Research

Paper

AI LLM March 11, 2026

G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition

Authors

Jing Peng, Ziyi Chen, Haoyu Li, Yucheng Wang, Duo Ma, Mengtian Li, Yunfan Du, Dezhu Xu, Kai Yu, Shuai Wang

Abstract

We study timestamped speaker-attributed ASR for long-form, multi-party speech with overlap, where chunk-wise inference must preserve meeting-level speaker identity consistency while producing time-stamped, speaker-labeled transcripts. Previous Speech-LLM systems tend to prioritize either local diarization or global labeling, but often lack the ability to capture fine-grained temporal boundaries or robust cross-chunk identity linking. We propose G-STAR, an end-to-end system that couples a time-aware speaker-tracking module with a Speech-LLM transcription backbone. The tracker provides structured speaker cues with temporal grounding, and the LLM generates attributed text conditioned on these cues. G-STAR supports both component-wise optimization and joint end-to-end training, enabling flexible learning under heterogeneous supervision and domain shift. Experiments analyze cue fusion, local versus long-context trade-offs and hierarchical objectives.

Metadata

arXiv ID: 2603.10468
Provider: ARXIV
Primary Category: eess.AS
Published: 2026-03-11
Fetched: 2026-03-12 04:21

Related papers

Raw Data (Debug)
{
  "raw_xml": "<entry>\n    <id>http://arxiv.org/abs/2603.10468v1</id>\n    <title>G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition</title>\n    <updated>2026-03-11T06:40:01Z</updated>\n    <link href='https://arxiv.org/abs/2603.10468v1' rel='alternate' type='text/html'/>\n    <link href='https://arxiv.org/pdf/2603.10468v1' rel='related' title='pdf' type='application/pdf'/>\n    <summary>We study timestamped speaker-attributed ASR for long-form, multi-party speech with overlap, where chunk-wise inference must preserve meeting-level speaker identity consistency while producing time-stamped, speaker-labeled transcripts. Previous Speech-LLM systems tend to prioritize either local diarization or global labeling, but often lack the ability to capture fine-grained temporal boundaries or robust cross-chunk identity linking. We propose G-STAR, an end-to-end system that couples a time-aware speaker-tracking module with a Speech-LLM transcription backbone. The tracker provides structured speaker cues with temporal grounding, and the LLM generates attributed text conditioned on these cues. G-STAR supports both component-wise optimization and joint end-to-end training, enabling flexible learning under heterogeneous supervision and domain shift. Experiments analyze cue fusion, local versus long-context trade-offs and hierarchical objectives.</summary>\n    <category scheme='http://arxiv.org/schemas/atom' term='eess.AS'/>\n    <category scheme='http://arxiv.org/schemas/atom' term='cs.AI'/>\n    <category scheme='http://arxiv.org/schemas/atom' term='cs.HC'/>\n    <category scheme='http://arxiv.org/schemas/atom' term='cs.MM'/>\n    <category scheme='http://arxiv.org/schemas/atom' term='cs.SD'/>\n    <published>2026-03-11T06:40:01Z</published>\n    <arxiv:comment>submitted to Interspeech 2026</arxiv:comment>\n    <arxiv:primary_category term='eess.AS'/>\n    <author>\n      <name>Jing Peng</name>\n    </author>\n    <author>\n      <name>Ziyi Chen</name>\n    </author>\n    <author>\n      <name>Haoyu Li</name>\n    </author>\n    <author>\n      <name>Yucheng Wang</name>\n    </author>\n    <author>\n      <name>Duo Ma</name>\n    </author>\n    <author>\n      <name>Mengtian Li</name>\n    </author>\n    <author>\n      <name>Yunfan Du</name>\n    </author>\n    <author>\n      <name>Dezhu Xu</name>\n    </author>\n    <author>\n      <name>Kai Yu</name>\n    </author>\n    <author>\n      <name>Shuai Wang</name>\n    </author>\n  </entry>"
}