English

G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition

Audio and Speech Processing 2026-03-12 v1 Artificial Intelligence Human-Computer Interaction Multimedia Sound

Abstract

We study timestamped speaker-attributed ASR for long-form, multi-party speech with overlap, where chunk-wise inference must preserve meeting-level speaker identity consistency while producing time-stamped, speaker-labeled transcripts. Previous Speech-LLM systems tend to prioritize either local diarization or global labeling, but often lack the ability to capture fine-grained temporal boundaries or robust cross-chunk identity linking. We propose G-STAR, an end-to-end system that couples a time-aware speaker-tracking module with a Speech-LLM transcription backbone. The tracker provides structured speaker cues with temporal grounding, and the LLM generates attributed text conditioned on these cues. G-STAR supports both component-wise optimization and joint end-to-end training, enabling flexible learning under heterogeneous supervision and domain shift. Experiments analyze cue fusion, local versus long-context trade-offs and hierarchical objectives.

Keywords

Cite

@article{arxiv.2603.10468,
  title  = {G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition},
  author = {Jing Peng and Ziyi Chen and Haoyu Li and Yucheng Wang and Duo Ma and Mengtian Li and Yunfan Du and Dezhu Xu and Kai Yu and Shuai Wang},
  journal= {arXiv preprint arXiv:2603.10468},
  year   = {2026}
}

Comments

submitted to Interspeech 2026

R2 v1 2026-07-01T11:14:13.308Z