English
Related papers

Related papers: STCON System for the CHiME-8 Challenge

200 papers

Target audio source separation with natural language queries presents a promising paradigm for extracting arbitrary audio events through arbitrary text descriptions. Existing methods mainly face two challenges, the difficulty in jointly…

Sound · Computer Science 2025-12-03 Xinlei Yin , Xiulian Peng , Xue Jiang , Zhiwei Xiong , Yan Lu

In multi-lingual societies, where multiple languages are spoken in a small geographic vicinity, informal conversations often involve mix of languages. Existing speech technologies may be inefficient in extracting information from such…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-04 Shikha Baghel , Shreyas Ramoji , Somil Jain , Pratik Roy Chowdhuri , Prachi Singh , Deepu Vijayasenan , Sriram Ganapathy

This paper describes the FlySpeech speaker diarization system submitted to the second \textbf{M}ultimodal \textbf{I}nformation Based \textbf{S}peech \textbf{P}rocessing~(\textbf{MISP}) Challenge held in ICASSP 2022. We develop an end-to-end…

Sound · Computer Science 2023-07-31 Li Zhang , Huan Zhao , Yue Li , Bowen Pang , Yannan Wang , Hongji Wang , Wei Rao , Qing Wang , Lei Xie

In this report, we summarize the integrated multilingual audio processing pipeline developed by our team for the inaugural NCIIPC Startup India AI GRAND CHALLENGE, addressing Problem Statement 06: Language-Agnostic Speaker Identification…

Automatic speaker diarization techniques typically involve a two-stage processing approach where audio segments of fixed duration are converted to vector representations in the first stage. This is followed by an unsupervised clustering of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-15 Prachi Singh , Sriram Ganapathy

Pre-trained self-supervised learning (SSL) models have achieved remarkable success in various speech tasks. However, their potential in target speech extraction (TSE) has not been fully exploited. TSE aims to extract the speech of a target…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-21 Junyi Peng , Marc Delcroix , Tsubasa Ochiai , Oldrich Plchot , Shoko Araki , Jan Cernocky

Extracting the speech of a target speaker from mixed audios, based on a reference speech from the target speaker, is a challenging yet powerful technology in speech processing. Recent studies of speaker-independent speech separation, such…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Zining Zhang , Bingsheng He , Zhenjie Zhang

This report describes the submitted system to the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) challenge, which considers the ASR task with multi-speaker overlapping and Mandarin accent dynamics in the ICMC case. We…

Target Speaker Extraction (TSE) uses a reference cue to extract the target speech from a mixture. In TSE systems relying on audio cues, the speaker embedding from the enrolled speech is crucial to performance. However, these embeddings may…

Sound · Computer Science 2025-08-12 Shu Wu , Anbin Qi , Yanzhang Xie , Xiang Xie

While speech recognition Word Error Rate (WER) has reached human parity for English, long-form dictation scenarios still suffer from segmentation and punctuation problems resulting from irregular pausing patterns or slow speakers.…

Computation and Language · Computer Science 2022-12-07 Piyush Behre , Sharman Tan , Padma Varadharajan , Shuangyu Chang

Speaker diarization, the process of segmenting an audio stream or transcribed speech content into homogenous partitions based on speaker identity, plays a crucial role in the interpretation and analysis of human speech. Most existing…

Machine Learning · Computer Science 2024-08-23 Luyao Cheng , Hui Wang , Siqi Zheng , Yafeng Chen , Rongjie Huang , Qinglin Zhang , Qian Chen , Xihao Li

This paper describes the submission to the speaker diarization track of VoxCeleb Speaker Recognition Challenge 2021 done by North America Bixby Lab of Samsung Research America. Our speaker diarization system consists of four main components…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-29 Myungjong Kim , Taeyeon Ki , Aviral Anshu , Vijendra Raj Apsingekar

This paper aims to achieve single-channel target speech extraction (TSE) in enclosures utilizing distance clues and room information. Recent works have verified the feasibility of distance clues for the TSE task, which can imply the sound…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Runwu Shi , Zirui Lin , Benjamin Yen , Jiang Wang , Ragib Amin Nihal , Kazuhiro Nakadai

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy

This technical report describes our system for track 1, 2 and 4 of the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22). By combining several ResNet variants, our submission for track 1 attained a minDCF of 0:090 with EER 1:401%. By…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-26 Qutang Cai , Guoqiang Hong , Zhijian Ye , Ximin Li , Haizhou Li

This paper presents Transcribe-to-Diarize, a new approach for neural speaker diarization that uses an end-to-end (E2E) speaker-attributed automatic speech recognition (SA-ASR). The E2E SA-ASR is a joint model that was recently proposed for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 Naoyuki Kanda , Xiong Xiao , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

This paper describes a spatial-aware speaker diarization system for the multi-channel multi-party meeting. The diarization system obtains direction information of speaker by microphone array. Speaker spatial embedding is generated by…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-27 Jie Wang , Yuji Liu , Binling Wang , Yiming Zhi , Song Li , Shipeng Xia , Jiayang Zhang , Feng Tong , Lin Li , Qingyang Hong

This report describes the submission of the DKU-DukeECE-Lenovo team to the VoxCeleb Speaker Recognition Challenge (VoxSRC) 2021 track 4. Our system including a voice activity detection (VAD) model, a speaker embedding model, two…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-08 Weiqing Wang , Danwei Cai , Qingjian Lin , Lin Yang , Junjie Wang , Jin Wang , Ming Li

This paper presents the system developed for Task 1 of the Multi-modal Information-based Speech Processing (MISP) 2025 Challenge. We introduce CASA-Net, an embedding fusion method designed for end-to-end audio-visual speaker diarization…

Sound · Computer Science 2025-06-04 Zhaoyang Li , Haodong Zhou , Longjie Luo , Xiaoxiao Li , Yongxin Chen , Lin Li , Qingyang Hong

The NIST Speaker Recognition Evaluation - Conversational Telephone Speech (CTS) challenge 2019 was an open evaluation for the task of speaker verification in challenging conditions. In this paper, we provide a detailed account of the LEAP…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Shreyas Ramoji , Prashant Krishnan , Bhargavram Mysore , Prachi Singh , Sriram Ganapathy