English
Related papers

Related papers: Acoustic modeling for Overlapping Speech Recogniti…

200 papers

We describe Microsoft's conversational speech recognition system, in which we combine recent developments in neural-network-based acoustic and language modeling to advance the state of the art on the Switchboard recognition task. Inspired…

Computation and Language · Computer Science 2022-02-24 W. Xiong , J. Droppo , X. Huang , F. Seide , M. Seltzer , A. Stolcke , D. Yu , G. Zweig

The goal of this work is to develop a meeting transcription system that can recognize speech even when utterances of different speakers are overlapped. While speech overlaps have been regarded as a major obstacle in accurately transcribing…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-10 Takuya Yoshioka , Hakan Erdogan , Zhuo Chen , Xiong Xiao , Fil Alleva

In the analysis of acoustic scenes, often the occurring sounds have to be detected in time, recognized, and localized in space. Usually, each of these tasks is done separately. In this paper, a model-based approach to jointly carry them out…

Sound · Computer Science 2017-12-20 Rupayan Chakraborty , Climent Nadeu

While end-to-end ASR systems have proven competitive with the conventional hybrid approach, they are prone to accuracy degradation when it comes to noisy and low-resource conditions. In this paper, we argue that, even in such difficult…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Andrei Andrusenko , Aleksandr Laptev , Ivan Medennikov

We propose an end-to-end speaker-attributed automatic speech recognition model that unifies speaker counting, speech recognition, and speaker identification on monaural overlapped speech. Our model is built on serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Naoyuki Kanda , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Tianyan Zhou , Takuya Yoshioka

Many approaches can derive information about a single speaker's identity from the speech by learning to recognize consistent characteristics of acoustic parameters. However, it is challenging to determine identity information when there are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Hyewon Han , Soo-Whan Chung , Hong-Goo Kang

The performance of automatic speech recognition systems degrades with increasing mismatch between the training and testing scenarios. Differences in speaker accents are a significant source of such mismatch. The traditional approach to deal…

Computation and Language · Computer Science 2018-02-09 Xuesong Yang , Kartik Audhkhasi , Andrew Rosenberg , Samuel Thomas , Bhuvana Ramabhadran , Mark Hasegawa-Johnson

This paper describes our submission to ICASSP 2022 Multi-channel Multi-party Meeting Transcription (M2MeT) Challenge. For Track 1, we propose several approaches to empower the clustering-based speaker diarization system to handle overlapped…

Sound · Computer Science 2022-02-11 Chen Shen , Yi Liu , Wenzhi Fan , Bin Wang , Shixue Wen , Yao Tian , Jun Zhang , Jingsheng Yang , Zejun Ma

Following the success of the 1st, 2nd, 3rd, 4th and 5th CHiME challenges we organize the 6th CHiME Speech Separation and Recognition Challenge (CHiME-6). The new challenge revisits the previous CHiME-5 challenge and further considers the…

Full-duplex spoken dialogue systems promise to transform human-machine interaction from a rigid, turn-based protocol into a fluid, natural conversation. However, the central challenge to realizing this vision, managing overlapping speech,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Guan-Ting Lin , Shih-Yun Shan Kuan , Qirui Wang , Jiachen Lian , Tingle Li , Shinji Watanabe , Hung-yi Lee

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

Computation and Language · Computer Science 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

Overlapped Speech Detection (OSD) is an important part of speech applications involving analysis of multi-party conversations. However, most of existing OSD systems are trained and evaluated on small datasets with limited application…

Sound · Computer Science 2023-09-08 Zhaohui Yin , Jingguang Tian , Xinhui Hu , Xinkang Xu , Yang Xiang

Conversational speech recognition has served as a flagship speech recognition task since the release of the Switchboard corpus in the 1990s. In this paper, we measure the human error rate on the widely used NIST 2000 test set, and find that…

Computation and Language · Computer Science 2018-12-06 W. Xiong , J. Droppo , X. Huang , F. Seide , M. Seltzer , A. Stolcke , D. Yu , G. Zweig

We describe a collection of acoustic and language modeling techniques that lowered the word error rate of our English conversational telephone LVCSR system to a record 6.6% on the Switchboard subset of the Hub5 2000 evaluation testset. On…

Computation and Language · Computer Science 2016-06-23 George Saon , Tom Sercu , Steven Rennie , Hong-Kwang J. Kuo

This technical report describes Johns Hopkins University speaker recognition system submitted to Voxceleb Speaker Recognition Challenge 2021 Track 3: Self-supervised speaker verification (closed). Our overall training process is similar to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-29 Jejin Cho , Jesus Villalba , Najim Dehak

Automatic recognition of overlapped speech remains a highly challenging task to date. Motivated by the bimodal nature of human speech perception, this paper investigates the use of audio-visual technologies for overlapped speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-07 Jianwei Yu , Shi-Xiong Zhang , Jian Wu , Shahram Ghorbani , Bo Wu , Shiyin Kang , Shansong Liu , Xunying Liu , Helen Meng , Dong Yu

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when…

Machine Learning · Computer Science 2022-05-09 Sanghyun Yoo , Inchul Song , Yoshua Bengio

Recent progress in separating the speech signals from multiple overlapping speakers using a single audio channel has brought us closer to solving the cocktail party problem. However, most studies in this area use a constrained problem…

Many existing speaker verification systems are reported to be vulnerable against different spoofing attacks, for example speaker-adapted speech synthesis, voice conversion, play back, etc. In order to detect these spoofed speech signals as…

Sound · Computer Science 2015-07-30 Shitao Weng , Shushan Chen , Lei Yu , Xuewei Wu , Weicheng Cai , Zhi Liu , Ming Li

This paper describes our Triple X speech recognition system submitted to Task 1 of the Multi-Lingual Conversational Speech Language Modeling (MLC-SLM) Challenge. Our work focuses on optimizing speech recognition accuracy in multilingual…

Computation and Language · Computer Science 2026-03-16 Miaomiao Gao , Xiaoxiao Xiang , Yiwen Guo