English
Related papers

Related papers: MUSCAT: MUltilingual, SCientific ConversATion Benc…

200 papers

Recent advances in speech-enabled AI, including Google's NotebookLM and OpenAI's speech-to-speech API, are driving widespread interest in voice interfaces globally. Despite this momentum, there exists no publicly available…

Computation and Language · Computer Science 2025-11-19 Gabrial Zencha Ashungafac , Mardhiyah Sanni , Busayo Awobade , Alex Gichamba , Tobi Olatunji

Automatic Speech Recognition (ASR) systems now mediate countless human-technology interactions, yet research on their fairness implications remains surprisingly limited. This paper examines ASR bias through a philosophical lens, arguing…

Computation and Language · Computer Science 2025-08-14 Anna Seo Gyeong Choi , Hoon Choi

Recognizing overlapping speech from multiple speakers in conversational scenarios is one of the most challenging problem for automatic speech recognition (ASR). Serialized output training (SOT) is a classic method to address multi-talker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-02 Mohan Shi , Zengrui Jin , Yaoxun Xu , Yong Xu , Shi-Xiong Zhang , Kun Wei , Yiwen Shao , Chunlei Zhang , Dong Yu

The existing audio datasets are predominantly tailored towards single languages, overlooking the complex linguistic behaviors of multilingual communities that engage in code-switching. This practice, where individuals frequently mix two or…

Sound · Computer Science 2025-03-04 Peng Xie , Kani Chen

With the growing adoption of wearable devices such as smart glasses for AI assistants, wearer speech recognition (WSR) is becoming increasingly critical to next-generation human-computer interfaces. However, in real environments,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-19 Yufeng Yang , Yiteng Huang , Yong Xu , Li Wan , Suwon Shon , Yang Liu , Yifeng Fan , Zhaojun Yang , Olivier Siohan , Yue Liu , Ming Sun , Florian Metze

This paper addresses the question as to what degree a BERT-based multilingual Spoken Language Understanding (SLU) model can transfer knowledge across languages. Through experiments we will show that, although it works substantially well…

Computation and Language · Computer Science 2020-11-11 Quynh Do , Judith Gaspers , Tobias Roding , Melanie Bradford

Speaker Verification (SV) is a task to verify the claimed identity of the claimant using his/her voice sample. Though there exists an ample amount of research in SV technologies, the development concerning a multilingual conversation is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-28 Jagabandhu Mishra , Mrinmoy Bhattacharjee , S. R. Mahadeva Prasanna

In the field of speaker diarization, the development of technology is constrained by two problems: insufficient data resources and poor generalization ability of deep learning models. To address these two problems, firstly, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Shilong Wu

Recent years have seen a surge in finding association between faces and voices within a cross-modal biometric application along with speaker recognition. Inspired from this, we introduce a challenging task in establishing association…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Muhammad Saad Saeed , Shah Nawaz , Pietro Morerio , Arif Mahmood , Ignazio Gallo , Muhammad Haroon Yousaf , Alessio Del Bue

Multilingual end-to-end automatic speech recognition models are attractive due to its simplicity in training and deployment. Recent work on large-scale training of such models has shown promising results compared to monolingual models.…

Computation and Language · Computer Science 2022-10-13 Ke Hu , Bo Li , Tara N. Sainath

Multi-lingual speech recognition aims to distinguish linguistic expressions in different languages and integrate acoustic processing simultaneously. In contrast, current multi-lingual speech recognition research follows a language-aware…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-28 Yoohwan Kwon , Soo-Whan Chung

This paper tackles several challenges that arise when integrating Automatic Speech Recognition (ASR) and Machine Translation (MT) for real-time, on-device streaming speech translation. Although state-of-the-art ASR systems based on…

Computation and Language · Computer Science 2025-08-20 Zeeshan Ahmed , Frank Seide , Niko Moritz , Ju Lin , Ruiming Xie , Simone Merello , Zhe Liu , Christian Fuegen

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

Human-Computer Interaction · Computer Science 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

The Speaker Diarization and Recognition (SDR) task aims to predict "who spoke when and what" within an audio clip, which is a crucial task in various real-world multi-speaker scenarios such as meeting transcription and dialogue systems.…

Sound · Computer Science 2026-01-06 Han Yin , Yafeng Chen , Chong Deng , Luyao Cheng , Hui Wang , Chao-Hong Tan , Qian Chen , Wen Wang , Xiangang Li

This paper describes the systems developed by SPRING Lab, Indian Institute of Technology Madras, for the ASRU MADASR 2.0 challenge. The systems developed focuses on adapting ASR systems to improve in predicting the language and dialect of…

Computation and Language · Computer Science 2025-11-20 Arjun Gangwar , Kaousheik Jayakumar , S. Umesh

Multi-talker overlapped speech poses a significant challenge for speech recognition and diarization. Recent research indicated that these two tasks are inter-dependent and complementary, motivating us to explore a unified modeling method to…

Sound · Computer Science 2023-05-26 Lingwei Meng , Jiawen Kang , Mingyu Cui , Haibin Wu , Xixin Wu , Helen Meng

Large Automatic Speech Recognition (ASR) models demand a vast number of parameters, copious amounts of data, and significant computational resources during the training process. However, such models can merely be deployed on high-compute…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-23 Xingchen Song , Chengdong Liang , Binbin Zhang , Pengshen Zhang , ZiYu Wang , Youcheng Ma , Menglong Xu , Lin Wang , Di Wu , Fuping Pan , Dinghao Zhou , Zhendong Peng

In this paper, we present our studies and experiments carried out for the task 1 of the Challenge and Workshop on Multilingual Conversational Speech Language Model (MLC-SLM), which focuses on advancing multilingual conversational speech…

Sound · Computer Science 2025-07-28 Lorenzo Concina , Jordi Luque , Alessio Brutti , Marco Matassoni , Yuchen Zhang

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

Large language models (LLMs) have driven substantial advances in speech language models (SpeechLMs), yielding strong performance in automatic speech recognition (ASR) under high-resource conditions. However, existing benchmarks…

Computation and Language · Computer Science 2026-03-23 Jianan Chen , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen