English
Related papers

Related papers: Speak & Improve Challenge 2025: Tasks and Baseline…

200 papers

This paper presents a description and evaluation of the ROC Speak system, a platform that allows ubiquitous access to communication skills training. ROC Speak (available at rocspeak.com) enables anyone to go to a website, record a video,…

Human-Computer Interaction · Computer Science 2023-10-10 Ru Zhao , Vivian Li , Hugo Barbosa , Gourab Ghoshal , Mohammed , Hoque

Recent work in speech-to-speech translation (S2ST) has focused primarily on offline settings, where the full input utterance is available before any output is given. This, however, is not reasonable in many real-world scenarios. In…

Computation and Language · Computer Science 2023-06-05 Liam Dugan , Anshul Wadhawan , Kyle Spence , Chris Callison-Burch , Morgan McGuire , Victor Zordan

Automatic speech quality assessment is an important, transversal task whose progress is hampered by the scarcity of human annotations, poor generalization to unseen recording conditions, and a lack of flexibility of existing approaches. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Joan Serrà , Jordi Pons , Santiago Pascual

Speech recognition is very challenging in student learning environments that are characterized by significant cross-talk and background noise. To address this problem, we present a bilingual speech recognition system that uses an…

Recently there have been efforts to introduce new benchmark tasks for spoken language understanding (SLU), like semantic parsing. In this paper, we describe our proposed spoken semantic parsing system for the quality track (Track 1) in…

Computation and Language · Computer Science 2023-05-09 Siddhant Arora , Hayato Futami , Shih-Lun Wu , Jessica Huynh , Yifan Peng , Yosuke Kashiwagi , Emiru Tsunoo , Brian Yan , Shinji Watanabe

This paper describes the synthesis of the room acoustics challenge as a part of the generative data augmentation workshop at ICASSP 2025. The challenge defines a unique generative task that is designed to improve the quantity and diversity…

End-to-end (E2E) spoken dialogue systems are increasingly replacing cascaded pipelines for voice-based human-AI interaction, processing raw audio directly without intermediate transcription. Existing benchmarks primarily evaluate these…

The 2021 Speaker Recognition Evaluation (SRE21) was the latest cycle of the ongoing evaluation series conducted by the U.S. National Institute of Standards and Technology (NIST) since 1996. It was the second large-scale multimodal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-22 Seyed Omid Sadjadi , Craig Greenberg , Elliot Singer , Lisa Mason , Douglas Reynolds

We introduce a new unsupervised task, spoken language modeling: the learning of linguistic representations from raw audio signals without any labels, along with the Zero Resource Speech Benchmark 2021: a suite of 4 black-box, zero-shot…

Computation and Language · Computer Science 2020-12-02 Tu Anh Nguyen , Maureen de Seyssel , Patricia Rozé , Morgane Rivière , Evgeny Kharitonov , Alexei Baevski , Ewan Dunbar , Emmanuel Dupoux

The ICASSP 2023 Acoustic Echo Cancellation Challenge is intended to stimulate research in acoustic echo cancellation (AEC), which is an important area of speech enhancement and is still a top issue in audio communication. This is the fourth…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Ross Cutler , Ando Saabas , Tanel Parnamaa , Marju Purin , Evgenii Indenbom , Nicolae-Catalin Ristea , Jegor Gužvin , Hannes Gamper , Sebastian Braun , Robert Aichner

Speech Large Language Models (Speech LLMs) have emerged as a crucial paradigm in recent years, extending the capabilities of traditional LLMs to speech tasks such as automatic speech recognition (ASR) and spoken dialogue modeling. However,…

Computation and Language · Computer Science 2025-07-08 Phurich Saengthong , Boonnithi Jiaramaneepinit , Sheng Li , Manabu Okumura , Takahiro Shinozaki

Spoken question answering (SQA) systems are critical for digital assistants and other real-world use cases, but evaluating their performance is a challenge due to the importance of human-spoken questions. This study presents a new…

Computation and Language · Computer Science 2024-02-28 Yijing Wu , SaiKrishna Rallabandi , Ravisutha Srinivasamurthy , Parag Pravin Dakle , Alolika Gon , Preethi Raghavan

The DIarization of SPeaker and LAnguage in Conversational Environments (DISPLACE) 2024 challenge is the second in the series of DISPLACE challenges, which involves tasks of speaker diarization (SD) and language diarization (LD) on a…

This paper summarizes our submission to Task 2 of the second track of the 10th Dialog System Technology Challenge (DSTC10) "Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations". Similar to the previous year's…

Computation and Language · Computer Science 2021-12-17 David Thulke , Nico Daheim , Christian Dugast , Hermann Ney

As social-media platforms emerge and evolve faster than the regulations meant to oversee them, automated detoxification might serve as a timely tool for moderators to enforce safe discourse at scale. We here describe our submission to the…

Computation and Language · Computer Science 2026-02-03 Trung Duc Anh Dang , Ferdinando Pio D'Elia

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

Sound · Computer Science 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

This paper introduces GigaSpeech, an evolving, multi-domain English speech recognition corpus with 10,000 hours of high quality labeled audio suitable for supervised training, and 40,000 hours of total audio suitable for semi-supervised and…

The IEEE Spoken Language Technology Workshop (SLT) 2021 Alpha-mini Speech Challenge (ASC) is intended to improve research on keyword spotting (KWS) and sound source location (SSL) on humanoid robots. Many publications report significant…

This report details the NTU Speechlab system developed for the Interspeech 2025 Multilingual Conversational Speech and Language Model (MLC-SLM) Challenge (Task I), where we achieved 5th place. We present comprehensive analyses of our…

Computation and Language · Computer Science 2025-07-08 Yizhou Peng , Bin Wang , Yi-Wen Chao , Ziyang Ma , Haoyang Zhang , Hexin Liu , Xie Chen , Eng Siong Chng

Spoken Language Models (SLMs) aim to learn linguistic competence directly from speech using discrete units, widening access to Natural Language Processing (NLP) technologies for languages with limited written resources. However, progress…

Computation and Language · Computer Science 2026-02-23 Adel Moumen , Guangzhi Sun , Philip C. Woodland