English
Related papers

Related papers: Data Augmentation for Training Dialog Models Robus…

200 papers

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

Computation and Language · Computer Science 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

In Speech Emotion Recognition (SER), textual data is often used alongside audio signals to address their inherent variability. However, the reliance on human annotated text in most research hinders the development of practical SER systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuanchao Li , Zeyu Zhao , Ondrej Klejch , Peter Bell , Catherine Lai

Automatic Speech Recognition (ASR) systems in real-world settings need to handle imperfect audio, often degraded by hardware limitations or environmental noise, while accommodating diverse user groups. In human-robot interaction (HRI),…

Robotics · Computer Science 2025-08-26 Theresa Pekarek Rosin , Julia Gachot , Henri-Leon Kordt , Matthias Kerzel , Stefan Wermter

Self-supervised learning (SSL) has allowed substantial progress in Automatic Speech Recognition (ASR) performance in low-resource settings. In this context, it has been demonstrated that larger self-supervised feature extractors are crucial…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Salah Zaiem , Robin Algayres , Titouan Parcollet , Slim Essid , Mirco Ravanelli

The awareness for biased ASR datasets or models has increased notably in recent years. Even for English, despite a vast amount of available training data, systems perform worse for non-native speakers. In this work, we improve an…

Computation and Language · Computer Science 2023-03-03 Philipp Klumpp , Pooja Chitkara , Leda Sarı , Prashant Serai , Jilong Wu , Irina-Elena Veliche , Rongqing Huang , Qing He

Speech recognition is the technology that enables machines to interpret and process human speech, converting spoken language into text or commands. This technology is essential for applications such as virtual assistants, transcription…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-09 Xinyu Wang , Haotian Jiang , Haolin Huang , Yu Fang , Mengjie Xu , Qian Wang

The usage of automatic speech recognition (ASR) systems are becoming omnipresent ranging from personal assistant to chatbots, home, and industrial automation systems, etc. Modern robots are also equipped with ASR capabilities for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Pradip Pramanick , Chayan Sarkar

In this paper, we analyzed how audio-visual speech enhancement can help to perform the ASR task in a cocktail party scenario. Therefore we considered two simple end-to-end LSTM-based models that perform single-channel audio-visual speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-28 Luca Pasa , Giovanni Morrone , Leonardo Badino

Conversational automatic speech recognition (ASR) is a task to recognize conversational speech including multiple speakers. Unlike sentence-level ASR, conversational ASR can naturally take advantages from specific characteristics of…

Sound · Computer Science 2022-02-18 Kun Wei , Yike Zhang , Sining Sun , Lei Xie , Long Ma

Spoken dialogue systems allow humans to interact with machines using natural speech. As such, they have many benefits. By using speech as the primary communication medium, a computer interface can facilitate swift, human-like acquisition of…

Computation and Language · Computer Science 2016-09-12 Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

Interactions with virtual assistants typically start with a predefined trigger phrase followed by the user command. To make interactions with the assistant more intuitive, we explore whether it is feasible to drop the requirement that users…

Computation and Language · Computer Science 2024-03-27 Dominik Wagner , Alexander Churchill , Siddharth Sigtia , Panayiotis Georgiou , Matt Mirsamadi , Aarshee Mishra , Erik Marchi

One of the central skills that language learners need to practice is speaking the language. Currently, students in school do not get enough speaking opportunities and lack conversational practice. Recent advances in speech technology and…

Computation and Language · Computer Science 2024-06-06 Janick Michot , Manuela Hürlimann , Jan Deriu , Luzia Sauer , Katsiaryna Mlynchyk , Mark Cieliebak

High-quality automatic speech recognition (ASR) is essential for virtual assistants (VAs) to work well. However, ASR often performs poorly on VA requests containing named entities. In this work, we start from the observation that many ASR…

Computation and Language · Computer Science 2021-09-22 Mandana Saebi , Ernest Pusateri , Aaksha Meghawat , Christophe Van Gysel

As end-to-end automatic speech recognition (ASR) models reach promising performance, various downstream tasks rely on good confidence estimators for these systems. Recent research has shown that model-based confidence estimators have a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-03 Qiujia Li , Yu Zhang , David Qiu , Yanzhang He , Liangliang Cao , Philip C. Woodland

Automatic speech recognition (ASR) models are typically trained on large datasets of transcribed speech. As language evolves and new terms come into use, these models can become outdated and stale. In the context of models trained on the…

Computation and Language · Computer Science 2023-12-04 Lillian Zhou , Yuxin Ding , Mingqing Chen , Harry Zhang , Rohit Prabhavalkar , Dhruv Guliani , Giovanni Motta , Rajiv Mathews

Advancements in conversational systems have revolutionized information access, surpassing the limitations of single queries. However, developing dialogue systems requires a large amount of training data, which is a challenge in low-resource…

Computation and Language · Computer Science 2024-03-05 Heydar Soudani , Evangelos Kanoulas , Faegheh Hasibi

With recent advances in speech synthesis, synthetic data is becoming a viable alternative to real data for training speech recognition models. However, machine learning with synthetic data is not trivial due to the gap between the synthetic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Ting-Yao Hu , Mohammadreza Armandpour , Ashish Shrivastava , Jen-Hao Rick Chang , Hema Koppula , Oncel Tuzel

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

Interactions with virtual assistants typically start with a trigger phrase followed by a command. In this work, we explore the possibility of making these interactions more natural by eliminating the need for a trigger phrase. Our goal is…

End-to-end models have achieved significant improvement on automatic speech recognition. One common method to improve performance of these models is expanding the data-space through data augmentation. Meanwhile, human auditory inspired…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-12 Zehai Tu , Jack Deadman , Ning Ma , Jon Barker