English
Related papers

Related papers: GE2E-AC: Generalized End-to-End Loss Training for …

200 papers

In the traditional cascading architecture for spoken language understanding (SLU), it has been observed that automatic speech recognition errors could be detrimental to the performance of natural language understanding. End-to-end (E2E) SLU…

Computation and Language · Computer Science 2021-09-02 Qian Chen , Wen Wang , Qinglin Zhang

Generalized end-to-end (GE2E) model is widely used in speaker verification (SV) fields due to its expandability and generality regardless of specific languages. However, the long-short term memory (LSTM) based on GE2E has two limitations:…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Hyeonmook Park , Jungbae Park , Sang Wan Lee

This paper presents a simple end-to-end model for speech recognition, combining a convolutional network based acoustic model and a graph decoding. It is trained to output letters, with transcribed speech, without the need for force…

Machine Learning · Computer Science 2016-09-14 Ronan Collobert , Christian Puhrsch , Gabriel Synnaeve

Acoustic Event Classification (AEC) has become a significant task for machines to perceive the surrounding auditory scene. However, extracting effective representations that capture the underlying characteristics of the acoustic events is…

Sound · Computer Science 2021-06-22 Zixing Zhang , Ding Liu , Jing Han , Kun Qian , Björn Schuller

Effectiveness of speech emotion recognition in real-world scenarios is often hindered by noisy environments and variability across datasets. This paper introduces a two-step approach to enhance the robustness and generalization of speech…

Sound · Computer Science 2025-10-13 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded approaches (ASR+MT) often suffer from error propagation in the…

Computation and Language · Computer Science 2021-02-10 Junkun Chen , Mingbo Ma , Renjie Zheng , Liang Huang

In this paper, we propose a novel deep neural network architecture, Sequence-to-Sequence Audio2Vec, for unsupervised learning of fixed-length vector representations of audio segments excised from a speech corpus, where the vectors contain…

Computation and Language · Computer Science 2017-11-07 Yu-An Chung , James Glass

The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based time domain source…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-14 Thilo von Neumann , Keisuke Kinoshita , Lukas Drude , Christoph Boeddeker , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

This paper proposes an noise type classification aided attention-based neural network approach for monaural speech enhancement. The network is constructed based on a previous work by introducing a noise classification subnetwork into the…

Sound · Computer Science 2021-06-01 Lu Ma , Song Yang , Yaguang Gong , Zhongqin Wu

In recent years, end-to-end speech recognition has emerged as a technology that integrates the acoustic, pronunciation dictionary, and language model components of the traditional Automatic Speech Recognition model. It is possible to…

Computation and Language · Computer Science 2023-12-18 Tzu-Ting Yang , Hsin-Wei Wang , Berlin Chen

Speech to text models tend to be trained and evaluated against a single target accent. This is especially true for English for which native speakers from the United States became the main benchmark. In this work, we are going to show how…

Computation and Language · Computer Science 2022-12-26 Pooja Chitkara , Morgane Riviere , Jade Copet , Frank Zhang , Yatharth Saraf

In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are passed to the model…

Computation and Language · Computer Science 2021-06-01 Kevin Parnow , Zuchao Li , Hai Zhao

Accents play a pivotal role in shaping human communication, enhancing our ability to convey and comprehend messages with clarity and cultural nuance. While there has been significant progress in Automatic Speech Recognition (ASR),…

Computation and Language · Computer Science 2025-06-24 Bonaventure F. P. Dossou

Acoustic-to-Word recognition provides a straightforward solution to end-to-end speech recognition without needing external decoding, language model re-scoring or lexicon. While character-based models offer a natural solution to the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-22 Shruti Palaskar , Florian Metze

Inspite the emerging importance of Speech Emotion Recognition (SER), the state-of-the-art accuracy is quite low and needs improvement to make commercial applications of SER viable. A key underlying reason for the low accuracy is the…

Sound · Computer Science 2020-03-24 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Julien Epps , Björn W. Schuller

Audio Adversarial Examples (AAE) represent specially created inputs meant to trick Automatic Speech Recognition (ASR) systems into misclassification. The present work proposes MP3 compression as a means to decrease the impact of Adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Iustina Andronic , Ludwig Kürzinger , Edgar Ricardo Chavez Rosas , Gerhard Rigoll , Bernhard U. Seeber

Automated audio captioning (AAC) is the task of automatically creating textual descriptions (i.e. captions) for the contents of a general audio signal. Most AAC methods are using existing datasets to optimize and/or evaluate upon. Given the…

Sound · Computer Science 2021-07-19 Jan Berg , Konstantinos Drossos

Automatic speech recognition (ASR) has become increasingly ubiquitous on modern edge devices. Past work developed streaming End-to-End (E2E) all-neural speech recognizers that can run compactly on edge devices. However, E2E ASR models are…

Computation and Language · Computer Science 2021-07-13 Dilin Wang , Yuan Shangguan , Haichuan Yang , Pierce Chuang , Jiatong Zhou , Meng Li , Ganesh Venkatesh , Ozlem Kalinli , Vikas Chandra

Local dialects influence people to pronounce words of the same language differently from each other. The great variability and complex characteristics of accents creates a major challenge for training a robust and accent-agnostic automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-05 Genta Indra Winata , Samuel Cahyawijaya , Zihan Liu , Zhaojiang Lin , Andrea Madotto , Peng Xu , Pascale Fung

The problem of automatic accent identification is important for several applications like speaker profiling and recognition as well as for improving speech recognition systems. The accented nature of speech can be primarily attributed to…

Computation and Language · Computer Science 2018-06-20 Aditya Siddhant , Preethi Jyothi , Sriram Ganapathy