English
Related papers

Related papers: Interpreting End-to-End Deep Learning Models for S…

200 papers

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

Sound · Computer Science 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez

Recently, a technique called Layer-wise Relevance Propagation (LRP) was shown to deliver insightful explanations in the form of input space relevances for understanding feed-forward neural network classification decisions. In the present…

Computation and Language · Computer Science 2017-08-08 Leila Arras , Grégoire Montavon , Klaus-Robert Müller , Wojciech Samek

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Machine learning (ML) is increasingly used to support decision-making in the healthcare sector. While ML approaches provide promising results with regard to their classification performance, most share a central limitation, namely their…

We propose to use neural networks for simultaneous detection and localization of multiple sound sources in human-robot interaction. In contrast to conventional signal processing techniques, neural network-based sound source localization…

Sound · Computer Science 2018-09-18 Weipeng He , Petr Motlicek , Jean-Marc Odobez

We propose an end-to-end model based on convolutional and recurrent neural networks for speech enhancement. Our model is purely data-driven and does not make any assumptions about the type or the stationarity of the noise. In contrast to…

Sound · Computer Science 2018-05-03 Han Zhao , Shuayb Zarar , Ivan Tashev , Chin-Hui Lee

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

Computation and Language · Computer Science 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

While deep learning models have made significant advances in supervised classification problems, the application of these models for out-of-set verification tasks like speaker recognition has been limited to deriving feature embeddings. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Shreyas Ramoji , Prashant Krishnan , Sriram Ganapathy

In this research, we advanced a spoken language recognition system, moving beyond traditional feature vector-based models. Our improvements focused on effectively capturing language characteristics over extended periods using a specialized…

Sound · Computer Science 2025-01-22 Or Haim Anidjar , Roi Yozevitch

Large language models (LLMs) not only exhibit human-like performance but also share computational principles with the brain's language processing mechanisms. While prior research has focused on mapping LLMs' internal representations to…

Computation and Language · Computer Science 2025-04-07 Maryam Rahimi , Yadollah Yaghoobzadeh , Mohammad Reza Daliri

Steered Response Power (SRP) is a widely used method for the task of sound source localization using microphone arrays, showing satisfactory localization performance on many practical scenarios. However, its performance is diminished under…

Sound · Computer Science 2024-03-15 Eric Grinstein , Toon van Waterschoot , Mike Brookes , Patrick A. Naylor

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

End-to-end neural network systems for automatic speech recognition (ASR) are trained from acoustic features to text transcriptions. In contrast to modular ASR systems, which contain separately-trained components for acoustic modeling,…

Computation and Language · Computer Science 2020-04-21 Yonatan Belinkov , Ahmed Ali , James Glass

Automated Speech Recognition (ASR) is an interdisciplinary application of computer science and linguistics that enable us to derive the transcription from the uttered speech waveform. It finds several applications in Military like…

Computation and Language · Computer Science 2022-04-05 Priyank Dubey , Bilal Shah

Time delay estimation is essential in Acoustic Source Localization (ASL) systems. One of the most used techniques for this purpose is the Generalized Cross Correlation (GCC) between a pair of signals and its use in Steered Response Power…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Juan Manuel Vera-Diaz , Daniel Pizarro , Javier Macias-Guarasa

In Neural Machine Translation (and, more generally, conditional language modeling), the generation of a target token is influenced by two types of context: the source and the prefix of the target sequence. While many attempts to understand…

Computation and Language · Computer Science 2021-06-28 Elena Voita , Rico Sennrich , Ivan Titov

Recent technological advancements have led to a large number of patents in a diverse range of domains, making it challenging for human experts to analyze and manage. State-of-the-art methods for multi-label patent classification rely on…

Artificial Intelligence · Computer Science 2024-07-30 Md Shajalal , Sebastian Denef , Md. Rezaul Karim , Alexander Boden , Gunnar Stevens

Current front-ends for robust automatic speech recognition(ASR) include masking- and mapping-based deep learning approaches to speech enhancement. A recently proposed deep learning approach toa prioriSNR estimation, called DeepXi, was able…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-29 Aaron Nicolson , Kuldip K. Paliwal

Personalized binaural audio reproduction is the basis of realistic spatial localization, sound externalization, and immersive listening, directly shaping user experience and listening effort. This survey reviews recent advances in deep…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Xikun Lu , Yunda Chen , Zehua Chen , Jie Wang , Mingxing Liu , Hongmei Hu , Chengshi Zheng , Stefan Bleeck , Jinqiu Sang

Speech contains information that is clinically relevant to some diseases, which has the potential to be used for health assessment. Recent work shows an interest in applying deep learning algorithms, especially pretrained large speech…

Sound · Computer Science 2024-07-02 Hok-Shing Lau , Mark Huntly , Nathon Morgan , Adesua Iyenoma , Biao Zeng , Tim Bashford