English
Related papers

Related papers: End-To-End Deep Learning-based Adaptation Control …

200 papers

Despite recent improvements in End-to-End Automatic Speech Recognition (E2E ASR) systems, the performance can degrade due to vocal characteristic mismatches between training and testing data, particularly with limited target speaker…

In this article, we derive a new stepsize adaptation for the normalized least mean square algorithm (NLMS) by describing the task of linear acoustic echo cancellation from a Bayesian network perspective. Similar to the well-known Kalman…

Machine Learning · Statistics 2023-07-19 Christian Huemmer , Roland Maas , Walter Kellermann

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

The rise of advanced large language models such as GPT-4, GPT-4o, and the Claude family has made fake audio detection increasingly challenging. Traditional fine-tuning methods struggle to keep pace with the evolving landscape of synthetic…

Sound · Computer Science 2024-08-14 Xiaohui Zhang , Jiangyan Yi , Jianhua Tao

The constant Q transform (CQT) has been shown to be one of the most effective speech signal pre-transforms to facilitate synthetic speech detection, followed by either hand-crafted (subband) constant Q cepstral coefficient (CQCC) feature…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Guang Hua , Andrew Beng Jin Teoh , Haijian Zhang

The combination of a deep neural network (DNN) -based speech enhancement (SE) front-end and an automatic speech recognition (ASR) back-end is a widely used approach to implement overlapping speech recognition. However, the SE front-end…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Keisuke Kinoshita , Naoyuki Kamo , Takafumi Moriya

In this paper, we propose an end-to-end deep learning-based joint transceiver design algorithm for millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems, which consists of deep neural network (DNN)-aided pilot…

Information Theory · Computer Science 2021-10-27 Qiyu Hu , Yunlong Cai , Kai Kang , Guanding Yu , Jakob Hoydis , Yonina C. Eldar

Current audio deepfake detection has achieved remarkable performance using diverse deep learning architectures such as ResNet, and has seen further improvements with the introduction of large models (LMs) like Wav2Vec. The success of large…

Sound · Computer Science 2026-03-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn Schuller

A promising approach for speech dereverberation is based on supervised learning, where a deep neural network (DNN) is trained to predict the direct sound from noisy-reverberant speech. This data-driven approach is based on leveraging prior…

Sound · Computer Science 2021-11-11 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Recent advances in self-supervised learning (SSL) on Transformers have significantly improved speaker verification (SV) by providing domain-general speech representations. However, existing approaches have underutilized the multi-layered…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-16 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Juan Yun , Sung Won Han

Recent advances in the Active Speaker Detection (ASD) problem build upon a two-stage process: feature extraction and spatio-temporal context aggregation. In this paper, we propose an end-to-end ASD workflow where feature learning and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Juan Leon Alcazar , Moritz Cordes , Chen Zhao , Bernard Ghanem

Most neural-network based speaker-adaptive acoustic models for speech synthesis can be categorized into either layer-based or input-code approaches. Although both approaches have their own pros and cons, most existing works on speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-02 Hieu-Thi Luong , Junichi Yamagishi

Deep neural networks (DNNs) used for brain-computer-interface (BCI) classification are commonly expected to learn general features when trained across a variety of contexts, such that these features could be fine-tuned to specific contexts.…

Machine Learning · Computer Science 2021-01-29 Demetres Kostas , Stephane Aroca-Ouellette , Frank Rudzicz

The performance of automatic speech recognition (ASR) has improved tremendously due to the application of deep neural networks (DNNs). Despite this progress, building a new ASR system remains a challenging task, requiring various resources,…

Computation and Language · Computer Science 2015-10-20 Yajie Miao , Mohammad Gowayyed , Florian Metze

Adaptive network coding schemes provide a promising approach to bridging the gap between high data rates and low delay in real-time streaming applications. However, their effectiveness often relies on accurate channel prediction, which is…

Information Theory · Computer Science 2026-03-24 Adina Waxman , Nir Shlezinger , Alejandro Cohen

Recently, end-to-end mispronunciation detection and diagnosis (MD&D) systems has become a popular alternative to greatly simplify the model-building process of conventional hybrid DNN-HMM systems by representing complicated modules with a…

Computation and Language · Computer Science 2021-04-20 Kaiqi Fu , Jones Lin , Dengfeng Ke , Yanlu Xie , Jinsong Zhang , Binghuai Lin

Speech-related applications deliver inferior performance in complex noise environments. Therefore, this study primarily addresses this problem by introducing speech-enhancement (SE) systems based on deep neural networks (DNNs) applied to a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Syu-Siang Wang , Yu-You Liang , Jeih-weih Hung , Yu Tsao , Hsin-Min Wang , Shih-Hau Fang

The SOTA in transcription of disfluent and conversational speech has in recent years favored two-stage models, with separate transcription and cleaning stages. We believe that previous attempts at end-to-end disfluency removal have fallen…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-12 Saksham Bassi , Giulio Duregon , Siddhartha Jalagam , David Roth

Acoustic Echo Cancellation (AEC) is an essential speech signal processing technology that removes echoes from microphone inputs to facilitate natural-sounding full-duplex communication. Currently, deep learning-based AEC methods primarily…

Sound · Computer Science 2024-12-30 Fei Zhao , Xueliang Zhang

Clipping is a common nonlinear distortion that occurs whenever the input or output of an audio system exceeds the supported range. This phenomenon undermines not only the perception of speech quality but also downstream processes utilizing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Jayeon Yi , Junghyun Koo , Kyogu Lee