English
Related papers

Related papers: Speech-dependent Data Augmentation for Own Voice R…

200 papers

Training neural text-to-speech (TTS) models for a new speaker typically requires several hours of high quality speech data. Prior works on voice cloning attempt to address this challenge by adapting pre-trained multi-speaker TTS models for…

Sound · Computer Science 2022-04-07 Paarth Neekhara , Jason Li , Boris Ginsburg

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy

Sequence-to-Sequence (S2S) models recently started to show state-of-the-art performance for automatic speech recognition (ASR). With these large and deep models overfitting remains the largest problem, outweighing performance improvements…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-04 Thai-Son Nguyen , Sebastian Stueker , Jan Niehues , Alex Waibel

For real-time speech enhancement (SE) including noise suppression, dereverberation and acoustic echo cancellation, the time-variance of the audio signals becomes a severe challenge. The causality and memory usage limit that only the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-22 Chengyu Zheng , Yuan Zhou , Xiulian Peng , Yuan Zhang , Yan Lu

A large and growing amount of speech content in real-life scenarios is being recorded on consumer-grade devices in uncontrolled environments, resulting in degraded speech quality. Transforming such low-quality device-degraded speech into…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-23 Haoyu Li , Junichi Yamagishi

Supervised models for speech enhancement are trained using artificially generated mixtures of clean speech and noise signals. However, the synthetic training conditions may not accurately reflect real-world conditions encountered during…

The majority of deep learning-based speech enhancement methods require paired clean-noisy speech data. Collecting such data at scale in real-world conditions is infeasible, which has led the community to rely on synthetically generated…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Dominik Klement , Matthew Maciejewski , Sanjeev Khudanpur , Jan Černocký , Lukáš Burget

Self-supervised learning enables the training of large neural models without the need for large, labeled datasets. It has been generating breakthroughs in several fields, including computer vision, natural language processing, biology, and…

Computation and Language · Computer Science 2023-12-19 Luis Lugo , Valentin Vielzeuf

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (namely, eliminating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Yen-Ju Lu , Yu Tsao , Shinji Watanabe

While recent automatic speech recognition systems achieve remarkable performance when large amounts of adequate, high quality annotated speech data is used for training, the same systems often only achieve an unsatisfactory result for tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Michael Gref , Oliver Walter , Christoph Schmidt , Sven Behnke , Joachim Köhler

A new method has been developed to adjust volume automatically on all audio devices equipped with at least one microphone, including mobile phones, personal media players, headsets, and car radios, that might be used in noisy environments,…

Sound · Computer Science 2016-11-18 Franklin Felber

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

Sound · Computer Science 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

In noisy environments, speech can be hard to understand for humans. Spoken dialog systems can help to enhance the intelligibility of their output, either by modifying the speech synthesis (e.g., imitate Lombard speech) or by optimizing the…

Computation and Language · Computer Science 2022-10-20 Anupama Chingacham , Vera Demberg , Dietrich Klakow

Data augmentation is a valuable tool for the design of deep learning systems to overcome data limitations and stabilize the training process. Especially in the medical domain, where the collection of large-scale data sets is challenging and…

Machine Learning · Computer Science 2025-02-11 Mane Margaryan , Matthias Seibold , Indu Joshi , Mazda Farshad , Philipp Fürnstahl , Nassir Navab

The use of Transformer represents a recent success in speech enhancement. However, as its core component, self-attention suffers from quadratic complexity, which is computationally prohibited for long speech recordings. Moreover, it allows…

Sound · Computer Science 2023-05-16 Qiquan Zhang , Hongxu Zhu , Qi Song , Xinyuan Qian , Zhaoheng Ni , Haizhou Li

In recent years, text-to-audio models have revolutionized the field of automatic audio generation. This paper investigates their application in generating synthetic datasets for training data-driven models. Specifically, this study analyzes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Francesca Ronchini , Luca Comanducci , Fabio Antonacci

The development of data-driven heart sound classification models has been an active area of research in recent years. To develop such data-driven models in the first place, heart sound signals need to be captured using a signal acquisition…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Davoud Shariat Panah , Andrew Hines , Susan McKeever

Speech recognition system performance degrades in noisy environments. If the acoustic models are built using features of clean utterances, the features of a noisy test utterance would be acoustically mismatched with the trained model. This…

Computation and Language · Computer Science 2015-07-16 D. S. Pavan Kumar

In this letter, we derive a new super Gaussian Joint Maximum a Posteriori based single microphone speech enhancement gain function. The developed Speech Enhancement method is implemented on a smartphone, and this arrangement functions as an…

Sound · Computer Science 2019-07-04 Chandan K A Reddy , Nikhil Shankar , Gautam Bhat , Ram Charan , Issa Panahi

The demand for realistic virtual immersive audio continues to grow, with Head-Related Transfer Functions (HRTFs) playing a key role. HRTFs capture how sound reaches our ears, reflecting unique anatomical features and enhancing spatial…

Sound · Computer Science 2026-01-26 Xuyi Hu , Jian Li , Lorenzo Picinali , Aidan O. T. Hogg