English
Related papers

Related papers: RealClass: A Framework for Classroom Speech Simula…

200 papers

The use of synthetic speech as data augmentation is gaining increasing popularity in fields such as automatic speech recognition and speech classification tasks. Despite novel text-to-speech systems with voice cloning capabilities, that…

Sound · Computer Science 2024-09-20 Sebastião Quintas , Isabelle Ferrané , Thomas Pellegrini

Existing deep learning based speech enhancement mainly employ a data-driven approach, which leverage large amounts of data with a variety of noise types to achieve noise removal from noisy signal. However, the high dependence on the data…

Sound · Computer Science 2024-01-24 Huaying Xue , Xiulian Peng , Yan Lu

Samples with ground truth labels may not always be available in numerous domains. While learning from crowdsourcing labels has been explored, existing models can still fail in the presence of sparse, unreliable, or diverging annotations.…

Machine Learning · Computer Science 2021-12-07 Mani Sotoodeh , Li Xiong , Joyce C. Ho

This paper proposes Remixed2Remixed, a domain adaptation method for speech enhancement, which adopts Noise2Noise (N2N) learning to adapt models trained on artificially generated (out-of-domain: OOD) noisy-clean pair data to better separate…

Sound · Computer Science 2023-12-29 Li Li , Shogo Seki

The INTERSPEECH 2020 Deep Noise Suppression Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. A typical…

Audio adversarial examples are audio files that have been manipulated to fool an automatic speech recognition (ASR) system, while still sounding benign to a human listener. Most methods to generate such samples are based on a two-step…

Sound · Computer Science 2023-10-06 Armin Ettenhofer , Jan-Philipp Schulze , Karla Pizzi

Achieving robust speech separation for overlapping speakers in various acoustic environments with noise and reverberation remains an open challenge. Although existing datasets are available to train separators for specific scenarios, they…

Sound · Computer Science 2024-08-30 Ke Chen , Jiaqi Su , Taylor Berg-Kirkpatrick , Shlomo Dubnov , Zeyu Jin

We present RemixIT, a simple yet effective self-supervised method for training speech enhancement without the need of a single isolated in-domain speech nor a noise waveform. Our approach overcomes limitations of previous methods which make…

Sound · Computer Science 2022-08-30 Efthymios Tzinis , Yossi Adi , Vamsi Krishna Ithapu , Buye Xu , Paris Smaragdis , Anurag Kumar

Manually labeled corpora are expensive to create and often not available for low-resource languages or domains. Automatic labeling approaches are an alternative way to obtain labeled data in a quicker and cheaper way. However, these labels…

Machine Learning · Computer Science 2018-07-24 Michael A. Hedderich , Dietrich Klakow

Speech emotion recognition is an important component of any human centered system. But speech characteristics produced and perceived by a person can be influenced by a multitude of reasons, both desirable such as emotion, and undesirable…

Sound · Computer Science 2023-09-04 Mimansa Jaiswal , Emily Mower Provost

This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples.…

Sound · Computer Science 2021-09-21 Madhav Mahesh Kashyap , Anuj Tambwekar , Krishnamoorthy Manohara , S Natarajan

To train transcriptor models that produce robust results, a large and diverse labeled dataset is required. Finding such data with the necessary characteristics is a challenging task, especially for languages less popular than English.…

Sound · Computer Science 2026-05-01 Alexandre R. Ferreira , Cláudio E. C. Campelo

Advancements in artificial intelligence and machine learning have significantly improved synthetic speech generation. This paper explores diffusion models, a novel method for creating realistic synthetic speech. We create a diffusion…

Cryptography and Security · Computer Science 2025-01-15 Anton Firc , Kamil Malinka , Petr Hanáček

In recent years, text-to-audio models have revolutionized the field of automatic audio generation. This paper investigates their application in generating synthetic datasets for training data-driven models. Specifically, this study analyzes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Francesca Ronchini , Luca Comanducci , Fabio Antonacci

Recent advancements in foundational models, such as large language models and world models, have greatly enhanced the capabilities of robotics, enabling robots to autonomously perform complex tasks. However, acquiring large-scale,…

Factual consistency evaluation is often conducted using Natural Language Inference (NLI) models, yet these models exhibit limited success in evaluating summaries. Previous work improved such models with synthetic training data. However, the…

Computation and Language · Computer Science 2023-10-20 Zorik Gekhman , Jonathan Herzig , Roee Aharoni , Chen Elkind , Idan Szpektor

Recent breakthroughs in multi-talker ASR (MT-ASR) and speaker diarization (SD) rely on synthetic data to mitigate the scarcity of large-scale conversational recordings, yet the impact of specific simulation choices remains poorly…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-18 Alexander Polok , Ivan Medennikov , Jan Černocký , Shinji Watanabe , Lukáš Burget , Samuele Cornell

Singing voice synthesis has been paid rising attention with the rapid development of speech synthesis area. In general, a studio-level singing corpus is usually necessary to produce a natural singing voice from lyrics and music-related…

Sound · Computer Science 2020-11-18 Heyang Xue , Shan Yang , Yi Lei , Lei Xie , Xiulin Li

Cross-lingual synthesis can be defined as the task of letting a speaker generate fluent synthetic speech in another language. This is a challenging task, and resulting speech can suffer from reduced naturalness, accented speech, and/or loss…

Sound · Computer Science 2022-04-04 Marcel de Korte , Jaebok Kim , Aki Kunikoshi , Adaeze Adigwe , Esther Klabbers

During the pre-training step of natural language models, the main objective is to learn a general representation of the pre-training dataset, usually requiring large amounts of textual data to capture the complexity and diversity of natural…

Computation and Language · Computer Science 2023-10-23 Tobias Deußer , Cong Zhao , Wolfgang Krämer , David Leonhard , Christian Bauckhage , Rafet Sifa