English
Related papers

Related papers: Revisiting Interpolation Augmentation for Speech-t…

200 papers

Despite significant advancements in multi-label text classification, the ability of existing models to generalize to novel and seldom-encountered complex concepts, which are compositions of elementary ones, remains underexplored. This…

Computation and Language · Computer Science 2023-12-21 Yuyang Chai , Zhuang Li , Jiahui Liu , Lei Chen , Fei Li , Donghong Ji , Chong Teng

Semi-supervised learning (SSL) has long been proved to be an effective technique to construct powerful models with limited labels. In the existing literature, consistency regularization-based methods, which force the perturbed samples to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Xihong Yang , Xiaochang Hu , Sihang Zhou , Xinwang Liu , En Zhu

While modern TTS technologies have made significant advancements in audio quality, there is still a lack of behavior naturalness compared to conversing with people. We propose a style-embedded TTS system that generates styled responses…

Sound · Computer Science 2020-09-23 Yang Gao , Weiyi Zheng , Zhaojun Yang , Thilo Kohler , Christian Fuegen , Qing He

Avoiding the risk of undefined categorical labels using nearest neighbor interpolation overlooks the risk of exacerbating pixel level annotation errors in augmented training data. Additionally, the inherent low pass filtering effects of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Olivier Rukundo

Labeling time series data is an expensive task because of domain expertise and dynamic nature of the data. Hence, we often have to deal with limited labeled data settings. Data augmentation techniques have been successfully deployed in…

Machine Learning · Computer Science 2023-04-11 Karan Aggarwal , Jaideep Srivastava

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2020-11-05 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Knowledge distillation is one of the primary methods of transferring knowledge from large to small models. However, it requires massive task-specific data, which may not be plausible in many real-world applications. Data augmentation…

Computation and Language · Computer Science 2023-03-14 Ziqi Wang , Yuexin Wu , Frederick Liu , Daogao Liu , Le Hou , Hongkun Yu , Jing Li , Heng Ji

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

Target confusion, defined as occasional switching to non-target speakers, poses a key challenge for end-to-end speaker extraction (E2E-SE) systems. We argue that this problem is largely caused by the lack of generalizability and…

Sound · Computer Science 2025-05-29 Zhenghai You , Zhenyu Zhou , Lantian Li , Dong Wang

Recent speech enhancement models have shown impressive performance gains by scaling up model complexity and training data. However, the impact of dataset variability (e.g. text, language, speaker, and noise) has been underexplored.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-20 Leying Zhang , Wangyou Zhang , Chenda Li , Yanmin Qian

In recent years, text-to-audio models have revolutionized the field of automatic audio generation. This paper investigates their application in generating synthetic datasets for training data-driven models. Specifically, this study analyzes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Francesca Ronchini , Luca Comanducci , Fabio Antonacci

This paper does not describe a new method; instead, it provides a thorough exploration of an important yet understudied design space related to recent advances in text-to-image synthesis -- specifically, the deep fusion of large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Bingda Tang , Boyang Zheng , Xichen Pan , Sayak Paul , Saining Xie

End-to-end text-to-speech (TTS) has shown great success on large quantities of paired text plus speech data. However, laborious data collection remains difficult for at least 95% of the languages over the world, which hinders the…

Computation and Language · Computer Science 2019-07-03 Tao Tu , Yuan-Jui Chen , Cheng-chieh Yeh , Hung-yi Lee

The current dominant approach for neural speech enhancement is via purely-supervised deep learning on simulated pairs of far-field noisy-reverberant speech (i.e., mixtures) and clean speech. The trained models, however, often exhibit…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Zhong-Qiu Wang

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

Self-supervised learned models have been found to be very effective for certain speech tasks such as automatic speech recognition, speaker identification, keyword spotting and others. While the features are undeniably useful in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Ravi Shankar , Ke Tan , Buye Xu , Anurag Kumar

Regularization is important for end-to-end speech models, since the models are highly flexible and easy to overfit. Data augmentation and dropout has been important for improving end-to-end models in other domains. However, they are…

Computation and Language · Computer Science 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

We address the problem of speech enhancement generalisation to unseen environments by performing two manipulations. First, we embed an additional recording from the environment alone, and use this embedding to alter activations in the main…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Gil Keren , Jing Han , Björn Schuller

Recently, retrieval-augmented text generation attracted increasing attention of the computational linguistics community. Compared with conventional generation models, retrieval-augmented text generation has remarkable advantages and…

Computation and Language · Computer Science 2022-02-15 Huayang Li , Yixuan Su , Deng Cai , Yan Wang , Lemao Liu

Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and…

Computation and Language · Computer Science 2023-02-08 Pinzhen Chen , Gerasimos Lampouras