English
Related papers

Related papers: Exploring Train and Test-Time Augmentations for Au…

200 papers

In the past five years, research has shifted from traditional Machine Learning (ML) and Deep Learning (DL) approaches to leveraging Large Language Models (LLMs) , including multimodality, for data augmentation to enhance generalization, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ranjan Sapkota , Shaina Raza , Maged Shoman , Achyut Paudel , Manoj Karkee

Data augmentation is known to contribute significantly to the robustness of machine learning models. In most instances, data augmentation is utilized during the training phase. Test-Time Augmentation (TTA) is a technique that instead…

Machine Learning · Statistics 2024-09-20 Masanari Kimura , Howard Bondell

Time masking has become a de facto augmentation technique for speech and audio tasks, including automatic speech recognition (ASR) and audio classification, most notably as a part of SpecAugment. In this work, we propose SpliceOut, a simple…

Sound · Computer Science 2021-10-14 Arjit Jain , Pranay Reddy Samala , Deepak Mittal , Preethi Jyoti , Maneesh Singh

Data augmentation methods have shown great importance in diverse supervised learning problems where labeled data is scarce or costly to obtain. For sound event localization and detection (SELD) tasks several augmentation methods have been…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-20 Ricardo Falcon-Perez , Kazuki Shimada , Yuichiro Koyama , Shusuke Takahashi , Yuki Mitsufuji

Test-time adaptation (TTA) aims to boost the generalization capability of a trained model by conducting self-/unsupervised learning during the testing phase. While most existing TTA methods for video primarily utilize visual supervisory…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Runhao Zeng , Qi Deng , Ronghao Zhang , Shuaicheng Niu , Jian Chen , Xiping Hu , Victor C. M. Leung

In this paper, we perform an in-depth study of how data augmentation techniques improve synthetic or spoofed audio detection. Specifically, we propose methods to deal with channel variability, different audio compressions, different…

Sound · Computer Science 2021-10-22 Ariel Cohen , Inbal Rimon , Eran Aflalo , Haim Permuter

Training a code-switching end-to-end automatic speech recognition (ASR) model normally requires a large amount of data, while code-switching data is often limited. In this paper, three novel approaches are proposed for code-switching data…

Computation and Language · Computer Science 2024-11-05 Chenpeng Du , Hao Li , Yizhou Lu , Lan Wang , Yanmin Qian

Recently, SpecAugment, an augmentation scheme for automatic speech recognition that acts directly on the spectrogram of input utterances, has shown to be highly effective in enhancing the performance of end-to-end networks on public…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-12 Daniel S. Park , Yu Zhang , Chung-Cheng Chiu , Youzheng Chen , Bo Li , William Chan , Quoc V. Le , Yonghui Wu

In this paper, we study the problem of data augmentation for language understanding in task-oriented dialogue system. In contrast to previous work which augments an utterance without considering its relation with other utterances, we…

Computation and Language · Computer Science 2018-07-05 Yutai Hou , Yijia Liu , Wanxiang Che , Ting Liu

The pre-trained multi-lingual XLSR model generalizes well for language identification after fine-tuning on unseen languages. However, the performance significantly degrades when the languages are not very distinct from each other, for…

Machine Learning · Computer Science 2023-02-17 Shangeth Rajaa , Kriti Anandan , Swaraj Dalmia , Tarun Gupta , Eng Siong Chng

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

Disordered speech recognition is a highly challenging task. The underlying neuro-motor conditions of people with speech disorders, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large…

Sound · Computer Science 2022-01-20 Mengzhe Geng , Xurong Xie , Shansong Liu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

Sequence-to-Sequence (S2S) models recently started to show state-of-the-art performance for automatic speech recognition (ASR). With these large and deep models overfitting remains the largest problem, outweighing performance improvements…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-04 Thai-Son Nguyen , Sebastian Stueker , Jan Niehues , Alex Waibel

A continued issue for those working with computational tools and endangered and under-resourced languages is the lower accuracy of results for languages with smaller amounts of data. We attempt to ameliorate this issue by using data…

Computation and Language · Computer Science 2025-04-10 Alessio Tosolini , Claire Bowern

The ability to jointly learn from multiple modalities, such as text, audio, and visual data, is a defining feature of intelligent systems. While there have been promising advances in designing neural networks to harness multimodal data, the…

Machine Learning · Computer Science 2023-04-25 Zichang Liu , Zhiqiang Tang , Xingjian Shi , Aston Zhang , Mu Li , Anshumali Shrivastava , Andrew Gordon Wilson

Deep learning technologies have significantly advanced the performance of target speaker extraction (TSE) tasks. To enhance the generalization and robustness of these algorithms when training data is insufficient, data augmentation is a…

Sound · Computer Science 2024-09-17 Junjie Li , Ke Zhang , Shuai Wang , Haizhou Li , Man-Wai Mak , Kong Aik Lee

Data Augmentation (DA) -- enriching training data by adding synthetic samples -- is a technique widely adopted in Computer Vision (CV) and Natural Language Processing (NLP) tasks to improve models performance. Yet, DA has struggled to gain…

Machine Learning · Computer Science 2024-01-24 Chao Wang , Alessandro Finamore , Pietro Michiardi , Massimo Gallo , Dario Rossi

We propose an on-the-fly data augmentation method for automatic speech recognition (ASR) that uses alignment information to generate effective training samples. Our method, called Aligned Data Augmentation (ADA) for ASR, replaces…

Computation and Language · Computer Science 2023-06-13 Tsz Kin Lam , Mayumi Ohta , Shigehiko Schamoni , Stefan Riezler

Audio data augmentation is a key step in training deep neural networks for solving audio classification tasks. In this paper, we introduce Audiogmenter, a novel audio data augmentation library in MATLAB. We provide 15 different augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Gianluca Maguolo , Michelangelo Paci , Loris Nanni , Ludovico Bonan

Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create…

Sound · Computer Science 2024-06-12 Zhenyu Zhou , Shibiao Xu , Shi Yin , Lantian Li , Dong Wang