English
Related papers

Related papers: Language Agnostic Code-Mixing Data Augmentation by…

200 papers

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Therefore, this paper uses…

Computation and Language · Computer Science 2021-10-08 Liang-Hsuan Tseng , Yu-Kuan Fu , Heng-Jui Chang , Hung-yi Lee

Self-supervised learning (SSL) leverages large amounts of unlabelled data to learn rich speech representations, fostering improvements in automatic speech recognition (ASR), even when only a small amount of labelled data is available for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Carlos Carvalho , Alberto Abad

Code-switching (CSW) text generation has been receiving increasing attention as a solution to address data scarcity. In light of this growing interest, we need more comprehensive studies comparing different augmentation approaches. In this…

Computation and Language · Computer Science 2023-10-25 Injy Hamed , Nizar Habash , Ngoc Thang Vu

Deep learning-based pronunciation scoring models highly rely on the availability of the annotated non-native data, which is costly and has scalability issues. To deal with the data scarcity problem, data augmentation is commonly used for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Kaiqi Fu , Shaojun Gao , Kai Wang , Wei Li , Xiaohai Tian , Zejun Ma

The awareness for biased ASR datasets or models has increased notably in recent years. Even for English, despite a vast amount of available training data, systems perform worse for non-native speakers. In this work, we improve an…

Computation and Language · Computer Science 2023-03-03 Philipp Klumpp , Pooja Chitkara , Leda Sarı , Prashant Serai , Jilong Wu , Irina-Elena Veliche , Rongqing Huang , Qing He

Grounding-based vision and language models have been successfully applied to low-level vision tasks, aiming to precisely locate objects referred in captions. The effectiveness of grounding representation learning heavily relies on the scale…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Jingru Yi , Burak Uzkent , Oana Ignat , Zili Li , Amanmeet Garg , Xiang Yu , Linda Liu

There is a growing trend of teaching large language models (LLMs) to solve mathematical problems through coding. Existing studies primarily focus on prompting powerful, closed-source models to generate seed training data followed by…

Computation and Language · Computer Science 2024-08-29 Dian Yu , Baolin Peng , Ye Tian , Linfeng Song , Haitao Mi , Dong Yu

Contrastive learning has recently achieved compelling performance in unsupervised sentence representation. As an essential element, data augmentation protocols, however, have not been well explored. The pioneering work SimCSE resorting to a…

Computation and Language · Computer Science 2024-06-17 Dongsheng Zhu , Zhenyu Mao , Jinghui Lu , Rui Zhao , Fei Tan

Code-mixing, the blending of linguistic elements from distinct languages to form meaningful sentences, is common in multilingual settings, yielding hybrid languages like Hinglish and Minglish. Marathi, India's third most spoken language,…

Data augmentation with mixup has shown to be effective on various computer vision tasks. Despite its great success, there has been a hurdle to apply mixup to NLP tasks since text consists of discrete tokens with variable length. In this…

Computation and Language · Computer Science 2021-06-16 Soyoung Yoon , Gyuwan Kim , Kyumin Park

Code-switching (CS) refers to the switching of languages within a speech signal and results in language confusion for automatic speech recognition (ASR). To address language confusion, we propose a language alignment loss (LAL) that aligns…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Hexin Liu , Xiangyu Zhang , Haoyang Zhang , Leibny Paola Garcia , Andy W. H. Khong , Eng Siong Chng , Shinji Watanabe

Recent speech enhancement (SE) models increasingly leverage self-supervised learning (SSL) representations for their rich semantic information. Typically, intermediate features are aggregated into a single representation via a lightweight…

Sound · Computer Science 2026-02-02 Seungu Han , Sungho Lee , Kyogu Lee

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

There is an increasing demand for sentiment analysis of text from social media which are mostly code-mixed. Systems trained on monolingual data fail for code-mixed data due to the complexity of mixing at different levels of the text.…

Computation and Language · Computer Science 2021-06-09 Bharathi Raja Chakravarthi , Navya Jose , Shardul Suryawanshi , Elizabeth Sherly , John P. McCrae

With recent advances in speech synthesis, synthetic data is becoming a viable alternative to real data for training speech recognition models. However, machine learning with synthetic data is not trivial due to the gap between the synthetic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Ting-Yao Hu , Mohammadreza Armandpour , Ashish Shrivastava , Jen-Hao Rick Chang , Hema Koppula , Oncel Tuzel

Code-switching automatic speech recognition (CS-ASR) presents unique challenges due to language confusion introduced by spontaneous intra-sentence switching and accent bias that blurs the phonetic boundaries. Although the constituent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Hexin Liu , Haoyang Zhang , Qiquan Zhang , Xiangyu Zhang , Dongyuan Shi , Eng Siong Chng , Haizhou Li

Social networking platforms provide a conduit to disseminate our ideas, views and thoughts and proliferate information. This has led to the amalgamation of English with natively spoken languages. Prevalence of Hindi-English code-mixed data…

Computation and Language · Computer Science 2021-05-12 Ananya Srivastava , Mohammed Hasan , Bhargav Yagnik , Rahee Walambe , Ketan Kotecha

This paper explores the use of text data augmentation techniques to enhance conflict and duplicate detection in software engineering tasks through sentence pair classification. The study adapts generic augmentation techniques such as…

Software Engineering · Computer Science 2023-05-17 Garima Malik , Mucahit Cevik , Ayşe Başar

We propose a simple data augmentation protocol aimed at providing a compositional inductive bias in conditional and unconditional sequence models. Under this protocol, synthetic training examples are constructed by taking real training…

Computation and Language · Computer Science 2020-05-20 Jacob Andreas

In low resource settings, data augmentation strategies are commonly leveraged to improve performance. Numerous approaches have attempted document-level augmentation (e.g., text classification), but few studies have explored token-level…

Computation and Language · Computer Science 2022-10-04 Arie Pratama Sutiono , Gus Hahn-Powell