English
Related papers

Related papers: Data Augmenting Contrastive Learning of Speech Rep…

200 papers

Data augmentation is a key tool for improving the performance of deep networks, particularly when there is limited labeled data. In some fields, such as computer vision, augmentation methods have been extensively studied; however, for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Zuzhao Ye , Gregory Ciccarelli , Brian Kulis

The optimization of a wavelet-based algorithm to improve speech intelligibility along with the full data set and results are reported. The discrete-time speech signal is split into frequency sub-bands via a multi-level discrete wavelet…

Sound · Computer Science 2022-07-25 Tianqu Kang , Anh-Dung Dinh , Binghong Wang , Tianyuan Du , Yijia Chen , Kevin Chau

Dialogue understanding tasks often necessitate abundant annotated data to achieve good performance and that presents challenges in low-resource settings. To alleviate this barrier, we explore few-shot data augmentation for dialogue…

Computation and Language · Computer Science 2022-11-03 Maximillian Chen , Alexandros Papangelis , Chenyang Tao , Andy Rosenbaum , Seokhwan Kim , Yang Liu , Zhou Yu , Dilek Hakkani-Tur

Unsupervised learning plays an important role in many fields, such as artificial intelligence, machine learning, and neuroscience. Compared to static data, methods for extracting low-dimensional structure for dynamic data are lagging. We…

Machine Learning · Computer Science 2022-03-07 Rui Meng , Tianyi Luo , Kristofer Bouchard

Creating Automatic Speech Recognition (ASR) systems that are robust and resilient to classroom conditions is paramount to the development of AI tools to aid teachers and students. In this work, we study the efficacy of continued pretraining…

Computation and Language · Computer Science 2025-03-13 Ahmed Adel Attia , Dorottya Demszky , Tolulope Ogunremi , Jing Liu , Carol Espy-Wilson

Data augmentation in deep neural networks is the process of generating artificial data in order to reduce the variance of the classifier with the goal to reduce the number of errors. This idea has been shown to improve deep neural network's…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller

Human talkers often address listeners with language-comprehension challenges, such as hard-of-hearing or non-native adults, by globally slowing down their speech. However, it remains unclear whether this strategy actually makes speech more…

Computation and Language · Computer Science 2026-04-01 Paige Tuttösí , Angelica Lim , H. Henny Yeung , Yue Wang , Jean-Julien Aucouturier

Data augmentation (DA) has gained widespread popularity in deep speaker models due to its ease of implementation and significant effectiveness. It enriches training data by simulating real-life acoustic variations, enabling deep neural…

Sound · Computer Science 2024-02-07 Zhenyu Zhou , Junhui Chen , Namin Wang , Lantian Li , Dong Wang

Data augmentation is a widely adopted technique utilized to improve the robustness of automatic speech recognition (ASR). Employing a fixed data augmentation strategy for all training data is a common practice. However, it is important to…

Sound · Computer Science 2024-12-03 Hongxuan Lu , Biao Li

Self-supervised contrastive learning has become a key technique in deep learning, particularly in time series analysis, due to its ability to learn meaningful representations without explicit supervision. Augmentation is a critical…

Machine Learning · Computer Science 2024-07-15 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

The majority of deep learning-based speech enhancement methods require paired clean-noisy speech data. Collecting such data at scale in real-world conditions is infeasible, which has led the community to rely on synthetically generated…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Dominik Klement , Matthew Maciejewski , Sanjeev Khudanpur , Jan Černocký , Lukáš Burget

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

Sound · Computer Science 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

Deep learning-based pronunciation scoring models highly rely on the availability of the annotated non-native data, which is costly and has scalability issues. To deal with the data scarcity problem, data augmentation is commonly used for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Kaiqi Fu , Shaojun Gao , Kai Wang , Wei Li , Xiaohai Tian , Zejun Ma

Sequential recommendation systems are integral to discerning temporal user preferences. Yet, the task of learning from abbreviated user interaction sequences poses a notable challenge. Data augmentation has been identified as a potent…

Information Retrieval · Computer Science 2025-02-25 Juyong Jiang , Peiyan Zhang , Yingtao Luo , Chaozhuo Li , Jae Boum Kim , Kai Zhang , Senzhang Wang , Sunghun Kim , Philip S. Yu

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

Machine Learning · Computer Science 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create…

Sound · Computer Science 2024-06-12 Zhenyu Zhou , Shibiao Xu , Shi Yin , Lantian Li , Dong Wang

Coherence evaluation aims to assess the organization and structure of a discourse, which remains challenging even in the era of large language models. Due to the scarcity of annotated data, data augmentation is commonly used for training…

Computation and Language · Computer Science 2024-04-02 Dawei Zhu , Wenhao Wu , Yifan Song , Fangwei Zhu , Ziqiang Cao , Sujian Li

Sequential recommender systems (SRS) are designed to predict users' future behaviors based on their historical interaction data. Recent research has increasingly utilized contrastive learning (CL) to leverage unsupervised signals to…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , You-Liang Huang , Yueqi Xie , Jingqi Gao , Shoujin Wang , Jae Boum Kim , Sunghun Kim

Code search, which aims at retrieving the most relevant code fragment for a given natural language query, is a common activity in software development practice. Recently, contrastive learning is widely used in code search research, where…

Software Engineering · Computer Science 2022-10-25 Haochen Li , Chunyan Miao , Cyril Leung , Yanxian Huang , Yuan Huang , Hongyu Zhang , Yanlin Wang