English
Related papers

Related papers: A Diversity-Enhanced and Constraints-Relaxed Augme…

200 papers

Retrieval-augmented generation (RAG) enhances large language models (LLMs) with external knowledge but still suffers from long contexts and disjoint retrieval-generation optimization. In this work, we propose CLaRa (Continuous Latent…

Computation and Language · Computer Science 2026-02-09 Jie He , Richard He Bai , Sinead Williamson , Jeff Z. Pan , Navdeep Jaitly , Yizhe Zhang

Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples to build new training instances. Continued training with…

Computation and Language · Computer Science 2023-06-12 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). It approximates the update of a pretrained weight matrix $W\in\mathbb{R}^{m\times n}$ by the product of two low-rank…

Machine Learning · Computer Science 2025-08-12 Shiwei Li , Xiandi Luo , Haozhao Wang , Xing Tang , Ziqiang Cui , Dugang Liu , Yuhua Li , Xiuqiang He , Ruixuan Li

This paper investigates methods for improving generative data augmentation for deep learning. Generative data augmentation leverages the synthetic samples produced by generative models as an additional dataset for classification with small…

Machine Learning · Computer Science 2023-10-24 Shin'ya Yamaguchi , Daiki Chijiwa , Sekitoshi Kanai , Atsutoshi Kumagai , Hisashi Kashima

The generalization capability of deepfake detectors is critical for real-world use. Data augmentation via synthetic fake face generation effectively enhances generalization, yet current SoTA methods rely on fixed strategies-raising a key…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuxuan Zhou , Tao Yu , Wen Huang , Yuheng Zhang , Tao Dai , Shu-Tao Xia

Conversational recommender systems (CRSs) enhance recommendation quality by engaging users in multi-turn dialogues, capturing nuanced preferences through natural language interactions. However, these systems often face the false negative…

Information Retrieval · Computer Science 2025-08-11 Haozhe Xu , Xiaohua Wang , Changze Lv , Xiaoqing Zheng

In real-world applications, domain data often contains identifiable or sensitive attributes, is subject to strict regulations (e.g., HIPAA, GDPR), and requires explicit data feature engineering for interpretability and transparency.…

Machine Learning · Computer Science 2025-09-03 Arun Vignesh Malarkkan , Haoyue Bai , Anjali Kaushik , Yanjie Fu

This paper presents an effective and general data augmentation framework for medical image segmentation. We adopt a computationally efficient and data-efficient gradient-based meta-learning scheme to explicitly align the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zeju Li , Konstantinos Kamnitsas , Qi Dou , Chen Qin , Ben Glocker

Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create…

Sound · Computer Science 2024-06-12 Zhenyu Zhou , Shibiao Xu , Shi Yin , Lantian Li , Dong Wang

In recent years, semi-supervised graph learning with data augmentation (DA) is currently the most commonly used and best-performing method to enhance model robustness in sparse scenarios with few labeled samples. Differing from homogeneous…

Machine Learning · Computer Science 2022-12-02 Ying Chen , Siwei Qiang , Mingming Ha , Xiaolei Liu , Shaoshuai Li , Lingfeng Yuan , Xiaobo Guo , Zhenfeng Zhu

Large language models (LLMs) have demonstrated strong effectiveness and robustness while fine-tuned as dense retrievers. However, their large parameter size brings significant inference time computational challenges, including high encoding…

Computation and Language · Computer Science 2025-06-04 Xueguang Ma , Xi Victoria Lin , Barlas Oguz , Jimmy Lin , Wen-tau Yih , Xilun Chen

Data augmentation (DA) has been widely used to improve the generalization of deep neural networks. While existing DA methods have proven effective, they often rely on augmentation operations with random magnitudes to each sample. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Suorong Yang , Furao Shen , Jian Zhao

Data augmentation (DA) enhances model generalization in computer vision but may introduce biases, impacting class accuracy unevenly. Our study extends this inquiry, examining DA's class-specific bias across various datasets, including those…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Athanasios Angelakis , Andrey Rass

By generating new yet effective data, data augmentation has become a promising method to mitigate the data sparsity problem in sequential recommendation. Existing works focus on augmenting the original data but rarely explore the issue of…

Information Retrieval · Computer Science 2024-12-24 Yizhou Dang , Jiahui Zhang , Yuting Liu , Enneng Yang , Yuliang Liang , Guibing Guo , Jianzhe Zhao , Xingwei Wang

In modern mobile applications, users frequently encounter various new contexts, necessitating on-device continual learning (CL) to ensure consistent model performance. While existing research predominantly focused on developing lightweight…

Machine Learning · Computer Science 2024-10-25 Chen Gong , Zhenzhe Zheng , Fan Wu , Xiaofeng Jia , Guihai Chen

Deep learning models have a large number of freeparameters that need to be calculated by effective trainingof the models on a great deal of training data to improvetheir generalization performance. However, data obtaining andlabeling is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Benlin Hu , Cheng Lei , Dong Wang , Shu Zhang , Zhenyu Chen

Data augmentation has the potential to improve the performance of machine learning models by increasing the amount of training data available. In this study, we evaluated the effectiveness of different data augmentation techniques for a…

Machine Learning · Computer Science 2024-06-11 Aashish Arora , Elsbeth Turcan

Data Augmentation through generating pseudo data has been proven effective in mitigating the challenge of data scarcity in the field of Grammatical Error Correction (GEC). Various augmentation strategies have been widely explored, most of…

Computation and Language · Computer Science 2023-10-19 Jingheng Ye , Yinghui Li , Yangning Li , Hai-Tao Zheng

Counterfactual data augmentation (CDA) -- i.e., adding minimally perturbed inputs during training -- helps reduce model reliance on spurious correlations and improves generalization to out-of-distribution (OOD) data. Prior work on…

Computation and Language · Computer Science 2022-11-02 Tanay Dixit , Bhargavi Paranjape , Hannaneh Hajishirzi , Luke Zettlemoyer

Deep neural networks (DNNs) often rely on massive labelled data for training, which is inaccessible in many applications. Data augmentation (DA) tackles data scarcity by creating new labelled data from available ones. Different DA methods…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Binyan Hu , Yu Sun , A. K. Qin