English
Related papers

Related papers: On-the-Fly Data Augmentation via Gradient-Guided a…

200 papers

In many classification problems, we want a classifier that is robust to a range of non-semantic transformations. For example, a human can identify a dog in a picture regardless of the orientation and pose in which it appears. There is…

Machine Learning · Computer Science 2021-12-20 Scott Mahan , Tim Doster , Henry Kvinge

The challenge of Out-of-Distribution (OOD) generalization poses a foundational concern for the application of machine learning algorithms to risk-sensitive areas. Inspired by traditional importance weighting and propensity weighting…

Machine Learning · Computer Science 2025-02-12 Han Yu , Yue He , Renzhe Xu , Dongbai Li , Jiayin Zhang , Wenchao Zou , Peng Cui

Generative data augmentation, which scales datasets by obtaining fake labeled examples from a trained conditional generative model, boosts classification performance in various learning tasks including (semi-)supervised learning, few-shot…

Machine Learning · Computer Science 2023-05-30 Chenyu Zheng , Guoqiang Wu , Chongxuan Li

Data augmentation is a popular technique which helps improve generalization capabilities of deep neural networks. It plays a pivotal role in remote-sensing scenarios in which the amount of high-quality ground truth data is limited, and…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Jakub Nalepa , Michal Myller , Michal Kawulok

Training data attribution (TDA) methods aim to measure how training data impacts a model's predictions. While gradient-based attribution methods, such as influence functions, offer theoretical grounding, their computational costs make them…

Machine Learning · Computer Science 2025-11-27 Weiwei Sun , Haokun Liu , Nikhil Kandpal , Colin Raffel , Yiming Yang

Test-time adaptation (TTA) allows a model to be adapted to an unseen domain without accessing the source data. Due to the nature of practical environments, TTA has a limited amount of data for adaptation. Recent TTA methods further restrict…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Younggeol Cho , Youngrae Kim , Junho Yoon , Seunghoon Hong , Dongman Lee

Data augmentation has been an indispensable tool to improve the performance of deep neural networks, however the augmentation can hardly transfer among different tasks and datasets. Consequently, a recent trend is to adopt AutoML technique…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aoming Liu , Zehao Huang , Zhiwu Huang , Naiyan Wang

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

In semi-supervised semantic segmentation (SSSS), data augmentation plays a crucial role in the weak-to-strong consistency regularization framework, as it enhances diversity and improves model generalization. Recent strong augmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Lingyan Ran , Yali Li , Tao Zhuo , Shizhou Zhang , Yanning Zhang

Data augmentation (DA) is a powerful workhorse for bolstering performance in modern machine learning. Specific augmentations like translations and scaling in computer vision are traditionally believed to improve generalization by generating…

Machine Learning · Computer Science 2024-02-29 Chi-Heng Lin , Chiraag Kaushik , Eva L. Dyer , Vidya Muthukumar

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

As it is cumbersome and expensive to acquire a huge amount of data for training neural dialog models, data augmentation is proposed to effectively utilize existing training samples. However, current data augmentation techniques on the…

Computation and Language · Computer Science 2023-03-20 Xiuying Chen , Mingzhe Li , Jiayi Zhang , Xiaoqiang Xia , Chen Wei , Jianwei Cui , Xin Gao , Xiangliang Zhang , Rui Yan

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Data augmentation is widely used to train deep learning models to address data scarcity. However, traditional data augmentation (TDA) typically relies on simple geometric transformation, such as random rotation and rescaling, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Dekai Zhu , Stefan Gavranovic , Flavien Boussuge , Benjamin Busam , Slobodan Ilic

Data augmentation is vital for deep learning neural networks. By providing massive training samples, it helps to improve the generalization ability of the model. Weakly supervised semantic segmentation (WSSS) is a challenging problem that…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yukun Su , Ruizhou Sun , Guosheng Lin , Qingyao Wu

Dataset Distillation (DD), a newly emerging field, aims at generating much smaller but efficient synthetic training datasets from large ones. Existing DD methods based on gradient matching achieve leading performance; however, they are…

Machine Learning · Computer Science 2023-04-18 Lei Zhang , Jie Zhang , Bowen Lei , Subhabrata Mukherjee , Xiang Pan , Bo Zhao , Caiwen Ding , Yao Li , Dongkuan Xu

Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Ju Xu , Mengzhang Li , Zhanxing Zhu

Self-supervised learning (SSL) has emerged as a promising alternative to create supervisory signals to real-world problems, avoiding the extensive cost of manual labeling. SSL is particularly attractive for unsupervised tasks such as…

Machine Learning · Computer Science 2023-07-31 Jaemin Yoo , Tiancheng Zhao , Leman Akoglu

Deep learning has performed remarkably well on many tasks recently. However, the superior performance of deep models relies heavily on the availability of a large number of training data, which limits the wide adaptation of deep models on…

Machine Learning · Computer Science 2022-10-14 Huiyuan Yang , Han Yu , Akane Sano

We propose the AdaPtive Noise Augmentation (PANDA) procedure to regularize the estimation and inference of generalized linear models (GLMs). PANDA iteratively optimizes the objective function given noise augmented data until convergence to…

Machine Learning · Statistics 2022-04-20 Yinan Li , Fang Liu