English
Related papers

Related papers: Sample Efficiency of Data Augmentation Consistency…

200 papers

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a means to reduce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

Data Augmentation (DA) is known to improve the generalizability of deep neural networks. Most existing DA techniques naively add a certain number of augmented samples without considering the quality and the added computational cost of these…

Machine Learning · Computer Science 2022-03-18 Ehsan Kamalloo , Mehdi Rezagholizadeh , Ali Ghodsi

Multi-label learning deals with the problem that each instance is associated with multiple labels simultaneously. Most of the existing approaches aim to improve the performance of multi-label learning by exploiting label correlations.…

Machine Learning · Computer Science 2022-01-19 Senlin Shu , Fengmao Lv , Yan Yan , Li Li , Shuo He , Jun He

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Pedestrian attribute recognition is an important multi-label classification problem. Although the convolutional neural networks are prominent in learning discriminative features from images, the data imbalance in multi-label setting for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Yang Hu , Xiaying Bai , Pan Zhou , Fanhua Shang , Shengmei Shen

Automated data augmentation has shown superior performance in image recognition. Existing works search for dataset-level augmentation policies without considering individual sample variations, which are likely to be sub-optimal. On the…

Machine Learning · Computer Science 2020-12-23 Fengwei Zhou , Jiawei Li , Chuanlong Xie , Fei Chen , Lanqing Hong , Rui Sun , Zhenguo Li

Current work in named entity recognition (NER) shows that data augmentation techniques can produce more robust models. However, most existing techniques focus on augmenting in-domain data in low-resource scenarios where annotated data is…

Computation and Language · Computer Science 2021-09-07 Shuguang Chen , Gustavo Aguilar , Leonardo Neves , Thamar Solorio

This paper discusses and evaluates ideas of data balancing and data augmentation in the context of mathematical objects: an important topic for both the symbolic computation and satisfiability checking communities, when they are making use…

Symbolic Computation · Computer Science 2023-08-21 Tereso del Rio , Matthew England

Data Augmentation (DA) has become an essential tool to improve robustness and generalization of modern machine learning. However, when deciding on DA strategies it is critical to choose parameters carefully, and this can be a daunting task…

Machine Learning · Computer Science 2026-03-04 Madi Matymov , Ba-Hien Tran , Michael Kampffmeyer , Markus Heinonen , Maurizio Filippone

Data augmentation is one of the most effective techniques to improve the generalization performance of deep neural networks. Yet, despite often facing limited data availability in medical image analysis, it is frequently underutilized. This…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Adam Tupper , Christian Gagné

The acquisition of large-scale, high-quality data is a resource-intensive and time-consuming endeavor. Compared to conventional Data Augmentation (DA) techniques (e.g. cropping and rotation), exploiting prevailing diffusion models for data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yunxiang Fu , Chaoqi Chen , Yu Qiao , Yizhou Yu

Data augmentation is a critical component of training deep learning models. Although data augmentation has been shown to significantly improve image classification, its potential has not been thoroughly investigated for object detection.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Barret Zoph , Ekin D. Cubuk , Golnaz Ghiasi , Tsung-Yi Lin , Jonathon Shlens , Quoc V. Le

In recent years, language models (LMs) have made remarkable progress in advancing the field of natural language processing (NLP). However, the impact of data augmentation (DA) techniques on the fine-tuning (FT) performance of these LMs has…

Computation and Language · Computer Science 2023-06-14 Zhengxiang Shi , Aldo Lipani

Data augmentation is arguably the most important regularization technique commonly used to improve generalization performance of machine learning models. It primarily involves the application of appropriate data transformation operations to…

Machine Learning · Computer Science 2025-03-07 Alhassan Mumuni , Fuseini Mumuni

Recent advancements in deep learning-based wearable human action recognition (wHAR) have improved the capture and classification of complex motions, but adoption remains limited due to the lack of expert annotations and domain discrepancies…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Indrajeet Ghosh , Garvit Chugh , Abu Zaher Md Faridee , Nirmalya Roy

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon

This paper addresses the problem of inverse covariance (also known as precision matrix) estimation in high-dimensional settings. Specifically, we focus on two classes of estimators: linear shrinkage estimators with a target proportional to…

Machine Learning · Statistics 2025-11-21 Lucas Morisset , Adrien Hardy , Alain Durmus

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

Machine Learning · Computer Science 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Ensemble methods which average over multiple neural network predictions are a simple approach to improve a model's calibration and robustness. Similarly, data augmentation techniques, which encode prior information in the form of invariant…

Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging…

Machine Learning · Computer Science 2020-06-02 Hongyuan You , Furkan Kocayusufoglu , Ambuj K. Singh