English
Related papers

Related papers: Understanding Data Augmentation from a Robustness …

200 papers

Recent work in incremental learning has introduced diverse approaches to tackle catastrophic forgetting from data augmentation to optimized training regimes. However, most of them focus on very few training steps. We propose a method for…

Computation and Language · Computer Science 2022-10-27 Karan Praharaj , Irina Matveeva

Data augmentation is one of the most widely used techniques to improve generalization in modern machine learning, often justified by its ability to promote invariance to label-irrelevant transformations. However, its theoretical role…

Machine Learning · Computer Science 2026-02-17 Abdelali Bouyahia , Frédéric LeBlanc , Mario Marchand

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Zhenlin Xu , Deyi Liu , Junlin Yang , Colin Raffel , Marc Niethammer

Table Structure Recognition is an essential part of end-to-end tabular data extraction in document images. The recent success of deep learning model architectures in computer vision remains to be non-reflective in table structure…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Umar Khan , Sohaib Zahid , Muhammad Asad Ali , Adnan ul Hassan , Faisal Shafait

We introduce AugLy, a data augmentation library with a focus on adversarial robustness. AugLy provides a wide array of augmentations for multiple modalities (audio, image, text, & video). These augmentations were inspired by those that real…

Artificial Intelligence · Computer Science 2022-01-19 Zoe Papakipos , Joanna Bitton

Data augmentation is widely used to enhance generalization in visual classification tasks. However, traditional methods struggle when source and target domains differ, as in domain adaptation, due to their inability to address domain gaps.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar , Naveed Akhtar

Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be…

Machine Learning · Computer Science 2021-03-29 Dafni Antotsiou , Carlo Ciliberto , Tae-Kyun Kim

Modern ML systems increasingly augment input instances with additional relevant information to enhance final prediction. Despite growing interest in such retrieval-augmented models, their fundamental properties and training are not well…

Machine Learning · Computer Science 2024-08-29 Soumya Basu , Ankit Singh Rawat , Manzil Zaheer

Current data augmentation techniques and transformations are well suited for improving the size and quality of natural image datasets but are not yet optimized for medical imaging. We hypothesize that sub-optimal data augmentations can…

Image and Video Processing · Electrical Eng. & Systems 2023-01-06 Tara M. Pattilachan , Ugur Demir , Elif Keles , Debesh Jha , Derk Klatte , Megan Engels , Sanne Hoogenboom , Candice Bolan , Michael Wallace , Ulas Bagci

Despite continued advancement in recent years, deep neural networks still rely on large amounts of training data to avoid overfitting. However, labeled training data for real-world applications such as healthcare is limited and difficult to…

Deploying machine learning systems in the real world requires both high accuracy on clean data and robustness to naturally occurring corruptions. While architectural advances have led to improved accuracy, building robust models remains…

Machine Learning · Computer Science 2019-06-07 Raphael Gontijo Lopes , Dong Yin , Ben Poole , Justin Gilmer , Ekin D. Cubuk

In this paper we propose a novel augmentation technique that improves not only the performance of deep neural networks on clean test data, but also significantly increases their robustness to random transformations, both affine and…

With the latest advances in Deep Learning-based generative models, it has not taken long to take advantage of their remarkable performance in the area of time series. Deep neural networks used to work with time series heavily depend on the…

Machine Learning · Computer Science 2024-02-19 Guillermo Iglesias , Edgar Talavera , Ángel González-Prieto , Alberto Mozo , Sandra Gómez-Canaval

Data augmentation has become a standard practice in software engineering to address limited or imbalanced data sets, particularly in specialized domains like test classification and bug detection where data can be scarce. Although…

Software Engineering · Computer Science 2025-02-05 Riddhi More , Jeremy S. Bradbury

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of…

Machine Learning · Computer Science 2022-02-08 Yuxin Yang , Xitong Zhang , Qiang Guan , Youzuo Lin

Coherence evaluation aims to assess the organization and structure of a discourse, which remains challenging even in the era of large language models. Due to the scarcity of annotated data, data augmentation is commonly used for training…

Computation and Language · Computer Science 2024-04-02 Dawei Zhu , Wenhao Wu , Yifan Song , Fangwei Zhu , Ziqiang Cao , Sujian Li

Deep learning has become a popular tool for medical image analysis, but the limited availability of training data remains a major challenge, particularly in the medical field where data acquisition can be costly and subject to privacy…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Su Ruan

Deep learning has performed remarkably well on many tasks recently. However, the superior performance of deep models relies heavily on the availability of a large number of training data, which limits the wide adaptation of deep models on…

Machine Learning · Computer Science 2022-10-14 Huiyuan Yang , Han Yu , Akane Sano

Deep (neural) networks have been applied productively in a wide range of supervised and unsupervised learning tasks. Unlike classical machine learning algorithms, deep networks typically operate in the \emph{overparameterized} regime, where…

Machine Learning · Computer Science 2019-10-14 Daniel LeJeune , Randall Balestriero , Hamid Javadi , Richard G. Baraniuk

While deep neural networks can attain good accuracy on in-distribution test points, many applications require robustness even in the face of unexpected perturbations in the input, changes in the domain, or other sources of distribution…

Machine Learning · Computer Science 2022-10-12 Marvin Zhang , Sergey Levine , Chelsea Finn