English
Related papers

Related papers: AugLy: Data Augmentations for Robustness

200 papers

Graph augmentation with contrastive learning has gained significant attention in the field of recommendation systems due to its ability to learn expressive user representations, even when labeled data is limited. However, directly applying…

Machine Learning · Computer Science 2024-03-26 Qianru Zhang , Lianghao Xia , Xuheng Cai , Siuming Yiu , Chao Huang , Christian S. Jensen

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

Machine Learning · Computer Science 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

Data augmentation (DA) techniques aim to increase data variability, and thus train deep networks with better generalisation. The pioneering AutoAugment automated the search for optimal DA policies with reinforcement learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Yonggang Li , Guosheng Hu , Yongtao Wang , Timothy Hospedales , Neil M. Robertson , Yongxin Yang

Research on data generation and augmentation has been focused majorly on enhancing generation models, leaving a notable gap in the exploration and refinement of methods for evaluating synthetic data. There are several text similarity…

Computation and Language · Computer Science 2023-11-09 Tiasa Singha Roy , Priyam Basu

Data augmentations are important in training high-performance 3D object detectors for point clouds. Despite recent efforts on designing new data augmentations, perhaps surprisingly, most state-of-the-art 3D detectors only use a few simple…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhaoqi Leng , Guowang Li , Chenxi Liu , Ekin Dogus Cubuk , Pei Sun , Tong He , Dragomir Anguelov , Mingxing Tan

In this paper we propose a novel augmentation technique that improves not only the performance of deep neural networks on clean test data, but also significantly increases their robustness to random transformations, both affine and…

Adversarial images are designed to mislead deep neural networks (DNNs), attracting great attention in recent years. Although several defense strategies achieved encouraging robustness against adversarial samples, most of them fail to…

Machine Learning · Computer Science 2020-02-25 Hang Yu , Aishan Liu , Xianglong Liu , Gengchao Li , Ping Luo , Ran Cheng , Jichen Yang , Chongzhi Zhang

This paper explores the use of adversarial examples in training speech recognition systems to increase robustness of deep neural network acoustic models. During training, the fast gradient sign method is used to generate adversarial…

Computation and Language · Computer Science 2018-06-19 Sining Sun , Ching-Feng Yeh , Mari Ostendorf , Mei-Yuh Hwang , Lei Xie

This research provides a comprehensive overview of adversarial attacks on AI and ML models, exploring various attack types, techniques, and their potential harms. We also delve into the business implications, mitigation strategies, and…

The advent of adversarial patches poses a significant challenge to the robustness of AI models, particularly in the domain of computer vision tasks such as object detection. In contradistinction to traditional adversarial examples, these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wonho Lee , Hyunsik Na , Jisu Lee , Daeseon Choi

Adversarial training of Deep Neural Networks is known to be significantly more data-hungry when compared to standard training. Furthermore, complex data augmentations such as AutoAugment, which have led to substantial gains in standard…

Machine Learning · Computer Science 2022-10-28 Sravanti Addepalli , Samyak Jain , R. Venkatesh Babu

Data augmentation has been established as an efficacious approach to supplement useful information for low-resource datasets. Traditional augmentation techniques such as noise injection and image transformations have been widely used. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yuwei Yin , Jean Kaddour , Xiang Zhang , Yixin Nie , Zhenguang Liu , Lingpeng Kong , Qi Liu

This paper presents an approach to developing assurance cases for adversarial robustness and regulatory compliance in large language models (LLMs). Focusing on both natural and code language tasks, we explore the vulnerabilities these…

Cryptography and Security · Computer Science 2024-10-10 Tomas Bueno Momcilovic , Dian Balta , Beat Buesser , Giulio Zizzo , Mark Purcell

There is an emerging need for predictive models to be trained on-the-fly, since in numerous machine learning applications data are arriving in an online fashion. A critical challenge encountered is that of limited availability of ground…

We introduce four new real-world distribution shift datasets consisting of changes in image style, image blurriness, geographic location, camera operation, and more. With our new datasets, we take stock of previously proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Dan Hendrycks , Steven Basart , Norman Mu , Saurav Kadavath , Frank Wang , Evan Dorundo , Rahul Desai , Tyler Zhu , Samyak Parajuli , Mike Guo , Dawn Song , Jacob Steinhardt , Justin Gilmer

Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be…

Machine Learning · Computer Science 2021-03-29 Dafni Antotsiou , Carlo Ciliberto , Tae-Kyun Kim

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

Computation and Language · Computer Science 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language processing tasks. Recently, several LLMs-based pipelines have been developed to enhance learning on graphs with text attributes,…

Machine Learning · Computer Science 2024-07-30 Kai Guo , Zewen Liu , Zhikai Chen , Hongzhi Wen , Wei Jin , Jiliang Tang , Yi Chang

Camera localization is a fundamental and crucial problem for many robotic applications. In recent years, using deep-learning for camera-based localization has become a popular research direction. However, they lack robustness to large…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Jialu Wang , Muhamad Risqi U. Saputra , Chris Xiaoxuan Lu , Niki Trigon , Andrew Markham

Adversarial attacks pose a significant threat to the reliability of pre-trained language models (PLMs) such as GPT, BERT, RoBERTa, and T5. This paper presents Adversarial Robustness through Dynamic Ensemble Learning (ARDEL), a novel scheme…

Cryptography and Security · Computer Science 2025-05-14 Hetvi Waghela , Jaydip Sen , Sneha Rakshit