English
Related papers

Related papers: Jointly Optimize Data Augmentation and Network Tra…

200 papers

In this paper we propose a novel augmentation technique that improves not only the performance of deep neural networks on clean test data, but also significantly increases their robustness to random transformations, both affine and…

Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness,…

Machine Learning · Computer Science 2021-11-02 Maor Ivgi , Jonathan Berant

Supervised deep learning relies on the assumption that enough training data is available, which presents a problem for its application to several fields, like medical imaging. On the example of a binary image classification task (breast…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Lukas Jendele , Ondrej Skopek , Anton S. Becker , Ender Konukoglu

Adversarial training is an effective method to boost model robustness to malicious, adversarial attacks. However, such improvement in model robustness often leads to a significant sacrifice of standard performance on clean images. In many…

Machine Learning · Computer Science 2022-04-29 Pengyue Hou , Ming Zhou , Jie Han , Petr Musilek , Xingyu Li

Neural network-based approaches can achieve high accuracy in various medical image segmentation tasks. However, they generally require large labelled datasets for supervised learning. Acquiring and manually labelling a large medical dataset…

Image and Video Processing · Electrical Eng. & Systems 2020-06-25 Chen Chen , Chen Qin , Huaqi Qiu , Cheng Ouyang , Shuo Wang , Liang Chen , Giacomo Tarroni , Wenjia Bai , Daniel Rueckert

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Ju Xu , Mengzhang Li , Zhanxing Zhu

Data augmentation is a key practice in machine learning for improving generalization performance. However, finding the best data augmentation hyperparameters requires domain knowledge or a computationally demanding search. We address this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Saypraseuth Mounsaveng , Issam Laradji , Ismail Ben Ayed , David Vazquez , Marco Pedersoli

Data augmentation is one of the most important tools in training modern deep neural networks. Recently, great advances have been made in searching for optimal augmentation policies in the image classification domain. However, two key points…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Zhiqiang Tang , Yunhe Gao , Leonid Karlinsky , Prasanna Sattigeri , Rogerio Feris , Dimitris Metaxas

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it…

Machine Learning · Computer Science 2020-06-02 Zheng Xu , Ali Shafahi , Tom Goldstein

It is no secret amongst deep learning researchers that finding the optimal data augmentation strategy during training can mean the difference between state-of-the-art performance and a run-of-the-mill result. To that end, the community has…

Machine Learning · Computer Science 2023-07-17 Xiaomeng Dong , Michael Potter , Gaurav Kumar , Yun-Chan Tsai , V. Ratna Saripalli , Theodore Trafalis

Data augmentation (DA) is fundamental against overfitting in large convolutional neural networks, especially with a limited training dataset. In images, DA is usually based on heuristic transformations, like geometric or color…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Saypraseuth Mounsaveng , David Vazquez , Ismail Ben Ayed , Marco Pedersoli

Deep Neural Networks (DNNs) have improved the accuracy of classification problems in lots of applications. One of the challenges in training a DNN is its need to be fed by an enriched dataset to increase its accuracy and avoid it suffering…

Machine Learning · Computer Science 2020-08-25 Iman Saberi , Fathiyeh Faghih

Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been gradually replaced…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huafeng Qin , Xin Jin , Yun Jiang , Mounim A. El-Yacoubi , Xinbo Gao

Data augmentation is one of the most effective techniques for regularizing deep learning models and improving their recognition performance in a variety of tasks and domains. However, this holds for standard in-domain settings, in which the…

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly…

Machine Learning · Computer Science 2021-12-23 Jihoon Tack , Sihyun Yu , Jongheon Jeong , Minseon Kim , Sung Ju Hwang , Jinwoo Shin

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

In the ever-evolving landscape of social network advertising, the volume and accuracy of data play a critical role in the performance of predictive models. However, the development of robust predictive algorithms is often hampered by the…

Social and Information Networks · Computer Science 2024-11-13 Qikai Yang , Panfeng Li , Xinhe Xu , Zhicheng Ding , Wenjing Zhou , Yi Nian

Effective training of neural networks requires much data. In the low-data regime, parameters are underdetermined, and learnt networks generalise poorly. Data Augmentation alleviates this by using existing data more effectively. However…

Machine Learning · Statistics 2018-03-23 Antreas Antoniou , Amos Storkey , Harrison Edwards