English
Related papers

Related papers: Adversarial Training with Generated Data in High-D…

200 papers

Deep models are highly susceptible to adversarial attacks. Such attacks are carefully crafted imperceptible noises that can fool the network and can cause severe consequences when deployed. To encounter them, the model requires training…

Machine Learning · Computer Science 2022-04-11 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Data efficiency of learning, which plays a key role in the Reinforcement Learning (RL) training process, becomes even more important in continual RL with sequential environments. In continual RL, the learner interacts with non-stationary,…

Machine Learning · Computer Science 2024-10-17 Sihao Wu , Xingyu Zhao , Xiaowei Huang

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Authentication is a task aiming to confirm the truth between data instances and personal identities. Typical authentication applications include face recognition, person re-identification, authentication based on mobile devices and so on.…

Machine Learning · Statistics 2019-05-29 Jian Liang , Yuren Cao , Chenbin Zhang , Shiyu Chang , Kun Bai , Zenglin Xu

We study generalised linear regression and classification for a synthetically generated dataset encompassing different problems of interest, such as learning with random features, neural networks in the lazy training regime, and the hidden…

Statistics Theory · Mathematics 2022-03-28 Federica Gerace , Bruno Loureiro , Florent Krzakala , Marc Mézard , Lenka Zdeborová

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Anomaly detection is facing with emerging challenges in many important industry domains, such as cyber security and online recommendation and advertising. The recent trend in these areas calls for anomaly detection on time-evolving data…

Machine Learning · Computer Science 2019-07-16 Zheng Gao , Lin Guo , Chi Ma , Xiao Ma , Kai Sun , Hang Xiang , Xiaoqiang Zhu , Hongsong Li , Xiaozhong Liu

Projected Gradient Descent (PGD) based adversarial training has become one of the most prominent methods for building robust deep neural network models. However, the computational complexity associated with this approach, due to the…

Machine Learning · Computer Science 2020-05-01 Sidharth Gupta , Parijat Dube , Ashish Verma

Recent studies show deep neural networks (DNNs) are extremely vulnerable to the elaborately designed adversarial examples. Adversarial learning with those adversarial examples has been proved as one of the most effective methods to defend…

Machine Learning · Computer Science 2022-07-05 Yaguan Qian , Yuqi Wang , Bin Wang , Zhaoquan Gu , Yuhan Guo , Wassim Swaileh

Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines…

Machine Learning · Computer Science 2020-06-22 Samet Oymak , Talha Cihad Gulcu

Pre-trained transformer models such as BERT have shown massive gains across many text classification tasks. However, these models usually need enormous labeled data to achieve impressive performances. Obtaining labeled data is often…

Computation and Language · Computer Science 2025-01-15 Rohit Sharma , Shanu Kumar , Avinash Kumar

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Labelled data often comes at a high cost as it may require recruiting human labelers or running costly experiments. At the same time, in many practical scenarios, one already has access to a partially labelled, potentially biased dataset…

Machine Learning · Computer Science 2021-06-15 Fnu Devvrit , Nived Rajaraman , Pranjal Awasthi

Efficient adversarial attack methods are critical for assessing the robustness of computer vision models. In this paper, we reconstruct the optimization objective for generating adversarial examples as "maximizing the difference between the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xinlei Liu , Tao Hu , Peng Yi , Weitao Han , Jichao Xie , Baolin Li

While leveraging additional training data is well established to improve adversarial robustness, it incurs the unavoidable cost of data collection and the heavy computation to train models. To mitigate the costs, we propose Guided…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Salah Ghamizi , Jingfeng Zhang , Maxime Cordy , Mike Papadakis , Masashi Sugiyama , Yves Le Traon

Deep learning usually achieves the best results with complete supervision. In the case of semantic segmentation, this means that large amounts of pixelwise annotations are required to learn accurate models. In this paper, we show that we…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Yi Zhu , Zhongyue Zhang , Chongruo Wu , Zhi Zhang , Tong He , Hang Zhang , R. Manmatha , Mu Li , Alexander Smola

Generative Adversarial Networks (GAN) have shown great promise in tasks like synthetic image generation, image inpainting, style transfer, and anomaly detection. However, generating discrete data is a challenge. This work presents an…

Machine Learning · Computer Science 2018-04-04 Shreyas Patel , Ashutosh Kakadiya , Maitrey Mehta , Raj Derasari , Rahul Patel , Ratnik Gandhi

In this work, we investigate semi-supervised learning (SSL) for image classification using adversarial training. Previous results have illustrated that generative adversarial networks (GANs) can be used for multiple purposes. Triple-GAN,…

Machine Learning · Computer Science 2019-10-22 Wenyuan Li , Zichen Wang , Yuguang Yue , Jiayun Li , William Speier , Mingyuan Zhou , Corey W. Arnold

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

Machine Learning · Statistics 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli

We study the error of linear regression in the face of adversarial attacks. In this framework, an adversary changes the input to the regression model in order to maximize the prediction error. We provide bounds on the prediction error in…

Machine Learning · Statistics 2023-03-29 Antônio H. Ribeiro , Thomas B. Schön