中文
相关论文

相关论文: Understanding Robust Overfitting from the Feature …

200 篇论文

Adversarial training (AT) is the de facto method for building robust neural networks, but it can be computationally expensive. To mitigate this, fast single-step attacks can be used, but this may lead to catastrophic overfitting (CO). This…

Supervised learning models are challenged by the intrinsic complexities of training data such as outliers and minority subpopulations and intentional attacks at inference time with adversarial samples. While traditional robust learning…

机器学习 · 计算机科学 2023-09-12 Shu Hu , Zhenhuan Yang , Xin Wang , Yiming Ying , Siwei Lyu

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

机器学习 · 计算机科学 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

As humans, we inherently perceive images based on their predominant features, and ignore noise embedded within lower bit planes. On the contrary, Deep Neural Networks are known to confidently misclassify images corrupted with meticulously…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Sravanti Addepalli , Vivek B. S. , Arya Baburaj , Gaurang Sriramanan , R. Venkatesh Babu

In the present day we use machine learning for sensitive tasks that require models to be both understandable and robust. Although traditional models such as decision trees are understandable, they suffer from adversarial attacks. When a…

机器学习 · 计算机科学 2020-12-21 Daniël Vos , Sicco Verwer

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT…

机器学习 · 计算机科学 2020-04-14 Haidong Xie , Xueshuang Xiang , Naijin Liu , Bin Dong

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

机器学习 · 计算机科学 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang

In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other…

机器学习 · 计算机科学 2021-06-01 Jingfeng Zhang , Jianing Zhu , Gang Niu , Bo Han , Masashi Sugiyama , Mohan Kankanhalli

Adversarial training is a popular method to give neural nets robustness against adversarial perturbations. In practice adversarial training leads to low robust training loss. However, a rigorous explanation for why this happens under…

机器学习 · 计算机科学 2020-02-25 Yi Zhang , Orestis Plevrakis , Simon S. Du , Xingguo Li , Zhao Song , Sanjeev Arora

Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead…

机器学习 · 计算机科学 2024-06-06 Yihao Zhang , Hangzhou He , Jingyu Zhu , Huanran Chen , Yifei Wang , Zeming Wei

Neural ranking models (NRMs) have shown great success in information retrieval (IR). But their predictions can easily be manipulated using adversarial examples, which are crafted by adding imperceptible perturbations to legitimate…

信息检索 · 计算机科学 2023-12-19 Yu-An Liu , Ruqing Zhang , Mingkun Zhang , Wei Chen , Maarten de Rijke , Jiafeng Guo , Xueqi Cheng

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

机器学习 · 计算机科学 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Adversarial training (AT) defends deep neural networks against adversarial attacks. One challenge that limits its practical application is the performance degradation on clean samples. A major bottleneck identified by previous works is the…

机器学习 · 计算机科学 2022-07-05 Haotao Wang , Aston Zhang , Shuai Zheng , Xingjian Shi , Mu Li , Zhangyang Wang

End-to-end (geometric) deep learning has seen first successes in approximating the solution of combinatorial optimization problems. However, generating data in the realm of NP-hard/-complete tasks brings practical and theoretical…

机器学习 · 计算机科学 2022-03-22 Simon Geisler , Johanna Sommer , Jan Schuchardt , Aleksandar Bojchevski , Stephan Günnemann

We study the error of linear regression in the face of adversarial attacks. In this framework, an adversary changes the input to the regression model in order to maximize the prediction error. We provide bounds on the prediction error in…

机器学习 · 统计学 2023-03-29 Antônio H. Ribeiro , Thomas B. Schön

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

机器学习 · 计算机科学 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

计算与语言 · 计算机科学 2022-03-25 Hanjie Chen , Yangfeng Ji

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

机器学习 · 计算机科学 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

机器人学 · 计算机科学 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff