English
Related papers

Related papers: Generalized No Free Lunch Theorem for Adversarial …

200 papers

Machine learning models are generally vulnerable to adversarial examples, which is in contrast to the robustness of humans. In this paper, we try to leverage one of the mechanisms in human recognition and propose a bio-inspired…

Machine Learning · Computer Science 2020-01-13 Sicheng Zhu , Bang An , Shiyu Niu

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

Machine Learning · Computer Science 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

Machine Learning · Computer Science 2025-10-14 Yunlong Feng , Qiang Wu

Modern machine learning systems have been applied successfully to a variety of tasks in recent years but making such systems robust against adversarially chosen modifications of input instances seems to be a much harder problem. It is…

Quantum Physics · Physics 2021-12-20 Khashayar Barooti , Grzegorz Głuch , Ruediger Urbanke

This chapter introduces and investigates some fundamental questions on the relationship between accuracy and robustness in both classical and quantum classification algorithms under noisy and adversarial conditions. We introduce and clarify…

Quantum Physics · Physics 2026-02-18 Nana Liu

Adversarially robust machine learning has received much recent attention. However, prior attacks and defenses for non-parametric classifiers have been developed in an ad-hoc or classifier-specific basis. In this work, we take a holistic…

Machine Learning · Computer Science 2020-02-26 Yao-Yuan Yang , Cyrus Rashtchian , Yizhen Wang , Kamalika Chaudhuri

This work investigates adversarial training in the context of margin-based linear classifiers in the high-dimensional regime where the dimension $d$ and the number of data points $n$ diverge with a fixed ratio $\alpha = n / d$. We introduce…

Machine Learning · Statistics 2026-01-13 Kasimir Tanner , Matteo Vilucchio , Bruno Loureiro , Florent Krzakala

We investigate the challenge of establishing stochastic-like guarantees when sequentially learning from a stream of i.i.d. data that includes an unknown quantity of clean-label adversarial samples. We permit the learner to abstain from…

Machine Learning · Computer Science 2025-04-22 Carolin Heinzler

We propose a distributionally robust logistic regression model with an unfairness penalty that prevents discrimination with respect to sensitive attributes such as gender or ethnicity. This model is equivalent to a tractable convex…

Machine Learning · Computer Science 2020-07-21 Bahar Taskesen , Viet Anh Nguyen , Daniel Kuhn , Jose Blanchet

We provide rigorous guarantees on learning with the weighted trace-norm under arbitrary sampling distributions. We show that the standard weighted trace-norm might fail when the sampling distribution is not a product distribution (i.e. when…

Machine Learning · Computer Science 2011-06-23 Rina Foygel , Ruslan Salakhutdinov , Ohad Shamir , Nathan Srebro

We provide algorithms for regression with adversarial responses under large classes of non-i.i.d. instance sequences, on general separable metric spaces, with provably minimal assumptions. We also give characterizations of learnability in…

Machine Learning · Computer Science 2023-06-13 Moïse Blanchard , Patrick Jaillet

Convolutional neural networks (CNNs) have made significant advancement, however, they are widely known to be vulnerable to adversarial attacks. Adversarial training is the most widely used technique for improving adversarial robustness to…

Machine Learning · Computer Science 2021-10-12 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

Machine Learning · Computer Science 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

Conditional estimation given specific covariate values (i.e., local conditional estimation or functional estimation) is ubiquitously useful with applications in engineering, social and natural sciences. Existing data-driven non-parametric…

Machine Learning · Statistics 2020-10-13 Viet Anh Nguyen , Fan Zhang , Jose Blanchet , Erick Delage , Yinyu Ye

In recent years, there has been an explosion of research into developing more robust deep neural networks against adversarial examples. Adversarial training appears as one of the most successful methods. To deal with both the robustness…

Machine Learning · Computer Science 2023-03-21 Gaojie Jin , Xinping Yi , Dengyu Wu , Ronghui Mu , Xiaowei Huang

Despite breakthrough performance, modern learning models are known to be highly vulnerable to small adversarial perturbations in their inputs. While a wide variety of recent \emph{adversarial training} methods have been effective at…

Machine Learning · Computer Science 2020-02-26 Adel Javanmard , Mahdi Soltanolkotabi , Hamed Hassani

Adversarial training, originally designed to resist test-time adversarial examples, has shown to be promising in mitigating training-time availability attacks. This defense ability, however, is challenged in this paper. We identify a novel…

Machine Learning · Computer Science 2022-10-11 Lue Tao , Lei Feng , Hongxin Wei , Jinfeng Yi , Sheng-Jun Huang , Songcan Chen

Modern machine learning algorithms perform poorly on adversarially manipulated data. Adversarial risk quantifies the error of classifiers in adversarial settings; adversarial classifiers minimize adversarial risk. In this paper, we analyze…

Machine Learning · Computer Science 2020-12-24 Muni Sreenivas Pydi , Varun Jog

The reliability of a learning model is key to the successful deployment of machine learning in various applications. However, it is difficult to describe the phenomenon due to the complicated nature of the problems in machine learning. It…

Machine Learning · Computer Science 2025-05-27 Ramin Barati , Reza Safabakhsh , Mohammad Rahmati