English
Related papers

Related papers: Lipschitz Bounds and Provably Robust Training by L…

200 papers

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

We consider non-smooth saddle point optimization problems. To solve these problems, we propose a zeroth-order method under bounded or Lipschitz continuous noise, possible adversarial. In contrast to the state-of-the-art algorithms, our…

Optimization and Control · Mathematics 2023-03-28 Darina Dvinskikh , Vladislav Tominin , Yaroslav Tominin , Alexander Gasnikov

Lagrangian systems represent a wide range of robotic systems, including manipulators, wheeled and legged robots, and quadrotors. Inverse dynamics control and feedforward linearization techniques are typically used to convert the complex…

Robotics · Computer Science 2018-09-13 Mohamed K. Helwa , Adam Heins , Angela P. Schoellig

Recent research has revealed that high compression of Deep Neural Networks (DNNs), e.g., massive pruning of the weight matrix of a DNN, leads to a severe drop in accuracy and susceptibility to adversarial attacks. Integration of network…

Machine Learning · Computer Science 2025-03-27 Yangqi Feng , Shing-Ho J. Lin , Baoyuan Gao , Xian Wei

As deep neural networks (DNNs) are increasingly deployed in sensitive applications, ensuring their security and robustness has become critical. A major threat to DNNs arises from adversarial attacks, where small input perturbations can lead…

Machine Learning · Computer Science 2025-11-27 Erh-Chung Chen , Pin-Yu Chen , I-Hsin Chung , Che-Rung Lee

As ML models are increasingly deployed in critical applications, robustness against adversarial perturbations is crucial. While numerous defenses have been proposed to counter such attacks, they typically assume that all adversarial…

Machine Learning · Computer Science 2025-06-11 Yuan Xin , Dingfan Chen , Michael Backes , Xiao Zhang

Graph Laplacian (GL)-based semi-supervised learning is one of the most used approaches for classifying nodes in a graph. Understanding and certifying the adversarial robustness of machine learning (ML) algorithms has attracted large amounts…

Machine Learning · Computer Science 2021-04-23 Matthew Thorpe , Bao Wang

Graph algorithms are widely used for decision making and knowledge discovery. To ensure their effectiveness, it is essential that their output remains stable even when subjected to small perturbations to the input because frequent output…

Data Structures and Algorithms · Computer Science 2023-09-15 Soh Kumabe , Yuichi Yoshida

In this paper, we address the adversarial training of neural ODEs from a robust control perspective. This is an alternative to the classical training via empirical risk minimization, and it is widely used to enforce reliable outcomes for…

Optimization and Control · Mathematics 2024-04-02 Cristina Cipriani , Alessandro Scagliotti , Tobias Wöhrer

Adversarial robustness and generalization are both crucial properties of reliable machine learning models. In this paper, we study these properties in the context of quantum machine learning based on Lipschitz bounds. We derive…

Quantum Physics · Physics 2025-12-23 Julian Berberich , Daniel Fink , Daniel Pranjić , Christian Tutschku , Christian Holm

Designing neural networks with bounded Lipschitz constant is a promising way to obtain certifiably robust classifiers against adversarial examples. However, the relevant progress for the important $\ell_\infty$ perturbation setting is…

Machine Learning · Computer Science 2022-10-28 Bohang Zhang , Du Jiang , Di He , Liwei Wang

Lipschitz bandits is a prominent version of multi-armed bandits that studies large, structured action spaces such as the $[0,1]$ interval, where similar actions are guaranteed to have similar rewards. A central theme here is the adaptive…

Machine Learning · Computer Science 2025-06-13 Chara Podimata , Aleksandrs Slivkins

Neural networks are often highly sensitive to input and weight perturbations. This sensitivity has been linked to pathologies such as vulnerability to adversarial examples, divergent training, and overfitting. To combat these problems, past…

Machine Learning · Computer Science 2025-07-18 Laker Newhouse , R. Preston Hess , Franz Cesista , Andrii Zahorodnii , Jeremy Bernstein , Phillip Isola

Robust risk minimisation has several advantages: it has been studied with regards to improving the generalisation properties of models and robustness to adversarial perturbation. We bound the distributionally robust risk for a model class…

Machine Learning · Statistics 2018-09-06 Zac Cranko , Simon Kornblith , Zhan Shi , Richard Nock

Deep Reinforcement Learning (DRL) has achieved remarkable advances in sequential decision tasks. However, recent works have revealed that DRL agents are susceptible to slight perturbations in observations. This vulnerability raises concerns…

Machine Learning · Computer Science 2023-12-15 Buqing Nie , Jingtian Ji , Yangqing Fu , Yue Gao

In many real-world applications, it is undesirable to drastically change the problem solution after a small perturbation in the input, as unstable outputs can lead to costly transaction fees, privacy and security concerns, reduced user…

Data Structures and Algorithms · Computer Science 2025-11-11 Quanquan C. Liu , Grigoris Velegkas , Yuichi Yoshida , Felix Zhou

Overfitting widely exists in adversarial robust training of deep networks. An effective remedy is adversarial weight perturbation, which injects the worst-case weight perturbation during network training by maximizing the classification…

Machine Learning · Computer Science 2022-05-31 Chaojian Yu , Bo Han , Mingming Gong , Li Shen , Shiming Ge , Bo Du , Tongliang Liu

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

Machine Learning · Computer Science 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

While existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real-world settings. In many such cases although test data might not be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Tejas Gokhale , Rushil Anirudh , Bhavya Kailkhura , Jayaraman J. Thiagarajan , Chitta Baral , Yezhou Yang

This paper addresses theory and applications of $\ell_p$-based Laplacian regularization in semi-supervised learning. The graph $p$-Laplacian for $p>2$ has been proposed recently as a replacement for the standard ($p=2$) graph Laplacian in…

Numerical Analysis · Mathematics 2022-01-28 Mauricio Flores , Jeff Calder , Gilad Lerman