English
Related papers

Related papers: Fast Certified Robust Training with Short Warmup

200 papers

In response to subtle adversarial examples flipping classifications of neural network models, recent research has promoted certified robustness as a solution. There, invariance of predictions to all norm-bounded attacks is achieved through…

Machine Learning · Computer Science 2022-10-13 Andrew C. Cullen , Paul Montague , Shijie Liu , Sarah M. Erfani , Benjamin I. P. Rubinstein

Recent studies have highlighted the potential of Lipschitz-based methods for training certifiably robust neural networks against adversarial attacks. A key challenge, supported both theoretically and empirically, is that robustness demands…

Machine Learning · Computer Science 2024-06-25 Kai Hu , Klas Leino , Zifan Wang , Matt Fredrikson

With the rapid development of deep learning, the sizes of neural networks become larger and larger so that the training and inference often overwhelm the hardware resources. Given the fact that neural networks are often over-parameterized,…

Machine Learning · Computer Science 2022-06-20 Zhangheng Li , Tianlong Chen , Linyi Li , Bo Li , Zhangyang Wang

Neural network (NN) controllers achieve strong empirical performance on nonlinear dynamical systems, yet deploying them in safety-critical settings requires robustness to disturbances and uncertainty. We present a method for jointly…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Neelay Junnarkar , Yasin Sonmez , Murat Arcak

Federated learning has recently gained significant attention and popularity due to its effectiveness in training machine learning models on distributed data privately. However, as in the single-node supervised learning setup, models trained…

Machine Learning · Computer Science 2022-10-27 Motasem Alfarra , Juan C. Pérez , Egor Shulgin , Peter Richtárik , Bernard Ghanem

During the entire training process of the ASR model, the intensity of data augmentation and the approach of calculating training loss are applied in a regulated manner based on preset parameters. For example, SpecAugment employs a…

Sound · Computer Science 2024-12-03 Hongxuan Lu , Shenjian Wang , Biao Li

Reinforcement learning-based controller design methods often require substantial data in the initial training phase. Moreover, the training process tends to exhibit strong randomness and slow convergence. It often requires considerable time…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Chenxu Ke , Congling Tian , Kaichen Xu , Ye Li , Lingcong Bao

Quantum machine learning is a promising field for efficiently learning features of a dataset to perform a specified task, such as classification. Interval bound propagation (IBP) is a popular certified training method in classical machine…

Quantum Physics · Physics 2026-05-04 Emma Andrews , Nahyeon Kim , Prabhat Mishra

The increasing use of machine learning in safety-critical domains amplifies the risk of adversarial threats, especially data poisoning attacks that corrupt training data to degrade performance or induce unsafe behavior. Most existing…

Machine Learning · Computer Science 2026-05-13 Sara Taheri , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar , Majid Zamani

Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under- or over-confident in their predictions. Consequently, methods have been…

Existing work in trustworthy machine learning primarily focuses on single-input adversarial perturbations. In many real-world attack scenarios, input-agnostic adversarial attacks, e.g. universal adversarial perturbations (UAPs), are much…

Machine Learning · Computer Science 2024-09-10 Changming Xu , Gagandeep Singh

Formal verification of neural networks (NNs) is a challenging and important problem. Existing efficient complete solvers typically require the branch-and-bound (BaB) process, which splits the problem domain into sub-domains and solves each…

Artificial Intelligence · Computer Science 2021-03-17 Kaidi Xu , Huan Zhang , Shiqi Wang , Yihan Wang , Suman Jana , Xue Lin , Cho-Jui Hsieh

The reliable deployment of neural networks in control systems requires rigorous robustness guarantees. In this paper, we obtain tight robustness certificates over convex attack sets for min-max representations of ReLU neural networks by…

Optimization and Control · Mathematics 2023-10-10 Brendon G. Anderson , Samuel Pfrommer , Somayeh Sojoudi

Adversarial training attains strong empirical robustness to specific adversarial attacks by training on concrete adversarial perturbations, but it produces neural networks that are not amenable to strong robustness certificates through…

Machine Learning · Computer Science 2026-02-04 Alessandro De Palma

Verifiable training has shown success in creating neural networks that are provably robust to a given amount of noise. However, despite only enforcing a single robustness criterion, its performance scales poorly with dataset complexity. On…

Machine Learning · Computer Science 2020-12-16 Shiqi Wang , Kevin Eykholt , Taesung Lee , Jiyong Jang , Ian Molloy

Verifying the robustness property of a general Rectified Linear Unit (ReLU) network is an NP-complete problem [Katz, Barrett, Dill, Julian and Kochenderfer CAV17]. Although finding the exact minimum adversarial distortion is hard, giving a…

The calibration and training of a neural network is a complex and time-consuming procedure that requires significant computational resources to achieve satisfactory results. Key obstacles are a large number of hyperparameters to select and…

Machine Learning · Computer Science 2023-09-07 Raffaele Giuseppe Cestari , Gabriele Maroni , Loris Cannelli , Dario Piga , Simone Formentin

Finding minimum distortion of adversarial examples and thus certifying robustness in neural network classifiers for given data points is known to be a challenging problem. Nevertheless, recently it has been shown to be possible to give a…

Machine Learning · Computer Science 2018-11-05 Huan Zhang , Tsui-Wei Weng , Pin-Yu Chen , Cho-Jui Hsieh , Luca Daniel

Enhancing model robustness under new and even adversarial environments is a crucial milestone toward building trustworthy machine learning systems. Current robust training methods such as adversarial training explicitly uses an "attack"…

Machine Learning · Computer Science 2020-12-23 Minhao Cheng , Pin-Yu Chen , Sijia Liu , Shiyu Chang , Cho-Jui Hsieh , Payel Das

Data errors, corruptions, and poisoning attacks during training pose a major threat to the reliability of modern AI systems. While extensive effort has gone into empirical mitigations, the evolving nature of attacks and the complexity of…

Machine Learning · Computer Science 2025-10-28 Tobias Lorenz , Marta Kwiatkowska , Mario Fritz