English
Related papers

Related papers: Training Safe Neural Networks with Global SDP Boun…

200 papers

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang

This study addresses the challenge of ensuring safe spacecraft proximity operations, focusing on collision avoidance between a chaser spacecraft and a complex-geometry target spacecraft under disturbances. To ensure safety in such…

Systems and Control · Electrical Eng. & Systems 2025-07-21 Hang Zhou , Tao Meng , Kun Wang , Chengrui Shi , Renhao Mao , Weijia Wang , Jiakun Lei

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

We present a simple, yet effective, approach to Semi-Supervised Learning. Our approach is based on estimating density-based distances (DBD) using a shortest path calculation on a graph. These Graph-DBD estimates can then be used in any…

Machine Learning · Computer Science 2012-02-20 Avleen S. Bijral , Nathan Ratliff , Nathan Srebro

We consider semidefinite programming (SDP) for the binary stochastic block model with equal-sized communities. Prior work of Hajek, Wu, and Xu proposed an SDP (sym-SDP) for the symmetric case where the intra-community edge probabilities are…

Information Theory · Computer Science 2025-06-24 Julia Gaudio , Phawin Prongpaophan

Despite their advances and success, real-world deep neural networks are known to be vulnerable to adversarial attacks. Universal adversarial perturbation, an input-agnostic attack, poses a serious threat for them to be deployed in…

Machine Learning · Computer Science 2025-02-11 Bing Sun , Jun Sun , Wei Zhao

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

Machine Learning · Computer Science 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

There is a growing body of literature showing that deep neural networks are vulnerable to adversarial input modification. Recently this work has been extended from image classification to malware classification over boolean features. In…

Machine Learning · Computer Science 2018-06-26 Alex Kouzemtchenko

We study the problem of formally verifying the robustness to adversarial examples of support vector machines (SVMs), a major machine learning model for classification and regression tasks. Following a recent stream of works on formal…

Machine Learning · Computer Science 2019-04-29 Francesco Ranzato , Marco Zanella

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

The increasing use of deep neural networks for safety-critical applications, such as autonomous driving and flight control, raises concerns about their safety and reliability. Formal verification can address these concerns by guaranteeing…

Artificial Intelligence · Computer Science 2018-02-06 Lindsey Kuper , Guy Katz , Justin Gottschlich , Kyle Julian , Clark Barrett , Mykel Kochenderfer

Formal verification provides critical security assurances for neural networks, yet its practical application suffers from the long verification time. This work introduces a novel method for training verification-friendly neural networks,…

Machine Learning · Computer Science 2024-12-31 Zongxin Liu , Zhe Zhao , Fu Song , Jun Sun , Pengfei Yang , Xiaowei Huang , Lijun Zhang

The framework of Integral Quadratic Constraints of Lessard et al. (2014) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to semi-definite programming (SDP). Followup work by Nishihara et…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento

Deep learning models have been extensively adopted in various regions due to their ability to represent hierarchical features, which highly rely on the training set and procedures. Thus, protecting the training process and deep learning…

Cryptography and Security · Computer Science 2025-03-12 Haodi Wang , Tangyu Jiang , Yu Guo , Chengjun Cai , Cong Wang , Xiaohua Jia

Deep neural networks have achieved human-level accuracy on almost all perceptual benchmarks. It is interesting that these advances were made using two ideas that are decades old: (a) an artificial neuron based on a linear summator and (b)…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Sergey Bochkanov

Although deep neural networks have achieved super-human performance on many classification tasks, they often exhibit a worrying lack of robustness towards adversarially generated examples. Thus, considerable effort has been invested into…

Machine Learning · Computer Science 2024-10-01 Leon Bungert , Nicolás García Trillos , Matt Jacobs , Daniel McKenzie , Đorđe Nikolić , Qingsong Wang

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has…

Machine Learning · Computer Science 2017-08-22 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

This paper explores methods for verifying the properties of Binary Neural Networks (BNNs), focusing on robustness against adversarial attacks. Despite their lower computational and memory needs, BNNs, like their full-precision counterparts,…

Machine Learning · Computer Science 2025-04-16 Jianting Yang , Srećko Ðurašinović , Jean-Bernard Lasserre , Victor Magron , Jun Zhao

Deep neural networks (DNNs) have set benchmarks on a wide array of supervised learning tasks. Trained DNNs, however, often lack robustness to minor adversarial perturbations to the input, which undermines their true practicality. Recent…

Machine Learning · Computer Science 2018-11-20 Farzan Farnia , Jesse M. Zhang , David Tse

We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpropagation-based approaches, our methods inherently mitigate…

Machine Learning · Computer Science 2025-04-01 Jintao Xu , Yifei Li , Wenxun Xing