English
Related papers

Related papers: Provably-Safe Neural Network Training Using Hybrid…

200 papers

This paper presents the Neural Network Verification (NNV) software tool, a set-based verification framework for deep neural networks (DNNs) and learning-enabled cyber-physical systems (CPS). The crux of NNV is a collection of reachability…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Hoang-Dung Tran , Xiaodong Yang , Diego Manzanas Lopez , Patrick Musau , Luan Viet Nguyen , Weiming Xiang , Stanley Bak , Taylor T. Johnson

Neural network based approximate computing is a universal architecture promising to gain tremendous energy-efficiency for many error resilient applications. To guarantee the approximation quality, existing works deploy two neural networks…

Machine Learning · Computer Science 2018-12-19 Zhenghao Peng , Xuyang Chen , Chengwen Xu , Naifeng Jing , Xiaoyao Liang , Cewu Lu , Li Jiang

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Machine Learning · Computer Science 2023-06-28 Zhen Liang , Dejin Ren , Bai Xue , Ji Wang , Wenjing Yang , Wanwei Liu

Neural networks are increasingly deployed in real-world safety-critical domains such as autonomous driving, aircraft collision avoidance, and malware detection. However, these networks have been shown to often mispredict on inputs with…

Machine Learning · Computer Science 2018-11-09 Shiqi Wang , Kexin Pei , Justin Whitehouse , Junfeng Yang , Suman Jana

With a constant improvement in the network architectures and training methodologies, Neural Networks (NNs) are increasingly being deployed in real-world Machine Learning systems. However, despite their impressive performance on "known…

Machine Learning · Computer Science 2020-05-18 Mahum Naseer , Mishal Fatima Minhas , Faiq Khalid , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Deep neural networks have shown remarkable performance across a wide range of vision-based tasks, particularly due to the availability of large-scale datasets for training and better architectures. However, data seen in the real world are…

Machine Learning · Computer Science 2018-11-26 Muhammad Usama , Dong Eui Chang

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders their utility in sensitive applications such as medical…

Machine Learning · Computer Science 2020-12-10 Arda Sahiner , Morteza Mardani , Batu Ozturkler , Mert Pilanci , John Pauly

We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more…

Machine Learning · Computer Science 2019-04-25 Kai Y. Xiao , Vincent Tjeng , Nur Muhammad Shafiullah , Aleksander Madry

In this paper, we consider the problem of formally verifying the safety of an autonomous robot equipped with a Neural Network (NN) controller that processes LiDAR images to produce control actions. Given a workspace that is characterized by…

Artificial Intelligence · Computer Science 2018-11-01 Xiaowu Sun , Haitham Khedr , Yasser Shoukry

Reinforcement learning (RL) algorithms can achieve state-of-the-art performance in decision-making and continuous control tasks. However, applying RL algorithms on safety-critical systems still needs to be well justified due to the…

Robotics · Computer Science 2022-11-22 Mahmoud Selim , Amr Alanwar , M. Watheq El-Kharashi , Hazem M. Abbas , Karl H. Johansson

Verification of neural networks enables us to gauge their robustness against adversarial attacks. Verification algorithms fall into two categories: exact verifiers that run in exponential time and relaxed verifiers that are efficient but…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Huan Zhang , Cho-Jui Hsieh , Pengchuan Zhang

Over the last decade, Neural Networks (NNs) have been widely used in numerous applications including safety-critical ones such as autonomous systems. Despite their emerging adoption, it is well known that NNs are susceptible to Adversarial…

Machine Learning · Computer Science 2022-07-19 Dor Cohen , Ofer Strichman

Derivative training is an established method that can significantly increase the accuracy of neural networks in certain low-dimensional tasks. In this paper, we extend this improvement to an illustrative image analysis problem:…

Machine Learning · Computer Science 2025-02-04 Vsevolod I. Avrutskiy

The recent advancements in deep learning have brought about significant changes in various aspects of people's lives. Meanwhile, these rapid developments have raised concerns about the legitimacy of the training process of deep neural…

Machine Learning · Computer Science 2023-12-07 Haochen Sun , Tonghe Bai , Jason Li , Hongyang Zhang

Performing real-time receding horizon motion planning for autonomous vehicles while providing safety guarantees remains difficult. This is because existing methods to accurately predict ego vehicle behavior under a chosen controller use…

Deep learning has been widely used in many fields, but the model training process usually consumes massive computational resources and time. Therefore, designing an efficient neural network training method with a provable convergence…

Machine Learning · Computer Science 2023-07-14 Lianke Qin , Zhao Song , Yuanyuan Yang

As neural networks (NNs) become more prevalent in safety-critical applications such as control of vehicles, there is a growing need to certify that systems with NN components are safe. This paper presents a set of backward reachability…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Sydney M. Katz , Chelsea Sidrane , Esen Yel , Michael Everett , Mykel J. Kochenderfer , Jonathan P. How

We develop fast algorithms and robust software for convex optimization of two-layer neural networks with ReLU activation functions. Our work leverages a convex reformulation of the standard weight-decay penalized training problem as a set…

Machine Learning · Computer Science 2025-04-10 Aaron Mishkin , Arda Sahiner , Mert Pilanci

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Safe learning is central to AI-enabled robots where a single failure may lead to catastrophic results. Barrier-based method is one of the dominant approaches for safe robot learning. However, this method is not scalable, hard to train, and…

Machine Learning · Computer Science 2024-06-21 Wei Xiao , Tsun-Hsuan Wang , Daniela Rus