English
Related papers

Related papers: Provably-Safe Neural Network Training Using Hybrid…

200 papers

Much combinatorial optimisation problems constitute a non-polynomial (NP) hard optimisation problem, i.e., they can not be solved in polynomial time. One such problem is finding the shortest route between two nodes on a graph.…

Machine Learning · Statistics 2017-09-08 Alessandro Bay , Biswa Sengupta

This paper tackles the problem of training a deep convolutional neural network with both low-precision weights and low-bitwidth activations. Optimizing a low-precision network is very challenging since the training process can easily get…

Computer Vision and Pattern Recognition · Computer Science 2021-06-05 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Lingqiao Liu , Ian Reid

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Deep Neural Networks (DNNs) have grown in popularity over the past decade and are now being used in safety-critical domains such as aircraft collision avoidance. This has motivated a large number of techniques for finding unsafe behavior in…

Machine Learning · Computer Science 2021-04-27 Matthew Sotoudeh , Aditya V. Thakur

We introduce an efficient method for learning linear models from uncertain data, where uncertainty is represented as a set of possible variations in the data, leading to predictive multiplicity. Our approach leverages abstract…

Machine Learning · Computer Science 2024-05-30 Jiongli Zhu , Su Feng , Boris Glavic , Babak Salimi

Robust control problems have significant practical implications since external disturbances can significantly impact the performance of control methods. Existing robust control methods excel at control-affine systems but fail at neural…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Huixuan Cheng , Hanjiang Hu , Changliu Liu

This work proposes a robust data-driven predictive control approach for unknown nonlinear systems in the presence of bounded process and measurement noise. Data-driven reachable sets are employed for the controller design instead of using…

Systems and Control · Electrical Eng. & Systems 2023-07-18 Mahsa Farjadnia , Amr Alanwar , Muhammad Umar B. Niazi , Marco Molinari , Karl Henrik Johansson

In this paper, we present a novel training approach called the Homotopy Relaxation Training Algorithm (HRTA), aimed at accelerating the training process in contrast to traditional methods. Our algorithm incorporates two key mechanisms: one…

Machine Learning · Computer Science 2024-10-08 Yahong Yang , Qipin Chen , Wenrui Hao

Designing controllers that accomplish tasks while guaranteeing safety constraints remains a significant challenge. We often want an agent to perform well in a nominal task, such as environment exploration, while ensuring it can avoid unsafe…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Azra Begzadić , Nikhil Uday Shinde , Sander Tonkens , Dylan Hirsch , Kaleb Ugalde , Michael C. Yip , Jorge Cortés , Sylvia Herbert

Privacy-preserving deep neural network (DNN) inference is a necessity in different regulated industries such as healthcare, finance and retail. Recently, homomorphic encryption (HE) has been used as a method to enable analytics while…

Cryptography and Security · Computer Science 2023-06-13 Moran Baruch , Nir Drucker , Lev Greenberg , Guy Moshkowich

A novel solve-training framework is proposed to train neural network in representing low dimensional solution maps of physical models. Solve-training framework uses the neural network as the ansatz of the solution map and train the network…

Numerical Analysis · Mathematics 2020-10-16 Yingzhou Li , Jianfeng Lu , Anqi Mao

To verify the correct operation of systems, engineers need to determine the set of configurations of a dynamical model that are able to safely reach a specified configuration under a control law. Unfortunately, constructing models for…

Optimization and Control · Mathematics 2016-01-07 Shankar Mohan , Victor Shia , Ram Vasudevan

The reliable deployment of neural networks in control systems requires rigorous robustness guarantees. In this paper, we obtain tight robustness certificates over convex attack sets for min-max representations of ReLU neural networks by…

Optimization and Control · Mathematics 2023-10-10 Brendon G. Anderson , Samuel Pfrommer , Somayeh Sojoudi

Formal verification of neural networks is essential before their deployment in safety-critical applications. However, existing methods for formally verifying neural networks are not yet scalable enough to handle practical problems under…

Machine Learning · Computer Science 2025-07-08 Tobias Ladner , Matthias Althoff

Implicit neural networks are a general class of learning models that replace the layers in traditional feedforward models with implicit algebraic equations. Compared to traditional learning models, implicit networks offer competitive…

Machine Learning · Computer Science 2021-12-13 Saber Jafarpour , Matthew Abate , Alexander Davydov , Francesco Bullo , Samuel Coogan

Current approaches to novelty or anomaly detection are based on deep neural networks. Despite their effectiveness, neural networks are also vulnerable to imperceptible deformations of the input data. This is a serious issue in critical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Ranya Almohsen , Shivang Patel , Donald A. Adjeroh , Gianfranco Doretto

Deep reinforcement learning (DRL) has demonstrated remarkable performance in many continuous control tasks. However, a significant obstacle to the real-world application of DRL is the lack of safety guarantees. Although DRL agents can…

Robotics · Computer Science 2025-08-15 Weiye Zhao , Feihan Li , Changliu Liu

Due to significant improvements in performance in recent years, neural networks are currently used for an ever-increasing number of applications. However, neural networks have the drawback that their decisions are not readily interpretable…

Cryptography and Security · Computer Science 2020-05-15 Christian Berghoff

The Neural Network (NN), as a black-box function approximator, has been considered in many control and robotics applications. However, difficulties in verifying the overall system safety in the presence of uncertainties hinder the…

Robotics · Computer Science 2024-05-21 Xiao Li , Yutong Li , Anouck Girard , Ilya Kolmanovsky

Neural networks have demonstrated considerable success on a wide variety of real-world problems. However, networks trained only to optimize for training accuracy can often be fooled by adversarial examples - slightly perturbed inputs that…

Machine Learning · Computer Science 2019-02-19 Vincent Tjeng , Kai Xiao , Russ Tedrake