English
Related papers

Related papers: Constrained Feedforward Neural Network Training vi…

200 papers

Beyond the traditional neural network training methods based on gradient descent and its variants, state estimation techniques have been proposed to determine a set of ideal weights from a control-theoretic perspective. Hence, the concept…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Yi Yang , Victor G. Lopez , Matthias A. Müller

The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Weiming Xiang , Hoang-Dung Tran , Xiaodong Yang , Taylor T. Johnson

The design of tracking controllers that closely follow a reference trajectory while ensuring safety and robustness against disturbances is a challenging problem in the control of autonomous systems. In this work, we propose a neural…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Yuezhu Xu , Mohamed Serry , Jun Liu , S. Sivaranjani

The decision logic for the ACAS X family of aircraft collision avoidance systems is represented as a large numeric table. Due to storage constraints of certified avionics hardware, neural networks have been suggested as a way to…

Systems and Control · Electrical Eng. & Systems 2020-05-07 Kyle D. Julian , Mykel J. Kochenderfer

Incorporating prior knowledge or specifications of input-output relationships into machine learning models has attracted significant attention, as it enhances generalization from limited data and yields conforming outputs. However, most…

Machine Learning · Computer Science 2025-10-21 Youngjae Min , Navid Azizan

We study the parameterized complexity of training two-layer neural networks with respect to the dimension of the input data and the number of hidden neurons, considering ReLU and linear threshold activation functions. Albeit the…

Computational Complexity · Computer Science 2024-01-19 Vincent Froese , Christoph Hertrich

The proliferation of neural networks in safety-critical applications necessitates the development of effective methods to ensure their safety. This letter presents a novel approach for computing the exact backward reachable sets of neural…

Optimization and Control · Mathematics 2023-03-21 Yuhao Zhang , Hang Zhang , Xiangru Xu

Control design for general nonlinear robotic systems with guaranteed stability and/or safety in the presence of model uncertainties is a challenging problem. Recent efforts attempt to learn a controller and a certificate (e.g., a Lyapunov…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Vivek Sharma , Pan Zhao , Naira Hovakimyan

Neural networks with ReLU activation play a key role in modern machine learning. Understanding the functions represented by ReLU networks is a major topic in current research as this enables a better interpretability of learning processes.…

Computational Complexity · Computer Science 2025-06-23 Vincent Froese , Moritz Grillo , Martin Skutella

We present a method for computing exact reachable sets for deep neural networks with rectified linear unit (ReLU) activation. Our method is well-suited for use in rigorous safety analysis of robotic perception and control systems with deep…

Robotics · Computer Science 2021-04-02 Joseph A. Vincent , Mac Schwager

In this paper, we consider the problem of training neural network (NN) controllers for nonlinear dynamical systems that are guaranteed to satisfy safety and liveness (e.g., reach-avoid) properties. Our approach is to combine model-based…

Systems and Control · Electrical Eng. & Systems 2021-09-07 Xiaowu Sun , Yasser Shoukry

Enforcing constraint satisfaction in neural network outputs is critical for safety, reliability, and physical fidelity in many control and decision-making applications. While soft-constrained methods penalize constraint violations during…

Machine Learning · Computer Science 2026-05-28 Andrea Goertzen , Kaveh Alim , Youngjae Min , Navid Azizan

This paper focuses on finding reinforcement learning policies for control systems with hard state and action constraints. Despite its success in many domains, reinforcement learning is challenging to apply to problems with hard constraints,…

Machine Learning · Computer Science 2020-03-24 Liyuan Zheng , Yuanyuan Shi , Lillian J. Ratliff , Baosen Zhang

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

This work explores the feasibility of steering a drone with a (recurrent) neural network, based on input from a forward looking camera, in the context of a high-level navigation task. We set up a generic framework for training a network to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Klaas Kelchtermans , Tinne Tuytelaars

The next generation of aircraft collision avoidance systems frame the problem as a Markov decision process and use dynamic programming to optimize the alerting logic. The resulting system uses a large lookup table to determine advisories…

Systems and Control · Computer Science 2019-03-05 Kyle D. Julian , Shivam Sharma , Jean-Baptiste Jeannin , Mykel J. Kochenderfer

Neural networks are regularly employed in adaptive control of nonlinear systems and related methods of reinforcement learning. A common architecture uses a neural network with a single hidden layer (i.e. a shallow network), in which the…

Optimization and Control · Mathematics 2024-04-18 Andrew Lamperski , Tyler Lekang

We draw connections between simple neural networks and under-determined linear systems to comprehensively explore several interesting theoretical questions in the study of neural networks. First, we emphatically show that it is unsurprising…

Numerical Analysis · Mathematics 2020-11-02 Austin R. Benson , Anil Damle , Alex Townsend

Neural Networks (NNs) have increasingly apparent safety implications commensurate with their proliferation in real-world applications: both unanticipated as well as adversarial misclassifications can result in fatal outcomes. As a…

Machine Learning · Computer Science 2021-04-20 Haitham Khedr , James Ferlez , Yasser Shoukry

Neural Networks (NNs) are the method of choice for building learning algorithms. Their popularity stems from their empirical success on several challenging learning problems. However, most scholars agree that a convincing theoretical…

Numerical Analysis · Mathematics 2021-01-01 Ronald DeVore , Boris Hanin , Guergana Petrova