English
Related papers

Related papers: Sample-Specific Output Constraints for Neural Netw…

200 papers

This paper investigates reinforcement learning with constraints, which are indispensable in safety-critical environments. To drive the constraint violation monotonically decrease, we take the constraints as Lyapunov functions and impose new…

Machine Learning · Computer Science 2021-05-07 Chuangchuang Sun , Dong-Ki Kim , Jonathan P. How

Our ability to sample realistic natural images, particularly faces, has advanced by leaps and bounds in recent years, yet our ability to exert fine-tuned control over the generative process has lagged behind. If this new technology is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Marek Kowalski , Stephan J. Garbin , Virginia Estellers , Tadas Baltrušaitis , Matthew Johnson , Jamie Shotton

Neural networks are powerful tools for data-driven modeling of complex dynamical systems, enhancing predictive capability for control applications. However, their inherent nonlinearity and black-box nature challenge control designs that…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Xiao Li , Tianhao Wei , Changliu Liu , Anouck Girard , Ilya Kolmanovsky

This work presents a novel ensemble of Bayesian Neural Networks (BNNs) for control of safety-critical systems. Decision making for safety-critical systems is challenging due to performance requirements with significant consequences in the…

Robotics · Computer Science 2020-01-10 Keuntaek Lee , Ziyi Wang , Bogdan I. Vlahov , Harleen K. Brar , Evangelos A. Theodorou

In this work we introduce a convolutional neural network (CNN) that jointly handles low-, mid-, and high-level vision tasks in a unified architecture that is trained end-to-end. Such a universal network can act like a `swiss knife' for…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Iasonas Kokkinos

This paper introduces differentiable higher-order control barrier functions (CBF) that are end-to-end trainable together with learning systems. CBFs are usually overly conservative, while guaranteeing safety. Here, we address their…

Machine Learning · Computer Science 2021-11-23 Wei Xiao , Ramin Hasani , Xiao Li , Daniela Rus

Neural networks (NN) perform well in diverse tasks, but sometimes produce nonsensical results to humans. Most NN models "solely" learn from (input, output) pairs, occasionally conflicting with human knowledge. Many studies indicate…

Machine Learning · Computer Science 2024-08-22 Mooho Song , Jay-Yoon Lee

While deep learning techniques have become extremely popular for solving a broad range of optimization problems, methods to enforce hard constraints during optimization, particularly on deep neural networks, remain underdeveloped. Inspired…

We introduce techniques for exploring the functionality of a neural network and extracting simple, human-readable approximations to its performance. By performing gradient ascent on the input space of the network, we are able to produce…

High Energy Physics - Phenomenology · Physics 2018-04-26 Thomas Roxlo , Matthew Reece

The significance of learning constraints from data is underscored by its potential applications in real-world problem-solving. While constraints are popular for modeling and solving, the approaches to learning constraints from data remain…

Machine Learning · Computer Science 2024-03-05 Eduardo Vyhmeister , Rocio Paez , Gabriel Gonzalez

This paper focuses on finding reinforcement learning policies for control systems with hard state and action constraints. Despite its success in many domains, reinforcement learning is challenging to apply to problems with hard constraints,…

Machine Learning · Computer Science 2020-03-24 Liyuan Zheng , Yuanyuan Shi , Lillian J. Ratliff , Baosen Zhang

The increasing adoption of neural networks in learning-augmented systems highlights the importance of model safety and robustness, particularly in safety-critical domains. Despite progress in the formal verification of neural networks,…

Machine Learning · Computer Science 2024-10-25 Shuowei Jin , Francis Y. Yan , Cheng Tan , Anuj Kalia , Xenofon Foukas , Z. Morley Mao

Neural networks can emulate nonlinear physical systems with high accuracy, yet they may produce physically-inconsistent results when violating fundamental constraints. Here, we introduce a systematic way of enforcing nonlinear analytic…

Computational Physics · Physics 2021-03-10 Tom Beucler , Michael Pritchard , Stephan Rasp , Jordan Ott , Pierre Baldi , Pierre Gentine

Neural networks have emerged as powerful tools across various applications, yet their decision-making process often remains opaque, leading to them being perceived as "black boxes." This opacity raises concerns about their interpretability…

Machine Learning · Computer Science 2024-11-27 Pirzada Suhail , Amit Sethi

We introduce Hyper Input Convex Neural Networks (HyCNNs), a novel neural network architecture designed for learning convex functions. HyCNNs combine the principles of Maxout networks with input convex neural networks (ICNNs) to create a…

Machine Learning · Computer Science 2026-04-30 Shayan Hundrieser , Insung Kong , Johannes Schmidt-Hieber

As part of a complete software stack for autonomous driving, NVIDIA has created a neural-network-based system, known as PilotNet, which outputs steering angles given images of the road ahead. PilotNet is trained using road images paired…

Computer Vision and Pattern Recognition · Computer Science 2017-04-27 Mariusz Bojarski , Philip Yeres , Anna Choromanska , Krzysztof Choromanski , Bernhard Firner , Lawrence Jackel , Urs Muller

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

Safe learning is essential for deploying learningbased controllers in safety-critical robotic systems, yet existing approaches often enforce multiple safety constraints uniformly or via fixed priority orders, leading to infeasibility and…

Machine Learning · Computer Science 2026-02-02 Kiwan Wong , Wei Xiao , Daniela Rus

Incorporating domain-specific constraints into machine learning models is essential for generating predictions that are both accurate and feasible in real-world applications. This paper introduces new methods for training Output-Constrained…

Machine Learning · Computer Science 2026-04-06 Hüseyin Tunç , Doğanay Özese , Ş. İlker Birbil , Donato Maragno , Marco Caserta , Mustafa Baydoğan