English
Related papers

Related papers: Learning Performance Bounds for Safety-Critical Sy…

200 papers

Cyber-physical systems (CPS) with reinforcement learning (RL)-based controllers are increasingly being deployed in complex physical environments such as autonomous vehicles, the Internet-of-Things(IoT), and smart cities. An important…

Systems and Control · Electrical Eng. & Systems 2024-06-26 Changjian Zhang , Parv Kapoor , Eunsuk Kang , Romulo Meira-Goes , David Garlan , Akila Ganlath , Shatadal Mishra , Nejib Ammar

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

Robotics · Computer Science 2024-03-01 Luka Kovač , Igor Farkaš

Controller tuning and parameter optimization are crucial in system design to improve both the controller and underlying system performance. Bayesian optimization has been established as an efficient model-free method for controller tuning…

Systems and Control · Electrical Eng. & Systems 2023-06-26 Christopher Koenig , Miks Ozols , Anastasia Makarova , Efe C. Balta , Andreas Krause , Alisa Rupenyan

This paper focuses on learning a model of system dynamics online while satisfying safety constraints.Our motivation is to avoid offline system identification or hand-specified dynamics models and allowa system to safely and autonomously…

Robotics · Computer Science 2020-05-07 Mohammad Javad Khojasteh , Vikas Dhiman , Massimo Franceschetti , Nikolay Atanasov

A general condition determining the optimal performance of a complex system has not yet been found and the possibility of its existence is unknown. To contribute in this direction, an optimization algorithm as a complex system is presented.…

Computational Complexity · Computer Science 2007-05-23 Victor Korotkikh , Galina Korotkikh , Darryl Bond

The idea of iterative process optimization based on collected output measurements, or "real-time optimization" (RTO), has gained much prominence in recent decades, with many RTO algorithms being proposed, researched, and developed. While…

Optimization and Control · Mathematics 2013-08-14 Gene A. Bunin , Grégory François , Dominique Bonvin

We apply the PAC-Bayes theory to the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-bounds) and explicit trade-off…

Machine Learning · Computer Science 2023-02-16 Michael Sucker , Peter Ochs

Performance evaluations are critical for quantifying algorithmic advances in reinforcement learning. Recent reproducibility analyses have shown that reported performance results are often inconsistent and difficult to replicate. In this…

Machine Learning · Computer Science 2020-08-14 Scott M. Jordan , Yash Chandak , Daniel Cohen , Mengxue Zhang , Philip S. Thomas

In this paper, we propose a system-level approach for verifying the safety of neural network controlled systems, combining a continuous-time physical system with a discrete-time neural network based controller. We assume a generic model for…

Artificial Intelligence · Computer Science 2020-11-11 Arthur Clavière , Eric Asselin , Christophe Garion , Claire Pagetti

Reinforcement learning (RL) agents need to be robust to variations in safety-critical environments. While system identification methods provide a way to infer the variation from online experience, they can fail in settings where fast…

Machine Learning · Computer Science 2022-03-07 Annie Xie , Shagun Sodhani , Chelsea Finn , Joelle Pineau , Amy Zhang

There have been numerous advances in reinforcement learning, but the typically unconstrained exploration of the learning process prevents the adoption of these methods in many safety critical applications. Recent work in safe reinforcement…

Machine Learning · Computer Science 2019-10-02 David Isele , Alireza Nakhaei , Kikuo Fujimura

Applying reinforcement learning (RL) methods on robots typically involves training a policy in simulation and deploying it on a robot in the real world. Because of the model mismatch between the real world and the simulator, RL agents…

Robotics · Computer Science 2021-12-23 Pulkit Katdare , Shuijing Liu , Katherine Driggs-Campbell

In this article, we consider a stochastic numerical simulator to assess the impact of some factors on a phenomenon. The simulator is seen as a black box with inputs and outputs. The quality of a simulation, hereafter referred to as…

Computation · Statistics 2017-07-27 Rémi Stroh , Séverine Demeyer , Nicolas Fischer , Julien Bect , Emmanuel Vazquez

Performance analysis of queueing networks is one of the most challenging areas of queueing theory. Barring very specialized models such as product-form type queueing networks, there exist very few results which provide provable…

Optimization and Control · Mathematics 2010-09-22 Dimitris Bertsimas , David Gamarnik , Alexander Rikun

The widescale deployment of Autonomous Vehicles (AV) appears to be imminent despite many safety challenges that are yet to be resolved. It is well-known that there are no universally agreed Verification and Validation (VV) methodologies…

Robotics · Computer Science 2020-11-17 Dhanoop Karunakaran , Stewart Worrall , Eduardo Nebot

In this work, we consider the problem of designing a safety filter for a nonlinear uncertain control system. Our goal is to augment an arbitrary controller with a safety filter such that the overall closed-loop system is guaranteed to stay…

Robotics · Computer Science 2022-04-11 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

Neural networks are vulnerable to adversarial attacks, i.e., small input perturbations can significantly affect the outputs of a neural network. Therefore, to ensure safety of neural networks in safety-critical environments, the robustness…

Machine Learning · Computer Science 2025-08-06 Lukas Koller , Tobias Ladner , Matthias Althoff

Autonomous systems such as self-driving cars rely on sensors to perceive the surrounding world. Measures must be taken against attacks on sensors, which have been a hot topic in the last few years. For that goal one must first evaluate how…

Cryptography and Security · Computer Science 2021-03-15 Koichi Shimizu , Daisuke Suzuki , Ryo Muramatsu , Hisashi Mori , Tomoyuki Nagatsuka , Tsutomu Matsumoto

Computer systems can be found everywhere: in space, in our homes, in our cars, in our pockets, and sometimes even in our own bodies. For concerns of safety, economy, and convenience, it is important that such systems work correctly.…

Logic in Computer Science · Computer Science 2019-05-22 Mathias Ruggaard Pedersen