English
Related papers

Related papers: Efficient sample selection for safe learning

200 papers

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that…

Numerical Analysis · Mathematics 2025-03-19 Shane A. McQuarrie , Anirban Chaudhuri , Karen E. Willcox , Mengwu Guo

Stochastic, iterative search methods such as Evolutionary Algorithms (EAs) are proven to be efficient optimizers. However, they require evaluation of the candidate solutions which may be prohibitively expensive in many real world…

Neural and Evolutionary Computing · Computer Science 2013-03-12 Maumita Bhattacharya

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

In the last decade, reinforcement learning successfully solved complex control tasks and decision-making problems, like the Go board game. Yet, there are few success stories when it comes to deploying those algorithms to real-world…

Artificial Intelligence · Computer Science 2024-09-13 Giuseppe Paolo , Jonas Gonzalez-Billandon , Albert Thomas , Balázs Kégl

Modern day engineering problems are ubiquitously characterized by sophisticated computer codes that map parameters or inputs to an underlying physical process. In other situations, experimental setups are used to model the physical process…

Machine Learning · Statistics 2021-07-02 Raphael Gautier , Piyush Pandita , Sayan Ghosh , Dimitri Mavris

Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent…

Machine Learning · Computer Science 2024-05-09 Akifumi Wachi , Xun Shen , Yanan Sui

Robotic algorithms typically depend on various parameters, the choice of which significantly affects the robot's performance. While an initial guess for the parameters may be obtained from dynamic models of the robot, parameters are usually…

Robotics · Computer Science 2020-04-08 Felix Berkenkamp , Andreas Krause , Angela P. Schoellig

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Distributionally robust control is a well-studied framework for optimal decision making under uncertainty, with the objective of minimizing an expected cost function over control actions, assuming the most adverse probability distribution…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Alexandros E. Tzikas , Lukas Fiechtner , Arec Jamgochian , Mykel J. Kochenderfer

Many decision-making processes involve solving a combinatorial optimization problem with uncertain input that can be estimated from historic data. Recently, problems in this class have been successfully addressed via end-to-end learning…

Machine Learning · Computer Science 2021-07-07 Maxime Mulamba , Jayanta Mandi , Michelangelo Diligenti , Michele Lombardi , Victor Bucarey , Tias Guns

Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage…

Machine Learning · Computer Science 2020-12-08 Mona Buisson-Fenet , Friedrich Solowjow , Sebastian Trimpe

We consider controller synthesis for stochastic and partially unknown environments in which safety is essential. Specifically, we abstract the problem as a Markov decision process in which the expected performance is measured using a cost…

Software Engineering · Computer Science 2015-10-21 Sebastian Junges , Nils Jansen , Christian Dehnert , Ufuk Topcu , Joost-Pieter Katoen

Sensor-based sorting systems enable the physical separation of a material stream into two fractions. The sorting decision is based on the image data evaluation of the sensors used and is carried out using actuators. Various process…

Machine Learning · Computer Science 2025-10-24 Felix Kronenwett , Georg Maier , Thomas Längle

Gaussian Process Regression is a popular nonparametric regression method based on Bayesian principles that provides uncertainty estimates for its predictions. However, these estimates are of a Bayesian nature, whereas for some important…

Machine Learning · Computer Science 2023-08-09 Christian Fiedler , Carsten W. Scherer , Sebastian Trimpe

Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions. However, a critical gap remains for their deployment in safety-critical domains: the…

Machine Learning · Computer Science 2026-03-02 Darshan Gadginmath , Ahmed Allibhoy , Fabio Pasqualetti

Bayesian inference and Gaussian processes are widely used in applications ranging from robotics and control to biological systems. Many of these applications are safety-critical and require a characterization of the uncertainty associated…

Machine Learning · Computer Science 2018-10-26 Luca Cardelli , Marta Kwiatkowska , Luca Laurenti , Andrea Patane

We tackle the problem of trajectory planning in an environment comprised of a set of obstacles with uncertain time-varying locations. The uncertainties are modeled using widely accepted Gaussian distributions, resulting in a…

Systems and Control · Electrical Eng. & Systems 2021-08-16 Vasileios Lefkopoulos , Maryam Kamgarpour

Safety is a critical feature of controller design for physical systems. When designing control policies, several approaches to guarantee this aspect of autonomy have been proposed, such as robust controllers or control barrier functions.…

Machine Learning · Computer Science 2021-02-26 Miguel Calvo-Fullana , Luiz F. O. Chamon , Santiago Paternain

Optimization via simulation (OvS) procedures that assume the simulation inputs are generated from the real-world distributions are subject to the risk of selecting a suboptimal solution when the distributions are substituted with input…

Methodology · Statistics 2021-01-20 Eunhye Song

We propose a general framework for machine learning based optimization under uncertainty. Our approach replaces the complex forward model by a surrogate, which is learned simultaneously in a one-shot sense when solving the optimal control…

Optimization and Control · Mathematics 2023-12-25 Philipp A. Guth , Claudia Schillings , Simon Weissmann