English
Related papers

Related papers: Safe Policy Search with Gaussian Process Models

200 papers

Monte Carlo methods have become increasingly relevant for control of non-differentiable systems, approximate dynamics models and learning from data. These methods scale to high-dimensional spaces and are effective at the non-convex…

Machine Learning · Computer Science 2022-10-10 Joe Watson , Jan Peters

Gaussian processes are frequently deployed as part of larger machine learning and decision-making systems, for instance in geospatial modeling, Bayesian optimization, or in latent Gaussian models. Within a system, the Gaussian process model…

Recently, a novel linear model predictive control algorithm based on a physics-informed Gaussian Process has been introduced, whose realizations strictly follow a system of underlying linear ordinary differential equations with constant…

Optimization and Control · Mathematics 2025-05-01 Adrian Lepp , Jörn Tebbe , Andreas Besginow

Gaussian Processes (GPs) offer an attractive method for regression over small, structured and correlated datasets. However, their deployment is hindered by computational costs and limited guidelines on how to apply GPs beyond simple…

Machine Learning · Computer Science 2023-07-18 Kenza Tazi , Jihao Andreas Lin , Ross Viljoen , Alex Gardner , ST John , Hong Ge , Richard E. Turner

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

An inference method for Gaussian process augmented state-space models are presented. This class of grey-box models enables domain knowledge to be incorporated in the inference process to guarantee a minimum of performance, still they are…

Signal Processing · Electrical Eng. & Systems 2020-03-17 Anton Kullberg , Isaac Skog , Gustaf Hendeby

We propose a novel group of Gaussian Process based algorithms for fast approximate optimal stopping of time series with specific applications to financial markets. We show that structural properties commonly exhibited by financial time…

Machine Learning · Statistics 2022-10-11 Kshama Dwarakanath , Danial Dervovic , Peyman Tavallali , Svitlana S Vyetrenko , Tucker Balch

High performance tracking control can only be achieved if a good model of the dynamics is available. However, such a model is often difficult to obtain from first order physics only. In this paper, we develop a data-driven control law that…

Systems and Control · Computer Science 2018-11-20 Thomas Beckers , Jonas Umlauft , Dana Kulić , Sandra Hirche

Model selection aims to find the best model in terms of accuracy, interpretability or simplicity, preferably all at once. In this work, we focus on evaluating model performance of Gaussian process models, i.e. finding a metric that provides…

Machine Learning · Computer Science 2024-03-15 Andreas Besginow , Jan David Hüwel , Thomas Pawellek , Christian Beecks , Markus Lange-Hegermann

To control how a robot moves, motion planning algorithms must compute paths in high-dimensional state spaces while accounting for physical constraints related to motors and joints, generating smooth and stable motions, avoiding obstacles,…

Complex computer codes are often too time expensive to be directly used to perform uncertainty propagation studies, global sensitivity analysis or to solve optimization problems. A well known and widely used method to circumvent this…

Applications · Statistics 2008-04-06 Amandine Marrel , Bertrand Iooss , Francois Van Dorpe , Elena Volkova

Many industrial applications rely on real-time optimization to improve key performance indicators. In the case of unknown process characteristics, real-time optimization becomes challenging, particularly for the satisfaction of safety…

Optimization and Control · Mathematics 2023-02-03 Buse Sibel Korkmaz , Marta Zagórowska , Mehmet Mercangöz

The log-Gaussian Cox process is a flexible and popular class of point pattern models for capturing spatial and space-time dependence for point patterns. Model fitting requires approximation of stochastic integrals which is implemented…

Computation · Statistics 2018-10-24 Shinichiro Shirota , Sudipto Banerjee

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

Machine Learning · Computer Science 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner

An important problem in sequential decision-making under uncertainty is to use limited data to compute a safe policy, i.e., a policy that is guaranteed to perform at least as well as a given baseline strategy. In this paper, we develop and…

Machine Learning · Statistics 2016-07-14 Marek Petrik , Yinlam Chow , Mohammad Ghavamzadeh

The Gaussian process (GP) is a Bayesian nonparametric paradigm that is widely adopted for uncertainty quantification (UQ) in a number of safety-critical applications, including robotics, healthcare, as well as surveillance. The consistency…

Machine Learning · Computer Science 2024-10-10 Jinwen Xu , Qin Lu , Georgios B. Giannakis

Enforcing state-wise safety constraints is critical for the application of reinforcement learning (RL) in real-world problems, such as autonomous driving and robot manipulation. However, existing safe RL methods only enforce state-wise…

Machine Learning · Computer Science 2024-10-03 Weiye Zhao , Feihan Li , Yifan Sun , Yujie Wang , Rui Chen , Tianhao Wei , Changliu Liu

Despite recent advances in automated machine learning, model selection is still a complex and computationally intensive process. For Gaussian processes (GPs), selecting the kernel is a crucial task, often done manually by the expert.…

Machine Learning · Computer Science 2022-10-24 Matthias Bitzer , Mona Meister , Christoph Zimmer

Designing controllers under uncertainty requires balancing the need to explore system dynamics with the requirement to maintain reliable control performance. Dual control addresses this challenge by selecting actions that both regulate the…

Optimization and Control · Mathematics 2025-12-18 Mohammad Mahmoudi Filabadi , Guillaume Crevecoeur , Tom Lefebvre

Data-driven methods for physics-based character control using reinforcement learning have been successfully applied to generate high-quality motions. However, existing approaches typically rely on Gaussian distributions to represent the…

Machine Learning · Computer Science 2021-10-06 Pei Xu , Ioannis Karamouzas