English
Related papers

Related papers: Data selection for multi-task learning under dynam…

200 papers

We present a straightforward and efficient way to control unstable robotic systems using an estimated dynamics model. Specifically, we show how to exploit the differentiability of Gaussian Processes to create a state-dependent linearized…

Robotics · Computer Science 2021-08-03 Ivan D. Jimenez Rodriguez , Ugo Rosolia , Aaron D. Ames , Yisong Yue

Stochastic policies (also known as relaxed controls) are widely used in continuous-time reinforcement learning algorithms. However, executing a stochastic policy and evaluating its performance in a continuous-time environment remain open…

Machine Learning · Computer Science 2025-10-03 Yanwei Jia , Du Ouyang , Yufei Zhang

Safety-critical technical systems operating in unknown environments require the ability to quickly adapt their behavior, which can be achieved in control by inferring a model online from the data stream generated during operation. Gaussian…

Systems and Control · Electrical Eng. & Systems 2022-02-24 Armin Lederer , Mingmin Zhang , Samuel Tesfazgi , Sandra Hirche

This paper introduces a method of identifying a maximal set of safe strategies from data for stochastic systems with unknown dynamics using barrier certificates. The first step is learning the dynamics of the system via Gaussian process…

Machine Learning · Computer Science 2024-05-07 Rayan Mazouz , John Skovbekk , Frederik Baymler Mathiesen , Eric Frew , Luca Laurenti , Morteza Lahijanian

The note studies the problem of selecting a good enough subset out of a finite number of alternatives under a fixed simulation budget. Our work aims to maximize the posterior probability of correctly selecting a good subset. We formulate…

Optimization and Control · Mathematics 2023-05-09 Gongbo Zhang , Bin Chen , Qing-shan Jia , Yijie Peng

Thompson sampling (TS) is a Bayesian randomized exploration strategy that samples options (e.g., system parameters or control laws) from the current posterior and then applies the selected option that is optimal for a task, thereby…

Machine Learning · Computer Science 2026-02-06 Kaikai Zheng , Dawei Shi , Yang Shi , Long Wang

In this paper, we consider the closed-loop control problem of nonlinear robotic systems in the presence of probabilistic uncertainties and disturbances. More precisely, we design a state feedback controller that minimizes deviations of the…

Robotics · Computer Science 2023-08-15 Weiqiao Han , Ashkan Jasour , Brian Williams

How can robots learn and adapt to new tasks and situations with little data? Systematic exploration and simulation are crucial tools for efficient robot learning. We present a novel black-box policy search algorithm focused on…

Robotics · Computer Science 2025-02-11 Shiming He , Alexander von Rohr , Dominik Baumann , Ji Xiang , Sebastian Trimpe

We consider chance constrained optimization where it is sought to optimize a function while complying with constraints, both of which are affected by uncertainties. The high computational cost of realistic simulations strongly limits the…

Optimization and Control · Mathematics 2022-04-18 Julien Pelamatti , Rodolphe Le Riche , Céline Helbert , Christophette Blanchet-Scalliet

We consider the problem of direct data-driven predictive control for unknown stochastic linear time-invariant (LTI) systems with partial state observation. Building upon our previous research on data-driven stochastic control, this paper…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Ruiqi Li , John W. Simpson-Porco , Stephen L. Smith

Our goal is to deploy a high-accuracy system starting with zero training examples. We consider an "on-the-job" setting, where as inputs arrive, we use real-time crowdsourcing to resolve uncertainty where needed and output our prediction…

Artificial Intelligence · Computer Science 2015-12-09 Keenon Werling , Arun Chaganty , Percy Liang , Chris Manning

We present an Imitation Learning approach for the control of dynamical systems with a known model. Our policy search method is guided by solutions from MPC. Typical policy search methods of this kind minimize a distance metric between the…

Robotics · Computer Science 2020-02-18 Jan Carius , Farbod Farshidian , Marco Hutter

Constraint-based control approaches offer a flexible way to specify robotic manipulation tasks and execute them on robots with many degrees of freedom. However, the specification of task constraints and their associated priorities usually…

Robotics · Computer Science 2021-04-14 Dennis Mronga , Frank Kirchner

This article presents a constrained policy optimization approach for the optimal control of systems under nonstationary uncertainties. We introduce an assumption that we call Markov embeddability that allows us to cast the stochastic…

Optimization and Control · Mathematics 2026-05-11 Sungho Shin , François Pacaud , Emil Contantinescu , Mihai Anitescu

For the application of MPC design in on-line regulation or tracking control problems, several studies have attempted to develop an accurate model, and realize adequate uncertainty description of linear or non-linear plants of the processes.…

Optimization and Control · Mathematics 2019-04-03 Yuanqiang Zhou , Dewei Li , Yugeng Xi , Zhongxue Gan

We study data-driven learning of robust stochastic control for infinite-horizon systems with potentially continuous state and action spaces. In many managerial settings--supply chains, finance, manufacturing, services, and dynamic…

Machine Learning · Statistics 2025-11-18 Shengbo Wang , Jason Meng , Nian Si , Jose Blanchet , Zhengyuan Zhou

We propose a novel data-driven stochastic model predictive control framework for uncertain linear systems with noisy output measurements. Our approach leverages multi-step predictors to efficiently propagate uncertainty, ensuring chance…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Haldun Balim , Andrea Carron , Melanie N. Zeilinger , Johannes Köhler

Many dynamic decision problems, such as robotic control, involve a series of tasks, many of which are unknown at training time. Typical approaches for these problems, such as multi-task and meta reinforcement learning, do not generalize…

Machine Learning · Computer Science 2025-05-28 Luise Ge , Michael Lanier , Anindya Sarkar , Bengisu Guresti , Chongjie Zhang , Yevgeniy Vorobeychik

This paper considers the problem of determining an optimal control action based on observed data. We formulate the problem assuming that the system can be modelled by a nonlinear state-space model, but where the model parameters, state and…

Optimization and Control · Mathematics 2021-07-02 Johannes N. Hendriks , James R. Z. Holdsworth , Adrian G. Wills , Thomas B. Schon , Brett Ninness

We consider a simulation optimization problem for a context-dependent decision-making, which aims to determine the top-m designs for all contexts. Under a Bayesian framework, we formulate the optimal dynamic sampling decision as a…

Machine Learning · Statistics 2023-06-12 Gongbo Zhang , Sihua Chen , Kuihua Huang , Yijie Peng