English
Related papers

Related papers: Towards Generalization and Simplicity in Continuou…

200 papers

A data-based policy for iterative control task is presented. The proposed strategy is model-free and can be applied whenever safe input and state trajectories of a system performing an iterative task are available. These trajectories,…

Systems and Control · Computer Science 2019-03-22 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

A key barrier to using reinforcement learning (RL) in many real-world applications is the requirement of a large number of system interactions to learn a good control policy. Off-policy and Offline RL methods have been proposed to reduce…

Machine Learning · Computer Science 2022-12-02 Wenqi Cui , Linbin Huang , Weiwei Yang , Baosen Zhang

Recently, reinforcement learning (RL) algorithms have demonstrated remarkable success in learning complicated behaviors from minimally processed input. However, most of this success is limited to simulation. While there are promising…

Machine Learning · Computer Science 2019-03-29 Quan Vuong , Sharad Vikram , Hao Su , Sicun Gao , Henrik I. Christensen

We propose a novel method for analyzing and visualizing the complexity of standard reinforcement learning (RL) benchmarks based on score distributions. A large number of policy networks are generated by randomly guessing their parameters,…

Machine Learning · Computer Science 2020-04-17 Declan Oller , Tobias Glasmachers , Giuseppe Cuccu

Classifiers can be trained with data-dependent constraints to satisfy fairness goals, reduce churn, achieve a targeted false positive rate, or other policy goals. We study the generalization performance for such constrained optimization…

Machine Learning · Computer Science 2018-10-02 Andrew Cotter , Maya Gupta , Heinrich Jiang , Nathan Srebro , Karthik Sridharan , Serena Wang , Blake Woodworth , Seungil You

Generative control policies have recently unlocked major progress in robotics. These methods produce action sequences via diffusion or flow matching, with training data provided by demonstrations. But existing methods come with two key…

Robotics · Computer Science 2026-03-09 Vince Kurtz , Joel W. Burdick

A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic…

Machine Learning · Computer Science 2022-03-10 Yikun Cheng , Pan Zhao , Manan Gandhi , Bo Li , Evangelos Theodorou , Naira Hovakimyan

Control barrier functions (CBFs) enable guaranteed safe multi-agent navigation in the continuous domain. The resulting navigation performance, however, is highly sensitive to the underlying hyperparameters. Traditional approaches consider…

Robotics · Computer Science 2023-09-12 Zhan Gao , Guang Yang , Amanda Prorok

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

Many tasks in control, robotics, and planning can be specified using desired goal configurations for various entities in the environment. Learning goal-conditioned policies is a natural paradigm to solve such tasks. However, current…

Machine Learning · Computer Science 2022-03-14 Allan Zhou , Vikash Kumar , Chelsea Finn , Aravind Rajeswaran

In complex manipulation scenarios (e.g. tasks requiring complex interaction of two hands or in-hand manipulation), generalization is a hard problem. Current methods still either require a substantial amount of (supervised) training data and…

Robotics · Computer Science 2017-08-15 Simon Hangl , Emre Ugur , Sandor Szedmak , Justus Piater

Policy gradient methods in reinforcement learning have become increasingly prevalent for state-of-the-art performance in continuous control tasks. Novel methods typically benchmark against a few key algorithms such as deep deterministic…

Machine Learning · Computer Science 2017-08-15 Riashat Islam , Peter Henderson , Maziar Gomrokchi , Doina Precup

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

In many real-world applications, reinforcement learning (RL) agents might have to solve multiple tasks, each one typically modeled via a reward function. If reward functions are expressed linearly, and the agent has previously learned a set…

Machine Learning · Computer Science 2022-06-24 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

The development of a generalist agent capable of solving a wide range of sequential decision-making tasks remains a significant challenge. We address this problem in a cross-agent setup where agents share the same observation space but…

Artificial Intelligence · Computer Science 2025-02-21 Niklas Höpner , David Kuric , Herke van Hoof

In this work, we address the problem of solving complex collaborative robotic tasks subject to multiple varying parameters. Our approach combines simultaneous policy blending with system identification to create generalized policies that…

Robotics · Computer Science 2022-05-23 Luke Bhan , Marcos Quinones-Grueiro , Gautam Biswas

Direct policy gradient methods for reinforcement learning and continuous control problems are a popular approach for a variety of reasons: 1) they are easy to implement without explicit knowledge of the underlying model 2) they are an…

Machine Learning · Computer Science 2019-03-26 Maryam Fazel , Rong Ge , Sham M. Kakade , Mehran Mesbahi

In this work we provide a computationally tractable procedure for designing affine control policies, applied to constrained, discrete-time, partially observable, linear systems subject to set bounded disturbances, stochastic noise and…

Optimization and Control · Mathematics 2018-11-27 Georgios Kotsalis , Guanghui Lan

This manuscript contains technical results related to a particular approach for the design of Model Predictive Control (MPC) laws. The approach, named "generalized" terminal state constraint, induces the recursive feasibility of the…

Systems and Control · Computer Science 2013-07-16 Lorenzo Fagiano , Andrew R. Teel