English
Related papers

Related papers: Learning Dynamic-Objective Policies from a Class o…

200 papers

Numerically computing global policies to optimal control problems for complex dynamical systems is mostly intractable. In consequence, a number of approximation methods have been developed. However, none of the current methods can quantify…

Robotics · Computer Science 2021-03-05 Ashwin Khadke , Hartmut Geyer

Online approximation of an infinite horizon optimal path-following strategy for a kinematic unicycle is considered. The solution to the optimal control problem is approximated using an approximate dynamic programming technique that uses…

Systems and Control · Computer Science 2013-10-02 Patrick Walters , Rushikesh Kamalapurkar , Lindsey Andrews , Warren E. Dixon

Dynamic loco-manipulation calls for effective whole-body control and contact-rich interactions with the object and the environment. Existing learning-based control synthesis relies on training low-level skill policies and explicitly…

Robotics · Computer Science 2025-10-10 Prashanth Ravichandar , Lokesh Krishna , Nikhil Sobanbabu , Quan Nguyen

Flexible-joint manipulators are governed by complex nonlinear dynamics, defining a challenging control problem. In this work, we propose an approach to learn an outer-loop joint trajectory tracking controller with deep reinforcement…

Robotics · Computer Science 2022-03-15 Dmytro Pavlichenko , Sven Behnke

Symbolic optimal control is a powerful method to synthesize algorithmically correct-by-design state-feedback controllers for nonlinear plants. Its solutions are (near-)optimal with respect to a given cost function. In this note, it is…

Optimization and Control · Mathematics 2022-05-30 Alexander Weber , Florian Fiege , Alexander Knoll

We propose a machine learning framework to synthesize reactive controllers for systems whose interactions with their adversarial environment are modeled by infinite-duration, two-player games over (potentially) infinite graphs. Our…

Computer Science and Game Theory · Computer Science 2020-11-03 Daniel Neider , Oliver Markgraf

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

The problem of offline reinforcement learning focuses on learning a good policy from a log of environment interactions. Past efforts for developing algorithms in this area have revolved around introducing constraints to online reinforcement…

Machine Learning · Computer Science 2022-04-27 Ian Char , Viraj Mehta , Adam Villaflor , John M. Dolan , Jeff Schneider

Trajectory following is one of the complicated control problems when its dynamics are nonlinear, stochastic and include a large number of parameters. The problem has significant difficulties including a large number of trials required for…

Robotics · Computer Science 2019-02-14 Ali Lenjani

Future sequence represents the outcome after executing the action into the environment (i.e. the trajectory onwards). When driven by the information-theoretic concept of mutual information, it seeks maximally informative consequences.…

Machine Learning · Computer Science 2023-11-15 Jianfei Ma

We develop an optimization framework centered around a core idea: once a (parametric) policy is specified, control authority is transferred to the policy, resulting in an autonomous dynamical system. Thus we should be able to optimize…

Machine Learning · Computer Science 2025-06-11 Emo Todorov

We consider the stabilization of Vlasov--Poisson plasma dynamics, a central control problem in nuclear fusion. Our focus is the gap between what an ideal controller would use and what experiments can actually observe: while optimal policy…

Machine Learning · Computer Science 2026-05-07 Xiaofan Xia , Qin Li , Wenlong Mou

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

Robotics · Computer Science 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza

We use reinforcement learning in simulation to obtain a driving system controlling a full-size real-world vehicle. The driving policy takes RGB images from a single camera and their semantic segmentation as input. We use mostly synthetic…

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Define an environment as a set of convex constraint functions that vary arbitrarily over time and consider a cost function that is also convex and arbitrarily varying. Agents that operate in this environment intend to select actions that…

Optimization and Control · Mathematics 2016-04-08 Santiago Paternain , Alejandro Ribeiro

When transferring a control policy from simulation to a physical system, the policy needs to be robust to variations in the dynamics to perform well. Commonly, the optimal policy overfits to the approximate model and the corresponding…

Machine Learning · Computer Science 2021-05-27 Michael Lutter , Shie Mannor , Jan Peters , Dieter Fox , Animesh Garg

Modern foundation models often undergo iterative ``bootstrapping'' in their post-training phase: a model generates synthetic data, an external verifier filters out low-quality samples, and the high-quality subset is used for further…

Machine Learning · Computer Science 2025-10-17 Pu Yang , Yunzhen Feng , Ziyuan Chen , Yuhang Wu , Zhuoyuan Li

Autonomous systems are increasingly expected to operate in the presence of adversaries, though adversaries may infer sensitive information simply by observing a system. Therefore, present a deceptive sequential decision-making framework…

The convergence of policy gradient algorithms in reinforcement learning hinges on the optimization landscape of the underlying optimal control problem. Theoretical insights into these algorithms can often be acquired from analyzing those of…

Machine Learning · Computer Science 2023-11-01 Jingliang Duan , Wenhan Cao , Yang Zheng , Lin Zhao