English
Related papers

Related papers: Physics-Informed Policy Optimization via Analytic …

200 papers

When using a tool, the grasps used for picking it up, reposing, and holding it in a suitable pose for the desired task could be distinct. Therefore, a key challenge for autonomous in-hand tool manipulation is finding a sequence of grasps…

Robotics · Computer Science 2023-04-06 Ethan K. Gordon , Rana Soltani Zarrin

Deep reinforcement learning (DRL) algorithms have been demonstrated to be effective in a wide range of challenging decision making and control tasks. However, these methods typically suffer from severe action oscillations in particular in…

Machine Learning · Computer Science 2021-03-04 Chen Chen , Hongyao Tang , Jianye Hao , Wulong Liu , Zhaopeng Meng

Policy gradient algorithms typically combine discounted future rewards with an estimated value function, to compute the direction and magnitude of parameter updates. However, for most Reinforcement Learning tasks, humans can provide…

Machine Learning · Computer Science 2019-04-09 Ishan Durugkar , Matthew Hausknecht , Adith Swaminathan , Patrick MacAlpine

We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation using a relatively simple vehicle model, including model randomization, can…

Robotics · Computer Science 2021-05-10 Eugenio Chisari , Alexander Liniger , Alisa Rupenyan , Luc Van Gool , John Lygeros

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are…

Machine Learning · Computer Science 2020-09-11 Marcin Szulc , Jakub Łyskawa , Paweł Wawrzyński

Reinforcement learning (RL) has gained attention for aligning large language models (LLMs) via reinforcement learning from human feedback (RLHF). The actor-only variants of Proximal Policy Optimization (PPO) are widely applied for their…

Optimization and Control · Mathematics 2025-12-19 Yin Liu , Qiming Dai , Junyu Zhang , Zaiwen Wen

Effective inclusion of physics-based knowledge into deep neural network models of dynamical systems can greatly improve data efficiency and generalization. Such a-priori knowledge might arise from physical principles (e.g., conservation…

Machine Learning · Computer Science 2022-12-13 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

Linear control models have gained extensive application in vehicle control due to their simplicity, ease of use, and support for stability analysis. However, these models lack adaptability to the changing environment and multi-objective…

Artificial Intelligence · Computer Science 2024-09-25 Keke Long , Haotian Shi , Yang Zhou , Xiaopeng Li

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

Machine Learning · Computer Science 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

Machine Learning · Computer Science 2025-04-03 Llewyn Salt , Marcus Gallagher

High-quality and representative data is essential for both Imitation Learning (IL)- and Reinforcement Learning (RL)-based motion planning tasks. For real robots, it is challenging to collect enough qualified data either as demonstrations…

Robotics · Computer Science 2023-06-13 Sha Luo , Lambert Schomaker

During initial iterations of training in most Reinforcement Learning (RL) algorithms, agents perform a significant number of random exploratory steps. In the real world, this can limit the practicality of these algorithms as it can lead to…

Machine Learning · Computer Science 2022-10-17 Ashish Kumar Jayant , Shalabh Bhatnagar

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

While classic control theory offers state of the art solutions in many problem scenarios, it is often desired to improve beyond the structure of such solutions and surpass their limitations. To this end, residual policy learning (RPL)…

Robotics · Computer Science 2021-08-09 Alireza Ranjbar , Ngo Anh Vien , Hanna Ziesche , Joschka Boedecker , Gerhard Neumann

Reinforcement learning (RL) has significantly advanced the control of physics-based and robotic characters that track kinematic reference motion. However, methods typically rely on a weighted sum of conflicting reward functions, requiring…

Robotics · Computer Science 2025-05-30 Lucas N. Alegre , Agon Serifi , Ruben Grandia , David Müller , Espen Knoop , Moritz Bächer

In many real-world applications of reinforcement learning (RL), interactions with the environment are limited due to cost or feasibility. This presents a challenge to traditional RL algorithms since the max-return objective involves an…

Machine Learning · Computer Science 2019-12-05 Ofir Nachum , Bo Dai , Ilya Kostrikov , Yinlam Chow , Lihong Li , Dale Schuurmans

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

In performative Reinforcement Learning (RL), an agent faces a policy-dependent environment: the reward and transition functions depend on the agent's policy. Prior work on performative RL has studied the convergence of repeated retraining…

Machine Learning · Computer Science 2025-05-12 Vasilis Pollatos , Debmalya Mandal , Goran Radanovic