English
Related papers

Related papers: Improving and Accelerating Offline RL in Large Dis…

200 papers

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

Reliable spacecraft attitude control depends on accurate prediction of attitude dynamics, particularly when model-based strategies such as Model Predictive Control (MPC) are employed, where performance is limited by the quality of the…

Robotics · Computer Science 2026-02-19 Carlo Cena , Mauro Martini , Marcello Chiaberge

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

Artificial Intelligence · Computer Science 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

Articulated object manipulation is a challenging task, requiring constrained motion and adaptive control to handle the unknown dynamics of the manipulated objects. While reinforcement learning (RL) has been widely employed to tackle various…

Robotics · Computer Science 2024-12-12 Yujin Kim , Sol Choi , Bum-Jae You , Keunwoo Jang , Yisoo Lee

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

We implement the reinforcement learning agent for a spin-1 atomic system to prepare spin squeezed state from given initial state. Proximal policy gradient (PPO) algorithm is used to deal with continuous external control field and final…

Quantum Physics · Physics 2019-02-21 Jun-Jie Chen , Ming Xue

Reinforcement Learning algorithms can learn complex behavioral patterns for sequential decision making tasks wherein an agent interacts with an environment and acquires feedback in the form of rewards sampled from it. Traditionally, such…

Machine Learning · Computer Science 2020-09-23 Sahil Sharma , Aravind Srinivas , Balaraman Ravindran

In sequential decision-making problems, Return-Conditioned Supervised Learning (RCSL) has gained increasing recognition for its simplicity and stability in modern decision-making tasks. Unlike traditional offline reinforcement learning (RL)…

Machine Learning · Computer Science 2025-06-11 Zhishuai Liu , Yu Yang , Ruhan Wang , Pan Xu , Dongruo Zhou

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Deep reinforcement learning (RL) has achieved great empirical successes in various domains. However, the large search space of neural networks requires a large amount of data, which makes the current RL algorithms not sample efficient.…

Machine Learning · Computer Science 2020-08-18 Qianli Shen , Yan Li , Haoming Jiang , Zhaoran Wang , Tuo Zhao

Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs). However, their performance heavily relies on the strategy used to select training points. Conventional adaptive…

Machine Learning · Computer Science 2025-04-18 Zhenao Song

Safe Policy Improvement (SPI) is an important technique for offline reinforcement learning in safety critical applications as it improves the behavior policy with a high probability. We classify various SPI approaches from the literature…

Machine Learning · Computer Science 2022-08-02 Philipp Scholl , Felix Dietrich , Clemens Otte , Steffen Udluft

Pretrained foundation models have exhibited extraordinary in-context learning performance, allowing zero-shot generalization to new tasks not encountered during pretraining. In the case of reinforcement learning (RL), in-context RL (ICRL)…

Machine Learning · Computer Science 2025-05-05 Weiqin Chen , Santiago Paternain

Reinforcement learning (RL) has demonstrated its ability to solve high dimensional tasks by leveraging non-linear function approximators. However, these successes are mostly achieved by 'black-box' policies in simulated domains. When…

Machine Learning · Computer Science 2021-11-19 Riad Akrour , Davide Tateo , Jan Peters

Robot learning has proven to be a general and effective technique for programming manipulators. Imitation learning is able to teach robots solely from human demonstrations but is bottlenecked by the capabilities of the demonstrations.…

Robotics · Computer Science 2024-10-24 Zihan Zhou , Animesh Garg , Dieter Fox , Caelan Garrett , Ajay Mandlekar

Understanding the behavior of deep reinforcement learning (DRL) agents is crucial for improving their performance and reliability. However, the complexity of their policies often makes them challenging to understand. In this paper, we…

Machine Learning · Computer Science 2024-02-21 Sindre Benjamin Remman , Anastasios M. Lekkas

Mainstream visuomotor policies predominantly rely on generative models for holistic action prediction, while current autoregressive policies, predicting the next token or chunk, have shown suboptimal results. This motivates a search for…

Robotics · Computer Science 2025-03-18 Yue Su , Xinyu Zhan , Hongjie Fang , Han Xue , Hao-Shu Fang , Yong-Lu Li , Cewu Lu , Lixin Yang

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. The proposed…

Systems and Control · Electrical Eng. & Systems 2024-08-28 Maximilian Bloor , Akhil Ahmed , Niki Kotecha , Mehmet Mercangöz , Calvin Tsay , Ehecactl Antonio Del Rio Chanona

Safe policy improvement (SPI) is an offline reinforcement learning problem in which a new policy that reliably outperforms the behavior policy with high confidence needs to be computed using only a dataset and the behavior policy. Markov…

Artificial Intelligence · Computer Science 2025-08-20 Kasper Engelen , Guillermo A. Pérez , Marnix Suilen

We explore Deep Reinforcement Learning in a parameterized action space. Specifically, we investigate how to achieve sample-efficient end-to-end training in these tasks. We propose a new compact architecture for the tasks where the parameter…

Machine Learning · Computer Science 2018-10-24 Ermo Wei , Drew Wicke , Sean Luke