English
Related papers

Related papers: CACTO-BIC: Scalable Actor-Critic Learning via Bias…

200 papers

Optimal behaviours of a system to perform a specific task can be achieved by leveraging the coupling between trajectory optimization, stabilization, and design optimization. This approach is particularly advantageous for underactuated…

Robotics · Computer Science 2024-08-13 Federico Girlanda , Lasse Shala , Shivesh Kumar , Frank Kirchner

Model-free deep reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. However, these methods typically suffer from two major challenges: high sample…

Multi-task reinforcement learning (RL) aims to find a single policy that effectively solves multiple tasks at the same time. This paper presents a constrained formulation for multi-task RL where the goal is to maximize the average…

Optimization and Control · Mathematics 2024-05-07 Sihan Zeng , Thinh T. Doan , Justin Romberg

Action and observation delays commonly occur in many Reinforcement Learning applications, such as remote control scenarios. We study the anatomy of randomly delayed environments, and show that partially resampling trajectory fragments in…

Machine Learning · Computer Science 2021-05-06 Simon Ramstedt , Yann Bouteiller , Giovanni Beltrame , Christopher Pal , Jonathan Binas

Efficient and effective exploration in continuous space is a central problem in applying reinforcement learning (RL) to autonomous driving. Skills learned from expert demonstrations or designed for specific tasks can benefit the…

Robotics · Computer Science 2022-09-27 Tong Zhou , Letian Wang , Ruobing Chen , Wenshuo Wang , Yu Liu

Offline Reinforcement Learning (RL) relies on policy constraints to mitigate extrapolation error, where both the constraint form and constraint strength critically shape performance. However, most existing methods commit to a single…

Machine Learning · Computer Science 2026-02-02 Xinchen Han , Qiuyang Fang , Hossam Afifi , Michel Marot

Modern paradigms for robot imitation train expressive policy architectures on large amounts of human demonstration data. Yet performance on contact-rich, deformable-object, and long-horizon tasks plateau far below perfect execution, even…

Robotics · Computer Science 2025-09-10 Zheyuan Hu , Robyn Wu , Naveen Enock , Jasmine Li , Riya Kadakia , Zackory Erickson , Aviral Kumar

Real-world electricity consumption prediction may involve different tasks, e.g., prediction for different time steps ahead or different geo-locations. These tasks are often solved independently without utilizing some common problem-solving…

Machine Learning · Computer Science 2022-06-01 Hui Song , A. K. Qin , Chenggang Yan

Bandit Convex Optimization (BCO) is a fundamental framework for modeling sequential decision-making with partial information, where the only feedback available to the player is the one-point or two-point function values. In this paper, we…

Machine Learning · Computer Science 2020-07-07 Peng Zhao , Guanghui Wang , Lijun Zhang , Zhi-Hua Zhou

Actor-critic methods, a type of model-free reinforcement learning (RL), have achieved state-of-the-art performances in many real-world domains in continuous control. Despite their success, the wide-scale deployment of these models is still…

Machine Learning · Computer Science 2020-12-14 Srinjoy Roy , Saptam Bakshi , Tamal Maharaj

Critique-guided reinforcement learning (RL) has emerged as a powerful paradigm for training LLM agents by augmenting sparse outcome rewards with natural-language feedback. However, current methods often rely on static or offline critic…

Artificial Intelligence · Computer Science 2026-04-15 Zhicong Li , Lingjie Jiang , Yulan Hu , Xingchen Zeng , Yixia Li , Xiangwen Zhang , Guanhua Chen , Zheng Pan , Xin Li , Yong Liu

Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offline safe RL problem…

Machine Learning · Computer Science 2023-06-22 Zuxin Liu , Zijian Guo , Yihang Yao , Zhepeng Cen , Wenhao Yu , Tingnan Zhang , Ding Zhao

Tradable credit schemes (TCS) are an increasingly studied alternative to congestion pricing, given their revenue neutrality and ability to address issues of equity through the initial credit allocation. Modeling TCS to aid future design and…

Machine Learning · Computer Science 2025-04-14 Xiaoyi Wu , Ravi Seshadri , Filipe Rodrigues , Carlos Lima Azevedo

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Group-based reinforcement learning (RL) methods have achieved remarkable success in improving the performance of large language models (LLMs) and have been rapidly extended to agentic tasks. However, their credit assignment relies heavily…

Machine Learning · Computer Science 2026-05-27 Xin Cheng , Shuo He , Lang Feng , HaiYang Xu , Ming Yan , Lei Feng , Bo An

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

This paper presents a hybrid approach that integrates trajectory optimization (TO) and reinforcement learning (RL) for motion planning and control of free-flying multi-arm robots in on-orbit servicing scenarios. The proposed system…

Over the recent years, reinforcement learning (RL) starts to show promising results in tackling combinatorial optimization (CO) problems, in particular when coupled with curriculum learning to facilitate training. Despite emerging empirical…

Machine Learning · Computer Science 2023-11-07 Runlong Zhou , Zelin He , Yuandong Tian , Yi Wu , Simon S. Du

Recent advances in constrained reinforcement learning (RL) have endowed reinforcement learning with certain safety guarantees. However, deploying existing constrained RL algorithms in continuous control tasks with general hard constraints…

Machine Learning · Computer Science 2023-12-22 Shutong Ding , Jingya Wang , Yali Du , Ye Shi

Parameterized movement primitives have been extensively used for imitation learning of robotic tasks. However, the high-dimensionality of the parameter space hinders the improvement of such primitives in the reinforcement learning (RL)…

Robotics · Computer Science 2022-02-14 Samuele Tosatto , Georgia Chalvatzaki , Jan Peters