English
Related papers

Related papers: Contact Energy Based Hindsight Experience Prioriti…

200 papers

In this paper, we investigate preference-based reinforcement learning (PbRL), which enables reinforcement learning (RL) agents to learn from human feedback. This is particularly valuable when defining a fine-grain reward function is not…

Machine Learning · Computer Science 2025-11-11 Guojian Wang , Jianxiang Liu , Xinyuan Li , Faguo Wu , Xiao Zhang , Tianyuan Chen , Xuyang Chen

The utilization of the experience replay mechanism enables agents to effectively leverage their experiences on several occasions. In previous studies, the sampling probability of the transitions was modified based on their relative…

Machine Learning · Computer Science 2024-06-14 Arda Sarp Yenicesu , Furkan B. Mutlu , Suleyman S. Kozat , Ozgur S. Oguz

Prioritized Experience Replay (ER) has been empirically shown to improve sample efficiency across many domains and attracted great attention; however, there is little theoretical understanding of why such prioritized sampling helps and its…

Artificial Intelligence · Computer Science 2022-06-14 Yangchen Pan , Jincheng Mei , Amir-massoud Farahmand , Martha White , Hengshuai Yao , Mohsen Rohani , Jun Luo

Intrinsically elastic robots surpass their rigid counterparts in a range of different characteristics. By temporarily storing potential energy and subsequently converting it to kinetic energy, elastic robots are capable of highly dynamic…

Solving goal-oriented tasks is an important but challenging problem in reinforcement learning (RL). For such tasks, the rewards are often sparse, making it difficult to learn a policy effectively. To tackle this difficulty, we propose a new…

Machine Learning · Computer Science 2019-11-04 Hao Sun , Zhizhong Li , Xiaotong Liu , Dahua Lin , Bolei Zhou

Rewards play a crucial role in reinforcement learning. To arrive at the desired policy, the design of a suitable reward function often requires significant domain expertise as well as trial-and-error. Here, we aim to minimize the effort…

Robotics · Computer Science 2020-11-18 Zheng Wu , Wenzhao Lian , Vaibhav Unhelkar , Masayoshi Tomizuka , Stefan Schaal

Humans naturally "program" a fellow collaborator to perform a task by demonstrating the task few times. It is intuitive, therefore, for a human to program a collaborative robot by demonstration and many paradigms use a single demonstration…

Language creates a compact representation of the world and allows the description of unlimited situations and objectives through compositionality. While these characterizations may foster instructing, conditioning or structuring interactive…

Machine Learning · Computer Science 2020-12-11 Geoffrey Cideron , Mathieu Seurin , Florian Strub , Olivier Pietquin

Deep reinforcement learning excels in continuous control but often requires extensive exploration, while physics-based models demand complete equations and suffer cubic complexity. This study proposes Hybrid Energy-Aware Reward Shaping…

Machine Learning · Computer Science 2026-03-17 Qijun Liao , Jue Yang , Yiting Kang , Xinxin Zhao , Yong Zhang , Mingan Zhao

Human-robot teaming (HRT) systems often rely on large-scale datasets of human and robot interactions, especially for close-proximity collaboration tasks such as human-robot handovers. Learning robot manipulation policies from raw,…

Robotics · Computer Science 2025-08-14 Yuekun Wu , Yik Lung Pang , Andrea Cavallaro , Changjae Oh

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

In contact-rich tasks, the hybrid, multi-modal nature of contact dynamics poses great challenges in model representation, planning, and control. Recent efforts have attempted to address these challenges via data-driven methods, learning…

Robotics · Computer Science 2024-03-11 Hien Bui , Michael Posa

The history of learning for control has been an exciting back and forth between two broad classes of algorithms: planning and reinforcement learning. Planning algorithms effectively reason over long horizons, but assume access to a local…

Artificial Intelligence · Computer Science 2019-06-13 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Despite the fact that robotic platforms can provide both consistent practice and objective assessments of users over the course of their training, there are relatively few instances where physical human robot interaction has been…

Robotics · Computer Science 2019-11-20 Kathleen Fitzsimons , Aleksandra Kalinowska , Julius P. A. Dewald , Todd Murphey

Dexterous manipulation tasks involving contact-rich interactions pose a significant challenge for both model-based control systems and imitation learning algorithms. The complexity arises from the need for multi-fingered robotic hands to…

Machine Learning · Computer Science 2023-09-08 Zheyuan Hu , Aaron Rovinsky , Jianlan Luo , Vikash Kumar , Abhishek Gupta , Sergey Levine

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL algorithm based on…

Systems and Control · Electrical Eng. & Systems 2021-06-08 Myoung Hoon Lee , Jun Moon

Reinforcement learning has achieved remarkable success in robot learning. However, under challenging exploration and contact-rich dynamics, early-stage training is frequently dominated by premature terminations such as collisions and falls.…

Robotics · Computer Science 2026-03-10 Chenyang Miao

Handing objects to humans is an essential capability for collaborative robots. Previous research works on human-robot handovers focus on facilitating the performance of the human partner and possibly minimising the physical effort needed to…

Preference-based reinforcement learning (PbRL) can enable robots to learn to perform tasks based on an individual's preferences without requiring a hand-crafted reward function. However, existing approaches either assume access to a…

Machine Learning · Computer Science 2024-02-13 Yi Liu , Gaurav Datta , Ellen Novoseller , Daniel S. Brown

Preference-based reinforcement learning (RL) algorithms help avoid the pitfalls of hand-crafted reward functions by distilling them from human preference feedback, but they remain impractical due to the burdensome number of labels required…

Machine Learning · Computer Science 2022-11-15 Katherine Metcalf , Miguel Sarabia , Barry-John Theobald