English
Related papers

Related papers: EFGCL: Learning Dynamic Motion through Spotting-In…

200 papers

Continual learning aims to allow models to learn new tasks without forgetting what has been learned before. This work introduces Elastic Variational Continual Learning with Weight Consolidation (EVCL), a novel hybrid model that integrates…

Machine Learning · Computer Science 2024-06-25 Hunar Batra , Ronald Clark

Reinforcement learning (RL) holds great promise for enabling autonomous acquisition of complex robotic manipulation skills, but realizing this potential in real-world settings has been challenging. We present a human-in-the-loop…

Robotics · Computer Science 2025-03-21 Jianlan Luo , Charles Xu , Jeffrey Wu , Sergey Levine

Learning highly dynamic behaviors for robots has been a longstanding challenge. Traditional approaches have demonstrated robust locomotion, but the exhibited behaviors lack diversity and agility. They employ approximate models, which lead…

Robotics · Computer Science 2024-02-22 Chong Zhang , Jiapeng Sheng , Tingguang Li , He Zhang , Cheng Zhou , Qingxu Zhu , Rui Zhao , Yizheng Zhang , Lei Han

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

Machine Learning · Computer Science 2023-12-20 Lisheng Wu , Ke Chen

Deformable continuum robots (DCRs) present unique planning challenges due to nonlinear deformation mechanics and partial state observability, violating the Markov assumptions of conventional reinforcement learning (RL) methods. While…

Robotics · Computer Science 2025-09-03 Yu Tian , Chi Kit Ng , Hongliang Ren

Efficient navigation in dynamic environments is crucial for autonomous robots interacting with moving agents and static obstacles. We present a novel deep reinforcement learning approach that improves robot navigation and interaction with…

Robotics · Computer Science 2025-09-30 Yury Kolomeytsev , Dmitry Golembiovsky

Humanoid soccer dribbling is a highly challenging task that demands dexterous ball manipulation while maintaining dynamic balance. Traditional rule-based methods often struggle to achieve accurate ball control due to their reliance on fixed…

Robotics · Computer Science 2026-03-17 Zhuoheng Wang , Jinyin Zhou , Qi Wu

Humanoid robots, with their human-like morphology, hold great potential for industrial applications. However, existing loco-manipulation methods primarily focus on dexterous manipulation, falling short of the combined requirements for…

Robotics · Computer Science 2025-11-27 Kaiyan Xiao , Zihan Xu , Cheng Zhe , Chengju Liu , Qijun Chen

We consider real-world reinforcement learning (RL) of robotic manipulation tasks that involve both visuomotor skills and contact-rich skills. We aim to train a policy that maps multimodal sensory observations (vision and force) to a…

Robotics · Computer Science 2022-03-01 Jun Jin , Daniel Graves , Cameron Haigh , Jun Luo , Martin Jagersand

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Eivind Bøhn , Erlend M. Coates , Dirk Reinhardt , Tor Arne Johansen

Dynamic quadruped locomotion over challenging terrains with precise foot placements is a hard problem for both optimal control methods and Reinforcement Learning (RL). Non-linear solvers can produce coordinated constraint satisfying…

Robotics · Computer Science 2021-11-02 Philemon Brakel , Steven Bohez , Leonard Hasenclever , Nicolas Heess , Konstantinos Bousmalis

Bipedal humanoid robots must precisely coordinate balance, timing, and contact decisions when locomoting on constrained footholds such as stepping stones, beams, and planks -- even minor errors can lead to catastrophic failure. Classical…

Robotics · Computer Science 2026-01-13 Min Dai , William D. Compton , Junheng Li , Lizhi Yang , Aaron D. Ames

Imitation learning is a popular approach for training visual navigation policies. However, collecting expert demonstrations for legged robots is challenging as these robots can be hard to control, move slowly, and cannot operate…

Artificial Intelligence · Computer Science 2020-03-05 Xinlei Pan , Tingnan Zhang , Brian Ichter , Aleksandra Faust , Jie Tan , Sehoon Ha

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

Goal-Conditioned Reinforcement Learning (GCRL) provides a versatile framework for developing unified controllers capable of handling wide ranges of tasks, exploring environments, and adapting behaviors. However, its reliance on…

Machine Learning · Computer Science 2025-02-20 Charly Pecqueux-Guézénec , Stéphane Doncieux , Nicolas Perrin-Gilbert

This paper presents a novel method for learning reward functions for robotic motions by harnessing the power of a CLIP-based model. Traditional reward function design often hinges on manual feature engineering, which can struggle to…

Robotics · Computer Science 2025-01-30 Xuzhe Dang , Stefan Edelkamp

Safe and real-time navigation is fundamental for humanoid robot applications. However, existing bipedal robot navigation frameworks often struggle to balance computational efficiency with the precision required for stable locomotion. We…

Robotics · Computer Science 2025-06-04 Chengyang Peng , Zhihao Zhang , Shiting Gong , Sankalp Agrawal , Keith A. Redmill , Ayonga Hereid

Legged robots have the potential to become vital in maintenance, home support, and exploration scenarios. In order to interact with and manipulate their environments, most legged robots are equipped with a dedicated robot arm, which means…

Robotics · Computer Science 2024-02-19 Philip Arm , Mayank Mittal , Hendrik Kolvenbach , Marco Hutter

This paper proposes the Phy-DRL: a physics-regulated deep reinforcement learning (DRL) framework for safety-critical autonomous systems. The Phy-DRL has three distinguished invariant-embedding designs: i) residual action policy (i.e.,…

Artificial Intelligence · Computer Science 2024-07-09 Hongpeng Cao , Yanbing Mao , Lui Sha , Marco Caccamo