English
Related papers

Related papers: Multi-critic Learning for Whole-body End-effector …

200 papers

Reinforcement Learning (RL) allows learning non-trivial robot control laws purely from data. However, many successful applications of RL have relied on ad-hoc regularizations, such as hand-crafted curricula, to regularize the learning…

Machine Learning · Computer Science 2023-09-26 Pascal Klink , Florian Wolf , Kai Ploeger , Jan Peters , Joni Pajarinen

In this paper, we address the issue of increasing the performance of reinforcement learning (RL) solutions for autonomous racing cars when navigating under conditions where practical vehicle modelling errors (commonly known as \emph{model…

Robotics · Computer Science 2024-08-06 Andrew Murdoch , Johannes Cornelius Schoeman , Hendrik Willem Jordaan

Existing reinforcement learning (RL) methods struggle with long-horizon robotic manipulation tasks, particularly those involving sparse rewards. While action chunking is a promising paradigm for robotic manipulation, using RL to directly…

Robotics · Computer Science 2026-03-02 Jiarui Yang , Bin Zhu , Jingjing Chen , Yu-Gang Jiang

Most existing Multi-Object Tracking (MOT) approaches follow the Tracking-by-Detection paradigm and the data association framework where objects are firstly detected and then associated. Although deep-learning based method can noticeably…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xingyu Wan , Jiakai Cao , Sanping Zhou , Jinjun Wang

Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for…

Robotics · Computer Science 2024-03-29 Zifan Wang , Yufei Jia , Lu Shi , Haoyu Wang , Haizhou Zhao , Xueyang Li , Jinni Zhou , Jun Ma , Guyue Zhou

Unsupervised reinforcement learning (RL) aims at pre-training agents that can solve a wide range of downstream tasks in complex environments. Despite recent advancements, existing approaches suffer from several limitations: they may require…

Control contraction metrics (CCMs) provide a framework to co-synthesize a controller and a corresponding contraction metric -- a positive-definite Riemannian metric under which a closed-loop system is guaranteed to be incrementally…

Machine Learning · Computer Science 2025-06-23 Minjae Cho , Hiroyasu Tsukamoto , Huy Trong Tran

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

This article introduces a novel sample-efficient curriculum learning (CL) approach for training an end-to-end reinforcement learning (RL) policy for robust stabilization of a Quadrotor. The learning objective is to simultaneously stabilize…

Reinforcement learning (RL) can refine Vision-Language-Action (VLA) policies beyond behavior cloning, but real-world RL remains expensive due to extensive rollouts, resets, supervision, and safety risks. Action-conditioned video world…

Robotics · Computer Science 2026-05-26 Xiaokang Liu , Zechen Bai , Hai Ci , Kevin Yuchen Ma , Mike Zheng Shou

Generalizing locomotion policies across diverse legged robots with varying morphologies is a key challenge due to differences in observation/action dimensions and system dynamics. In this work, we propose Multi-Loco, a novel unified…

Robotics · Computer Science 2025-06-16 Shunpeng Yang , Zhen Fu , Zhefeng Cao , Guo Junde , Patrick Wensing , Wei Zhang , Hua Chen

This paper presents a unified algorithm for motion and force control for a six degree-of-freedom spatial manipulator. The motion-force controller performs trajectory tracking, maneuvering the manipulator's end-effector through desired…

Robotics · Computer Science 2024-08-09 Sagar Ojha , Karl Leodler , Lou Barbieri , TseHuai Wu

Manipulating objects is a hallmark of human intelligence, and an important task in domains such as robotics. In principle, Reinforcement Learning (RL) offers a general approach to learn object manipulation. In practice, however, domains…

Robotics · Computer Science 2024-04-02 Dan Haramati , Tal Daniel , Aviv Tamar

Hybrid locomotion of wheeled-legged robots has recently attracted increasing attention due to their advantages of combining the agility of legged locomotion and the efficiency of wheeled motion. But along with expanded performance, the…

Robotics · Computer Science 2025-10-14 Jingyuan Sun , Hongyu Ji , Zihan Qu , Chaoran Wang , Mingyu Zhang

Jumping poses a significant challenge for quadruped robots, despite being crucial for many operational scenarios. While optimisation methods exist for controlling such motions, they are often time-consuming and demand extensive knowledge of…

Robotics · Computer Science 2026-05-19 Riccardo Bussola , Michele Focchi , Giulio Turrisi , Claudio Semini , Luigi Palopoli

In this paper, a continuous-time adaptive actor-critic reinforcement learning (RL) controller is developed for drift-free nonlinear systems. Practical examples of such systems are image-based visual servoing (IBVS) and wheeled mobile robots…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Ashwin P. Dani , Shubhendu Bhasin

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

We describe a framework for changing-contact robot manipulation tasks that require the robot to make and break contacts with objects and surfaces. The discontinuous interaction dynamics of such tasks make it difficult to construct and use a…

Robotics · Computer Science 2021-11-16 Saif Sidhik , Mohan Sridharan , Dirk Ruiken

Despite recent remarkable achievements in quadruped control, it remains challenging to ensure robust and compliant locomotion in the presence of unforeseen external disturbances. Existing methods prioritize locomotion robustness over…

Robotics · Computer Science 2025-07-04 Xiang Zhou , Xinyu Zhang , Qingrui Zhang

Achieving highly dynamic behaviors on humanoid robots, such as running, requires controllers that are both robust and precise, and hence difficult to design. Classical control methods offer valuable insight into how such systems can…

Robotics · Computer Science 2025-09-25 Zachary Olkin , Kejun Li , William D. Compton , Aaron D. Ames