English
Related papers

Related papers: Constrained Reinforcement Learning for Dexterous M…

200 papers

Legged robots are physically capable of traversing a wide range of challenging environments, but designing controllers that are sufficiently robust to handle this diversity has been a long-standing challenge in robotics. Reinforcement…

Robotics · Computer Science 2021-10-12 Laura Smith , J. Chase Kew , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for…

Robotics · Computer Science 2024-03-29 Zifan Wang , Yufei Jia , Lu Shi , Haoyu Wang , Haizhou Zhao , Xueyang Li , Jinni Zhou , Jun Ma , Guyue Zhou

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

While deep reinforcement learning techniques have recently produced considerable achievements on many decision-making problems, their use in robotics has largely been limited to simulated worlds or restricted motions, since unconstrained…

Robotics · Computer Science 2018-02-26 Tu-Hoa Pham , Giovanni De Magistris , Ryuki Tachibana

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

As one of the core parts of flexible manufacturing systems, material handling involves storage and transportation of materials between workstations with automated vehicles. The improvement in material handling can impulse the overall…

Machine Learning · Computer Science 2023-05-24 Chengpeng Hu , Ziming Wang , Jialin Liu , Junyi Wen , Bifei Mao , Xin Yao

Dexterous multi-fingered hands are extremely versatile and provide a generic way to perform a multitude of tasks in human-centric environments. However, effectively controlling them remains challenging due to their high dimensionality and…

Machine Learning · Computer Science 2018-06-27 Aravind Rajeswaran , Vikash Kumar , Abhishek Gupta , Giulia Vezzani , John Schulman , Emanuel Todorov , Sergey Levine

This paper focuses on the scalable robot learning for manipulation in the dexterous robot arm-hand systems, where the remote human-robot interactions via augmented reality (AR) are established to collect the expert demonstration data for…

Machine Learning · Computer Science 2026-02-10 Yicheng Yang , Ruijiao Li , Lifeng Wang , Shuai Zheng , Shunzheng Ma , Keyu Zhang , Tuoyu Sun , Chenyun Dai , Jie Ding , Zhuo Zou

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Adding constraint support in Machine Learning has the potential to address outstanding issues in data-driven AI systems, such as safety and fairness. Existing approaches typically apply constrained optimization techniques to ML training,…

Machine Learning · Computer Science 2021-03-01 Fabrizio Detassis , Michele Lombardi , Michela Milano

Reinforcement Learning (RL) training is predominantly conducted in cost-effective and controlled simulation environments. However, the transfer of these trained models to real-world tasks often presents unavoidable challenges. This research…

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

Robotics · Computer Science 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

As surgical interventions trend towards minimally invasive approaches, Concentric Tube Robots (CTRs) have been explored for various interventions such as brain, eye, fetoscopic, lung, cardiac and prostate surgeries. Arranged concentrically,…

Robotics · Computer Science 2023-09-06 Keshav Iyengar , Sarah Spurgeon , Danail Stoyanov

Parkour poses a significant challenge for legged robots, requiring navigation through complex environments with agility and precision based on limited sensory inputs. In this work, we introduce a novel method for training end-to-end visual…

Robotics · Computer Science 2024-09-23 Elliot Chane-Sane , Joseph Amigo , Thomas Flayols , Ludovic Righetti , Nicolas Mansard

Motion planning is an essential component in most of today's robotic applications. In this work, we consider the learning setting, where a set of solved motion planning problems is used to improve the efficiency of motion planning on…

Robotics · Computer Science 2019-06-04 Tom Jurgenson , Aviv Tamar

Dexterous multi-fingered robotic hands can perform a wide range of manipulation skills, making them an appealing component for general-purpose robotic manipulators. However, such hands pose a major challenge for autonomous control, due to…

Artificial Intelligence · Computer Science 2018-10-16 Henry Zhu , Abhishek Gupta , Aravind Rajeswaran , Sergey Levine , Vikash Kumar

Several earlier studies have shown impressive control performance in complex robotic systems by designing the controller using a neural network and training it with model-free reinforcement learning. However, these outstanding controllers…

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

Machine Learning · Computer Science 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe

Manipulating objects to achieve desired goal states is a basic but important skill for dexterous manipulation. Human hand motions demonstrate proficient manipulation capability, providing valuable data for training robots with multi-finger…

Robotics · Computer Science 2024-11-07 Yuanpei Chen , Chen Wang , Yaodong Yang , C. Karen Liu