English
Related papers

Related papers: Sim-to-Real Surgical Robot Learning and Autonomous…

200 papers

We present a method for enabling Reinforcement Learning of motor control policies for complex skills such as dexterous manipulation. We posit that a key difficulty for training such policies is the difficulty of exploring the problem state…

Reinforcement Learning (RL) training is predominantly conducted in cost-effective and controlled simulation environments. However, the transfer of these trained models to real-world tasks often presents unavoidable challenges. This research…

This paper presents a deep learning framework designed to enhance the grasping capabilities of quadrupeds equipped with arms, with a focus on improving precision and adaptability. Our approach centers on a sim-to-real methodology that…

Robot learning has proven to be a general and effective technique for programming manipulators. Imitation learning is able to teach robots solely from human demonstrations but is bottlenecked by the capabilities of the demonstrations.…

Robotics · Computer Science 2024-10-24 Zihan Zhou , Animesh Garg , Dieter Fox , Caelan Garrett , Ajay Mandlekar

Robot arms should be able to learn new tasks. One framework here is reinforcement learning, where the robot is given a reward function that encodes the task, and the robot autonomously learns actions to maximize its reward. Existing…

Robotics · Computer Science 2024-03-21 Shaunak A. Mehta , Soheil Habibian , Dylan P. Losey

This paper addresses the challenge of occluded robot grasping, i.e. grasping in situations where the desired grasp poses are kinematically infeasible due to environmental constraints such as surface collisions. Traditional robot…

Robotics · Computer Science 2025-02-17 Jun Yamada , Alexander L. Mitchell , Jack Collins , Ingmar Posner

We propose a novel formulation of robotic pick and place as a deep reinforcement learning (RL) problem. Whereas most deep RL approaches to robotic manipulation frame the problem in terms of low level states and actions, we propose a more…

Robotics · Computer Science 2018-02-26 Marcus Gualtieri , Andreas ten Pas , Robert Platt

Precise robotic manipulation skills are desirable in many industrial settings, reinforcement learning (RL) methods hold the promise of acquiring these skills autonomously. In this paper, we explicitly consider incorporating operational…

For the shape control of deformable free-form surfaces, simulation plays a crucial role in establishing the mapping between the actuation parameters and the deformed shapes. The differentiation of this forward kinematic mapping is usually…

Robotics · Computer Science 2024-05-16 Yingjun Tian , Guoxin Fang , Renbo Su , Weiming Wang , Simeon Gill , Andrew Weightman , Charlie C. L. Wang

Reinforcement learning encounters many challenges when applied directly in the real world. Sim-to-real transfer is widely used to transfer the knowledge learned from simulation to the real world. Domain randomization -- one of the most…

Machine Learning · Computer Science 2022-03-15 Xiaoyu Chen , Jiachen Hu , Chi Jin , Lihong Li , Liwei Wang

Many objects, such as tools and household items, can be used only if grasped in a very specific way - grasped functionally. Often, a direct functional grasp is not possible, though. We propose a method for learning a dexterous pre-grasp…

Robotics · Computer Science 2025-02-27 Dmytro Pavlichenko , Sven Behnke

Dexterous manipulation has seen remarkable progress in recent years, with policies capable of executing many complex and contact-rich tasks in simulation. However, transferring these policies from simulation to real world remains a…

Robotics · Computer Science 2025-05-05 Shuqi Zhao , Ke Yang , Yuxin Chen , Chenran Li , Yichen Xie , Xiang Zhang , Changhao Wang , Masayoshi Tomizuka

We introduce a sample-efficient method for learning state-dependent stiffness control policies for dexterous manipulation. The ability to control stiffness facilitates safe and reliable manipulation by providing compliance and robustness to…

Robotics · Computer Science 2021-09-16 Mincheol Kim , Scott Niekum , Ashish D. Deshpande

This paper presents a hierarchical framework for Deep Reinforcement Learning that acquires motor skills for a variety of push recovery and balancing behaviors, i.e., ankle, hip, foot tilting, and stepping strategies. The policy is trained…

Robotics · Computer Science 2020-02-11 Chuanyu Yang , Kai Yuan , Wolfgang Merkt , Taku Komura , Sethu Vijayakumar , Zhibin Li

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

Deep imitation learning is promising for robot manipulation because it only requires demonstration samples. In this study, deep imitation learning is applied to tasks that require force feedback. However, existing demonstration methods have…

Robotics · Computer Science 2024-02-27 Heecheol Kim , Yoshiyuki Ohmura , Akihiko Nagakubo , Yasuo Kuniyoshi

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

This paper presents a sensor-level mapless collision avoidance algorithm for use in mobile robots that map raw sensor data to linear and angular velocities and navigate in an unknown environment without a map. An efficient training strategy…

Artificial Intelligence · Computer Science 2021-02-24 Hanlin Niu , Ze Ji , Farshad Arvin , Barry Lennox , Hujun Yin , Joaquin Carrasco

Achieving generalizable and precise robotic manipulation across diverse environments remains a critical challenge, largely due to limitations in spatial perception. While prior imitation-learning approaches have made progress, their…

Robotics · Computer Science 2025-05-28 Yiqi Huang , Travis Davies , Jiahuan Yan , Jiankai Sun , Xiang Chen , Luhui Hu

Object rearranging is one of the most common deformable manipulation tasks, where the robot needs to rearrange a deformable object into a goal configuration. Previous studies focus on designing an expert system for each specific task by…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Chongkun Xia , Xueqian Wang , Lipeng Chen