English
Related papers

Related papers: Assembly robots with optimized control stiffness t…

200 papers

Robotic peg-in-hole assembly represents a critical area of investigation in robotic automation. The fusion of reinforcement learning (RL) and deep neural networks (DNNs) has yielded remarkable breakthroughs in this field. However, existing…

Robotics · Computer Science 2023-07-12 Ruochen Yin , Huapeng Wu , Ming Li , Yong Cheng , Yuntao Song , Heikki Handroos

Closed-loop control remains an open challenge in soft robotics. The nonlinear responses of soft actuators under dynamic loading conditions limit the use of analytic models for soft robot control. Traditional methods of controlling soft…

Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. However, it is non-trivial to manually design a robot controller that combines modalities with very different characteristics. While…

We consider real-world reinforcement learning (RL) of robotic manipulation tasks that involve both visuomotor skills and contact-rich skills. We aim to train a policy that maps multimodal sensory observations (vision and force) to a…

Robotics · Computer Science 2022-03-01 Jun Jin , Daniel Graves , Cameron Haigh , Jun Luo , Martin Jagersand

Contact-rich manipulation involves kinematic constraints on the task motion, typically with discrete transitions between these constraints during the task. Allowing the robot to detect and reason about these contact constraints can support…

Robotics · Computer Science 2023-04-05 Christian Hegeler , Filippo Rozzi , Loris Roveda , Kevin Haninger

Autonomous driving has garnered significant attention in recent years, especially in optimizing vehicle performance under varying conditions. This paper addresses the challenge of maintaining maximum speed stability in low-speed autonomous…

Artificial Intelligence · Computer Science 2024-12-30 Benny Bao-Sheng Li , Elena Wu , Hins Shao-Xuan Yang , Nicky Yao-Jin Liang

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

Machine Learning · Computer Science 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Reinforcement Learning (RL) has become a critical tool for optimization challenges within automation, leading to significant advancements in several areas. This review article examines the current landscape of RL within automation, with a…

Machine Learning · Computer Science 2025-03-05 Ahmad Farooq , Kamran Iqbal

Optimizing accelerator control is a critical challenge in experimental particle physics, requiring significant manual effort and resource expenditure. Traditional tuning methods are often time-consuming and reliant on expert input,…

Accelerator Physics · Physics 2026-01-27 Anwar Ibrahim , Denis Derkach , Alexey Petrenko , Fedor Ratnikov , Maxim Kaledin

Controlling contact forces during interactions is critical for locomotion and manipulation tasks. While sim-to-real reinforcement learning (RL) has succeeded in many contact-rich problems, current RL methods achieve forceful interactions…

Robotics · Computer Science 2024-05-21 Tifanny Portela , Gabriel B. Margolis , Yandong Ji , Pulkit Agrawal

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general control solution that…

Robotics · Computer Science 2024-08-27 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of…

Robotics · Computer Science 2020-10-27 Yunlei Shi , Zhaopeng Chen , Hongxu Liu , Sebastian Riedel , Chunhui Gao , Qian Feng , Jun Deng , Jianwei Zhang

Recent advances in both machine learning and Internet-of-Things have attracted attention to automatic Activity Recognition, where users wear a device with sensors and their outputs are mapped to a predefined set of activities. However, few…

Machine Learning · Computer Science 2019-08-20 Taku Yamagata , Raúl Santos-Rodríguez , Ryan McConville , Atis Elsts

Industrial robots are widely used in diverse manufacturing environments. Nonetheless, how to enable robots to automatically plan trajectories for changing tasks presents a considerable challenge. Further complexities arise when robots…

Robotics · Computer Science 2025-02-27 Siddharth Singh , Tian Yu , Qing Chang , John Karigiannis , Shaopeng Liu

The integration of Reinforcement Learning (RL) with heuristic methods is an emerging trend for solving optimization problems, which leverages RL's ability to learn from the data generated during the search process. One promising approach is…

Machine Learning · Computer Science 2024-09-19 Arthur Müller , Lukas Vollenkemper

The problem of multi-robot navigation of connectivity maintenance is challenging in multi-robot applications. This work investigates how to navigate a multi-robot team in unknown environments while maintaining connectivity. We propose a…

Robotics · Computer Science 2021-09-20 Minghao Li , Yingrui Jie , Yang Kong , Hui Cheng

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Autonomous race driving poses a complex control challenge as vehicles must be operated at the edge of their handling limits to reduce lap times while respecting physical and safety constraints. This paper presents a novel reinforcement…

Robotics · Computer Science 2024-06-24 Yuanda Wang , Xin Yuan , Changyin Sun