English
Related papers

Related papers: Visual Spatial Attention and Proprioceptive Data-D…

200 papers

Reinforcement Learning (RL) has shown great promise for efficiently learning force control policies in peg-in-hole tasks. However, robots often face difficulties due to visual occlusions by the gripper and uncertainties in the initial…

Robotics · Computer Science 2023-09-28 Tatsuya Kamijo , Ixchel G. Ramirez-Alpizar , Enrique Coronado , Gentiane Venture

Imitation learning is promising for robotic manipulation, but \emph{precise insertion} in the real world remains difficult due to contact-rich dynamics, tight clearances, and limited demonstrations. Many existing visuomotor policies depend…

Robotics · Computer Science 2026-03-25 Han Sun , Sheng Liu , Yizhao Wang , Zhenning Zhou , Shuai Wang , Haibo Yang , Jingyuan Sun , Qixin Cao

Complicated assembly processes can be described as a sequence of two main activities: grasping and insertion. While general grasping solutions are common in industry, insertion is still only applicable to small subsets of problems, mainly…

Robotics · Computer Science 2021-04-30 Oren Spector , Dotan Di Castro

Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but current RL methods require a large number of trials to accomplish this. In this paper, we tackle rapid adaptation to new tasks through the…

Since current Vision-Language-Action (VLA) systems suffer from limited spatial perception and the absence of memory throughout manipulation, we investigate visual anchors as a means to enhance spatial and temporal reasoning within VLA…

Robotics · Computer Science 2026-03-16 Juan Zhu , Zhanying Shao , Xiaoqi Li , Ethan Morgan , Jiadong Xu , Hongwei Fan , Hao Dong

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

Robotics · Computer Science 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar

Data efficiency in robotic skill acquisition is crucial for operating robots in varied small-batch assembly settings. To operate in such environments, robots must have robust obstacle avoidance and versatile goal conditioning acquired from…

Robotics · Computer Science 2023-03-07 Jun Yamada , Jack Collins , Ingmar Posner

Recent work has shown that dopamine-modulated STDP can solve many of the issues associated with reinforcement learning, such as the distal reward problem. Spiking neural networks provide a useful technique in implementing reinforcement…

Neural and Evolutionary Computing · Computer Science 2015-02-24 Richard Evans

Learning a good representation is an essential component for deep reinforcement learning (RL). Representation learning is especially important in multitask and partially observable settings where building a representation of the unknown…

Most 3d human pose estimation methods assume that input -- be it images of a scene collected from one or several viewpoints, or from a video -- is given. Consequently, they focus on estimates leveraging prior knowledge and measurement by…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Erik Gärtner , Aleksis Pirinen , Cristian Sminchisescu

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

Robotics · Computer Science 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

We present a reinforcement learning framework for quadrupedal wall-climbing locomotion that explicitly addresses uncertainty in magnetic foot adhesion. A physics-based adhesion model of a quadrupedal magnetic climbing robot is incorporated…

Robotics · Computer Science 2025-10-24 Yong Um , Young-Ha Shin , Joon-Ha Kim , Soonpyo Kwon , Hae-Won Park

Grasping small objects surrounded by unstable or non-rigid material plays a crucial role in applications such as surgery, harvesting, construction, disaster recovery, and assisted feeding. This task is especially difficult when fine…

Robotics · Computer Science 2023-06-29 Yunchu Zhang , Liyiming Ke , Abhay Deshpande , Abhishek Gupta , Siddhartha Srinivasa

Training robots to navigate diverse environments is a challenging problem as it involves the confluence of several different perception tasks such as mapping and localization, followed by optimal path-planning and control. Recently released…

Robotics · Computer Science 2021-01-07 Kaushik Balakrishnan , Punarjay Chakravarty , Shubham Shrivastava

Inverted landing in a rapid and robust manner is a challenging feat for aerial robots, especially while depending entirely on onboard sensing and computation. In spite of this, this feat is routinely performed by biological fliers such as…

Robotics · Computer Science 2023-04-26 Bryan Habas , Jack W. Langelaan , Bo Cheng

Reinforcement learning systems have the potential to enable continuous improvement in unstructured environments, leveraging data collected autonomously. However, in practice these systems require significant amounts of instrumentation or…

Robotics · Computer Science 2022-03-30 Abhishek Gupta , Corey Lynch , Brandon Kinman , Garrett Peake , Sergey Levine , Karol Hausman

Learning robot skills from scratch is often time-consuming, while reusing data promotes sustainability and improves sample efficiency. This study investigates policy transfer across different robotic platforms, focusing on peg-in-hole task…

Robotics · Computer Science 2026-04-09 Khalil Abuibaid , Vinit Hegiste , Nigora Gafur , Achim Wagner , Martin Ruskowski

Despite the growing interest in robot control utilizing the computation of biological neurons, context-dependent behavior by neuron-connected robots remains a challenge. Context-dependent behavior here is defined as behavior that is not the…

Quadratic programming is a workhorse of modern nonlinear optimization, control, and data science. Although regularized methods offer convergence guarantees under minimal assumptions on the problem data, they can exhibit the slow…

Optimization and Control · Mathematics 2026-05-18 Jeremy Bertoncini , Alberto De Marchi , Matthias Gerdts , Simon Gottschalk