English
Related papers

Related papers: Taking Recoveries to Task: Recovery-Driven Develop…

200 papers

Developing machine intelligence abilities in robots and autonomous systems is an expensive and time consuming process. Existing solutions are tailored to specific applications and are harder to generalize. Furthermore, scarcity of training…

Robotics · Computer Science 2023-10-10 Sai Vemprala , Shuhang Chen , Abhinav Shukla , Dinesh Narayanan , Ashish Kapoor

Task robust adaptation is a long-standing pursuit in sequential decision-making. Some risk-averse strategies, e.g., the conditional value-at-risk principle, are incorporated in domain randomization or meta reinforcement learning to…

Machine Learning · Computer Science 2025-05-16 Yun Qu , Qi Cheems Wang , Yixiu Mao , Yiqin Lv , Xiangyang Ji

We introduce the term Super-Reactive Systems to refer to reactive systems whose construction and behavior are complex, constantly changing and evolving, and heavily interwoven with other systems and the physical world. Finding hidden faults…

Software Engineering · Computer Science 2025-06-17 David Harel , Assaf Marron

We describe a framework for changing-contact robot manipulation tasks that require the robot to make and break contacts with objects and surfaces. The discontinuous interaction dynamics of such tasks make it difficult to construct and use a…

Robotics · Computer Science 2021-11-16 Saif Sidhik , Mohan Sridharan , Dirk Ruiken

Task automation of surgical robot has the potentials to improve surgical efficiency. Recent reinforcement learning (RL) based approaches provide scalable solutions to surgical automation, but typically require extensive data collection to…

Robotics · Computer Science 2023-02-21 Tao Huang , Kai Chen , Bin Li , Yun-Hui Liu , Qi Dou

As robots gain capabilities to enter our human-centric world, they require formalism and algorithms that enable smart and efficient interactions. This is challenging, especially for robotic manipulators with complex tasks that may require…

Robotics · Computer Science 2022-03-15 Karan Muvvala , Peter Amorese , Morteza Lahijanian

In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its…

Robotics · Computer Science 2024-03-19 Yuhong Cao , Rui Zhao , Yizhuo Wang , Bairan Xiang , Guillaume Sartoretti

Model-based planners and controllers are commonly used to solve complex manipulation problems as they can efficiently optimize diverse objectives and generalize to long horizon tasks. However, they often fail during deployment due to noisy…

Robotics · Computer Science 2025-03-10 Shivam Vats , Devesh K. Jha , Maxim Likhachev , Oliver Kroemer , Diego Romeres

Learning from Demonstrations (LfD) and Reinforcement Learning (RL) have enabled robot agents to accomplish complex tasks. Reward Machines (RMs) enhance RL's capability to train policies over extended time horizons by structuring high-level…

Robotics · Computer Science 2024-12-16 Mattijs Baert , Sam Leroux , Pieter Simoens

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Many modern robotic systems such as multi-robot systems and manipulators exhibit redundancy, a property owing to which they are capable of executing multiple tasks. This work proposes a novel method, based on the Reinforcement Learning (RL)…

Robotics · Computer Science 2025-04-03 Sheikh A. Tahmid , Gennaro Notomista

Robotic research over the last decades have lead us to different architectures to automatically synthesise discrete event controllers and implement these motion and task plans in real-world robot scenarios. However, these architectures…

Robotics · Computer Science 2020-04-24 Tomás Liendro , Sebastián Zudaire

This paper presents an application of specification based runtime verification techniques to control mobile robots in a reactive manner. In our case study, we develop a layered control architecture where runtime monitors constructed from…

Robotics · Computer Science 2019-02-12 Dogan Ulus , Calin Belta

Imitation Learning from monocular video demonstrations provides a scalable approach for teaching complex skills to humanoid robots. However, translating human motion to humanoids requires overcoming significant morphological mismatches.…

In this work, motivated by recent manufacturing trends, we investigate autonomous robotic assembly. Industrial assembly tasks require contact-rich manipulation skills, which are challenging to acquire using classical control and motion…

Robotics · Computer Science 2018-07-26 Garrett Thomas , Melissa Chien , Aviv Tamar , Juan Aparicio Ojea , Pieter Abbeel

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

We propose RAPid-Learn: Learning to Recover and Plan Again, a hybrid planning and learning method, to tackle the problem of adapting to sudden and unexpected changes in an agent's environment (i.e., novelties). RAPid-Learn is designed to…

Artificial Intelligence · Computer Science 2022-06-28 Shivam Goel , Yash Shukla , Vasanth Sarathy , Matthias Scheutz , Jivko Sinapov

Reinforcement learning systems have the potential to enable continuous improvement in unstructured environments, leveraging data collected autonomously. However, in practice these systems require significant amounts of instrumentation or…

Robotics · Computer Science 2022-03-30 Abhishek Gupta , Corey Lynch , Brandon Kinman , Garrett Peake , Sergey Levine , Karol Hausman

Rewards play a crucial role in reinforcement learning. To arrive at the desired policy, the design of a suitable reward function often requires significant domain expertise as well as trial-and-error. Here, we aim to minimize the effort…

Robotics · Computer Science 2020-11-18 Zheng Wu , Wenzhao Lian , Vaibhav Unhelkar , Masayoshi Tomizuka , Stefan Schaal

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…