English
Related papers

Related papers: Multimodal Behaviour Trees for Robotic Laboratory …

200 papers

Automated laboratory experiments have the potential to propel new discoveries, while increasing reproducibility and improving scientists' safety when handling dangerous materials. However, many automated laboratory workflows have not fully…

Robotics · Computer Science 2025-06-26 Hatem Fakhruldeen , Gabriella Pizzuto , Jakub Glowacki , Andrew Ian Cooper

Construction robots operate in unstructured construction sites, where effective visual perception is crucial for ensuring safe and seamless operations. However, construction robots often handle large elements and perform tasks across…

Robotics · Computer Science 2024-12-17 Jia Xu , Manish Dixit , Xi Wang

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

Robots have become increasingly prevalent in dynamic and crowded environments such as airports and shopping malls. In these scenarios, the critical challenges for robot navigation are reliability and timely arrival at predetermined…

Robotics · Computer Science 2023-09-21 Zhirui Sun , Boshu Lei , Peijia Xie , Fugang Liu , Junjie Gao , Ying Zhang , Jiankun Wang

We study a human-robot collaborative transportation task in presence of obstacles. The task for each agent is to carry a rigid object to a common target position, while safely avoiding obstacles and satisfying the compliance and actuation…

Robotics · Computer Science 2022-07-14 Tony Zheng , Monimoy Bujarbaruah , Yvonne R. Stürz , Francesco Borrelli

Identifying and categorizing specific robot tasks, behaviors, and resources is an essential precursor to reproducing and evaluating robotics experiments across laboratories and platforms. Without some means of capturing how one environment,…

Robotics · Computer Science 2021-01-08 Signe A. Redfield

Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. However, it is non-trivial to manually design a robot controller that combines modalities with very different characteristics. While…

Vision Language Models (VLMs) play a crucial role in robotic manipulation by enabling robots to understand and interpret the visual properties of objects and their surroundings, allowing them to perform manipulation based on this multimodal…

Robotics · Computer Science 2025-05-21 Nurhan Bulus Guran , Hanchi Ren , Jingjing Deng , Xianghua Xie

This paper proposes a cooperative environmental learning algorithm working in a fully distributed manner. A multi-robot system is more effective for exploration tasks than a single robot, but it involves the following challenges: 1) online…

Robotics · Computer Science 2021-12-30 Dohyun Jang , Jaehyun Yoo , Clark Youngdong Son , H. Jin Kim

Task planning is an important component of traditional robotics systems enabling robots to compose fine grained skills to perform more complex tasks. Recent work building systems for translating natural language to executable actions for…

Robotics · Computer Science 2023-05-12 Mert İnan , Aishwarya Padmakumar , Spandana Gella , Patrick Lange , Dilek Hakkani-Tur

Exploration of unknown, unstructured environments, such as in search and rescue, cave exploration, and planetary missions,presents significant challenges due to their unpredictable nature. This unpredictability can lead to inefficient path…

Robotics · Computer Science 2024-10-08 Riana Gagnon Souleiman , Vivek Shankar Varadharajan , Giovanni Beltrame

In post-disaster scenarios, efficient search and rescue operations involve collaborative efforts between robots and humans. Existing planning approaches focus on specific aspects but overlook crucial elements like information gathering,…

Robotics · Computer Science 2023-09-25 Hamid Osooli , Paul Robinette , Kshitij Jerath , S. Reza Ahmadzadeh

Evolutionary Robotics allows robots with limited sensors and processing to tackle complex tasks by means of sensory-motor coordination. In this paper we show the first application of the Behaviour Tree framework to a real robotic platform…

Robotics · Computer Science 2015-08-10 Kirk Y. W. Scheper , Sjoerd Tijmons , Coen C. de Visser , Guido C. H. E. de Croon

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

Trustworthy robot behavior requires not only high levels of task success but also that the robot can reliably quantify how likely it is to succeed. To this end, we present a first-of-its-kind study of confidence calibration in…

Robotics · Computer Science 2025-12-23 Thomas P Zollo , Richard Zemel

Multi-task problem solving has been shown to improve the accuracy of the individual tasks, which is an important feature for robots, as they have a limited resource. However, when the number of labels for each task is not equal, namely…

Robotics · Computer Science 2026-02-03 Ozgur Erkent

Human-robot interaction benefits greatly from multimodal sensor inputs as they enable increased robustness and generalization accuracy. Despite this observation, few HRI methods are capable of efficiently performing inference for multimodal…

Robotics · Computer Science 2019-08-15 Joseph Campbell , Simon Stepputtis , Heni Ben Amor

Industrial robots are important machines applied in numerous modern industries that execute repetitive tasks with high accuracy, replacing or supporting dangerous jobs. In this kind of system, with increased complexity in which cost is…

Robotics · Computer Science 2021-04-26 Marcela G. dos Santos , Fabio Petrillo

Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. It is non-trivial to manually design a robot controller that combines these modalities which have very different characteristics.…

Robotic chemists promise to both liberate human experts from repetitive tasks and accelerate scientific discovery, yet remain in their infancy. Chemical experiments involve long-horizon procedures over hazardous and deformable substances,…

Robotics · Computer Science 2025-09-11 Zongzheng Zhang , Chenghao Yue , Haobo Xu , Minwen Liao , Xianglin Qi , Huan-ang Gao , Ziwei Wang , Hao Zhao