English
Related papers

Related papers: Introspective Perception: Learning to Predict Fail…

200 papers

Learned communication makes multi-agent systems more effective by aggregating distributed information. However, it also exposes individual agents to the threat of erroneous messages they might receive. In this paper, we study the setting…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Nicholas Vadivelu , Mengye Ren , James Tu , Jingkang Wang , Raquel Urtasun

We consider exploration tasks in which an autonomous mobile robot incrementally builds maps of initially unknown indoor environments. In such tasks, the robot makes a sequence of decisions on where to move next that, usually, are based on…

Robotics · Computer Science 2021-04-23 Matteo Luperto , Luca Fochetta , Francesco Amigoni

To solve its task, a robot needs to have the ability to interpret its perceptions. In vision, this interpretation is particularly difficult and relies on the understanding of the structure of the scene, at least to the extent of its task…

Robotics · Computer Science 2019-01-31 Léni K. Le Goff , Ghanim Mukhtar , Alexandre Coninx , Stéphane Doncieux

Autonomous robots operating in large knowledgeintensive domains require planning in the discrete (task) space and the continuous (motion) space. In knowledge-intensive domains, on the one hand, robots have to reason at the highestlevel, for…

Robotics · Computer Science 2020-10-05 Antony Thomas , Fulvio Mastrogiovanni , Marco Baglietto

In robotics, one of the main challenges is that the on-board Artificial Intelligence (AI) must deal with different or unexpected environments. Such AI agents may be incompetent there, while the underlying model itself may not be aware of…

Robotics · Computer Science 2020-05-05 Gertjan J. Burghouts , Albert Huizing , Mark A. Neerincx

Many of today's robot perception systems aim at accomplishing perception tasks that are too simplistic and too hard. They are too simplistic because they do not require the perception systems to provide all the information needed to…

Robotics · Computer Science 2021-07-07 Patrick Mania , Franklin Kenghagho Kenfack , Michael Neumann , Michael Beetz

Trajectory planning in robotics aims to generate collision-free pose sequences that can be reliably executed. Recently, vision-to-planning systems have gained increasing attention for their efficiency and ability to interpret and adapt to…

Robotics · Computer Science 2025-11-04 Qihang Li , Zhuoqun Chen , Haoze Zheng , Haonan He , Zitong Zhan , Shaoshu Su , Junyi Geng , Chen Wang

Ideally, robots should move in ways that maximize the knowledge gained about the state of both their internal system and the external operating environment. Trajectory design is a challenging problem that has been investigated from a…

Robotics · Computer Science 2022-01-07 Christopher Grebe , Emmett Wise , Jonathan Kelly

Designing robotic tasks for co-manipulation necessitates to exploit not only proprioceptive but also exteroceptive information for improved safety and autonomy. Following such instinct, this research proposes to formulate intuitive robotic…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Sunny Katyara , Fanny Ficuciello , Tao Teng , Fei Chen , Bruno Siciliano , Darwin G. Caldwell

Learning from demonstration is a promising approach for teaching robots new skills. However, a central challenge in the execution of acquired skills is the ability to recognize faults and prevent failures. This is essential because…

Motion prediction for intelligent vehicles typically focuses on estimating the most probable future evolutions of a traffic scenario. Estimating the gap acceptance, i.e., whether a vehicle merges or crosses before another vehicle with the…

Robotics · Computer Science 2024-09-18 Max Bastian Mertens , Jona Ruof , Jan Strohbeck , Michael Buchholz

Uncertainty in control and perception poses challenges for autonomous vehicle navigation in unstructured environments, leading to navigation failures and potential vehicle damage. This paper introduces a framework that minimizes control and…

Robotics · Computer Science 2023-06-27 Junwon Seo , Jungwi Mun , Taekyung Kim

The ability to accurately predict the surrounding environment is a foundational principle of intelligence in biological and artificial agents. In recent years, a variety of approaches have been proposed for learning to predict the physical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Alberto Cenzato , Alberto Testolin , Marco Zorzi

This article presents a novel framework for performing visual inspection around 3D infrastructures, by establishing a team of fully autonomous Micro Aerial Vehicles (MAVs) with robust localization, planning and perception capabilities. The…

Bird's-eye-view (BEV) perception has emerged as a cornerstone of autonomous driving systems, providing a structured, ego-centric representation critical for downstream planning and control. However, real-world deployment faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Lifeng Zhuo , Kefan Jin , Zhe Liu , Hesheng Wang

The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Sarah Pratt , Luca Weihs , Ali Farhadi

While machine learning systems show high success rate in many complex tasks, research shows they can also fail in very unexpected situations. Rise of machine learning products in safety-critical industries cause an increase in attention in…

Machine Learning · Computer Science 2019-05-21 Sina Mohseni , Akshay Jagadeesh , Zhangyang Wang

Industrial facilities often require periodic visual inspections of key installations. Examining these points of interest is time consuming, potentially hazardous or require special equipment to reach. MAVs are ideal platforms to automate…

Robotics · Computer Science 2018-03-28 Marius Fehr , Thomas Schneider , Marcin Dymczyk , Jürgen Sturm , Roland Siegwart

In this work, we present an approach to supervisory reinforcement learning control for unmanned aerial vehicles (UAVs). UAVs are dynamic systems where control decisions in response to disturbances in the environment have to be made in the…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined…

Robotics · Computer Science 2020-11-30 Danilo Perico , Paulo E. Santos , Reinaldo Bianchi