English
Related papers

Related papers: Uncertainty-Aware Perception-Based Control for Aut…

200 papers

Sensing and Perception (S&P) is a crucial component of an autonomous system (such as a robot), especially when deployed in highly dynamic environments where it is required to react to unexpected situations. This is particularly true in case…

Artificial Intelligence · Computer Science 2021-09-06 Andrea Piazzoni , Jim Cherian , Martin Slavik , Justin Dauwels

Multimodal foundation models offer promising advancements for enhancing driving perception systems, but their high computational and financial costs pose challenges. We develop a method that leverages foundation models to refine predictions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yunhao Yang , Yuxin Hu , Mao Ye , Zaiwei Zhang , Zhichao Lu , Yi Xu , Ufuk Topcu , Ben Snyder

The uncertainty quantification of sensor measurements coupled with deep learning networks is crucial for many robotics systems, especially for safety-critical applications such as self-driving cars. This paper develops an uncertainty…

Robotics · Computer Science 2025-06-23 Qiyuan Wu , Mark Campbell

Predicting the motion of a driver's vehicle is crucial for advanced driving systems, enabling detection of potential risks towards shared control between the driver and automation systems. In this paper, we propose a variational neural…

Robotics · Computer Science 2019-03-07 Xin Huang , Stephen McGill , Brian C. Williams , Luke Fletcher , Guy Rosman

Motivated by perception-based control problems in autonomous systems, this paper addresses the problem of developing feedback controllers to regulate the inputs and the states of a dynamical system to optimal solutions of an optimization…

Systems and Control · Electrical Eng. & Systems 2023-10-17 Liliaokeawawa Cothren , Gianluca Bianchin , Sarah Dean , Emiliano Dall'Anese

Model-based control is a popular paradigm for robot navigation because it can leverage a known dynamics model to efficiently plan robust robot trajectories. However, it is challenging to use model-based methods in settings where the…

Robotics · Computer Science 2019-07-19 Somil Bansal , Varun Tolani , Saurabh Gupta , Jitendra Malik , Claire Tomlin

Autonomous vehicles can enhance overall performance and implement safety measures in ways that are impossible with conventional automobiles. These functions are executed through vehicle control systems, which have been the subject of…

Systems and Control · Electrical Eng. & Systems 2022-10-13 Gautam Shetty , Sabir Hossain , Chuan Hu , Xianke Lin

The viability of automated driving is heavily dependent on the performance of perception systems to provide real-time accurate and reliable information for robust decision-making and maneuvers. These systems must perform reliably not only…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Apostol Vassilev , Munawar Hasan , Edward Griffor , Honglan Jin , Pavel Piliptchak , Mahima Arora , Thoshitha Gamage

A key component in autonomous driving is the ability of the self-driving car to understand, track and predict the dynamics of the surrounding environment. Although there is significant work in the area of object detection, tracking and…

Robotics · Computer Science 2021-07-20 Cosmin Ginerica , Mihai Zaha , Florin Gogianu , Lucian Busoniu , Bogdan Trasnea , Sorin Grigorescu

A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from…

Machine Learning · Computer Science 2018-11-19 Rhiannon Michelmore , Marta Kwiatkowska , Yarin Gal

In this paper, we propose a method for addressing the issue of unnoticed catastrophic deployment and domain shift in neural networks for semantic segmentation in autonomous driving. Our approach is based on the idea that deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Hendrik Vogt , Stefan Buehler , Mark Schutera

A significant barrier to deploying autonomous vehicles (AVs) on a massive scale is safety assurance. Several technical challenges arise due to the uncertain environment in which AVs operate such as road and weather conditions, errors in…

Artificial Intelligence · Computer Science 2019-10-08 Majid Khonji , Jorge Dias , Lakmal Seneviratne

Motion prediction is essential for safe and efficient autonomous driving. However, the inexplicability and uncertainty of complex artificial intelligence models may lead to unpredictable failures of the motion prediction module, which may…

Robotics · Computer Science 2023-05-26 Wenbo Shao , Yanchao Xu , Liang Peng , Jun Li , Hong Wang

This paper proposes a new control strategy to improve vehicle cornering performance in a model predictive control framework. The most distinguishing feature of the proposed method is that the natural handling characteristics of the…

Systems and Control · Computer Science 2019-11-18 Kyoungseok Han , Giseo Park , Gokul S. Sankar , Kanghyun Nam , Seibum B. Choi

Uncertainties in Deep Neural Network (DNN)-based perception and vehicle's motion pose challenges to the development of safe autonomous driving vehicles. In this paper, we propose a safe motion planning framework featuring the quantification…

Robotics · Computer Science 2021-08-12 Liuhui Ding , Dachuan Li , Bowen Liu , Wenxing Lan , Bing Bai , Qi Hao , Weipeng Cao , Ke Pei

Estimating the uncertainty of a neural network plays a fundamental role in safety-critical settings. In perception for autonomous driving, measuring the uncertainty means providing additional calibrated information to downstream tasks, such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Stefano Gasperini , Jan Haug , Mohammad-Ali Nikouei Mahani , Alvaro Marcos-Ramiro , Nassir Navab , Benjamin Busam , Federico Tombari

Motion planning at urban intersections that accounts for the situation context, handles occlusions, and deals with measurement and prediction uncertainty is a major challenge on the way to urban automated driving. In this work, we address…

Robotics · Computer Science 2021-10-22 Johannes Müller , Jan Strohbeck , Martin Herrmann , Michael Buchholz

Environment perception is the task for intelligent vehicles on which all subsequent steps rely. A key part of perception is to safely detect other road users such as vehicles, pedestrians, and cyclists. With modern deep learning techniques…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Florian Kraus , Klaus Dietmayer

A novel learning Model Predictive Control technique is applied to the autonomous racing problem. The goal of the controller is to minimize the time to complete a lap. The proposed control strategy uses the data from previous laps to improve…

Machine Learning · Computer Science 2017-11-10 Ugo Rosolia , Ashwin Carvalho , Francesco Borrelli

In autonomous racing, vehicles operate close to the limits of handling and a sensor failure can have critical consequences. To limit the impact of such failures, this paper presents the redundant perception and state estimation approaches…