English
Related papers

Related papers: Learning Multi-Modal Self-Awareness Models for Aut…

200 papers

The ability of robots to model their own dynamics is key to autonomous planning and learning, as well as for autonomous damage detection and recovery. Traditionally, dynamic models are pre-programmed or learned from external observations.…

Robotics · Computer Science 2024-03-19 Yuhang Hu , Boyuan Chen , Hod Lipson

With increasing automation in passenger vehicles, the study of safe and smooth occupant-vehicle interaction and control transitions is key. In this study, we focus on the development of contextual, semantically meaningful representations of…

Robotics · Computer Science 2021-07-26 Akshay Rangesh , Nachiket Deo , Ross Greer , Pujitha Gunaratne , Mohan M. Trivedi

In this paper, we presented a preliminary study for tactical driver behavior detection from untrimmed naturalistic driving recordings. While supervised learning based detection is a common approach, it suffers when labeled data is scarce.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Athma Narayanan , Yi-Ting Chen , Srikanth Malla

The goal of our work is to use visual attention to enhance autonomous driving performance. We present two methods of predicting visual attention maps. The first method is a supervised learning approach in which we collect eye-gaze data for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Sourav Pal , Tharun Mohandoss , Pabitra Mitra

Driver distractions are known to be the dominant cause of road accidents. While monitoring systems can detect non-driving-related activities and facilitate reducing the risks, they must be accurate and efficient to be applicable.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Yiming Ma , Victor Sanchez , Soodeh Nikan , Devesh Upadhyay , Bhushan Atote , Tanaya Guha

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

The perception module of self-driving vehicles relies on a multi-sensor system to understand its environment. Recent advancements in deep learning have led to the rapid development of approaches that integrate multi-sensory measurements to…

Robotics · Computer Science 2023-07-14 Xi Zhu , Likang Wang , Caifa Zhou , Xiya Cao , Yue Gong , Lei Chen

Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as well as lane…

Robotics · Computer Science 2021-06-30 Namig Aliyev , Oguzhan Sezer , Mehmet Turan Guzel

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

Recent research on automotive driving developed an efficient end-to-end learning mode that directly maps visual input to control commands. However, it models distinct driving variations in a single network, which increases learning…

Robotics · Computer Science 2019-12-02 Huifang Ma , Yue Wang , Rong Xiong , Sarath Kodagoda , Li Tang

In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yingjie Wang , Qiuyu Mao , Hanqi Zhu , Jiajun Deng , Yu Zhang , Jianmin Ji , Houqiang Li , Yanyong Zhang

Autonomous race cars require perception, estimation, planning, and control modules which work together asynchronously while driving at the limit of a vehicle's handling capability. A fundamental challenge encountered in designing these…

Robotics · Computer Science 2020-11-17 Achin Jain , Matthew O'Kelly , Pratik Chaudhari , Manfred Morari

The safe deployment of autonomous vehicles relies on their ability to effectively react to environmental changes. This can require maneuvering on varying surfaces which is still a difficult problem, especially for slippery terrains. To…

Robotics · Computer Science 2023-03-22 Johan Vertens , Nicolai Dorka , Tim Welschehold , Michael Thompson , Wolfram Burgard

Human state detection and behavior prediction have seen significant advancements with the rise of machine learning and multimodal sensing technologies. However, predicting prosocial behavior intentions in mobility scenarios, such as helping…

Machine Learning · Computer Science 2025-07-14 Abinay Reddy Naini , Zhaobo K. Zheng , Teruhisa Misu , Kumar Akash

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen

Navigation and guidance of autonomous vehicles is a fundamental problem in robotics, which has attracted intensive research in recent decades. This report is mainly concerned with provable collision avoidance of multiple autonomous vehicles…

Optimization and Control · Mathematics 2014-01-28 Michael Hoy

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Humans have consciousness as the ability to perceive events and objects: a mental model of the world developed from the most impoverished of visual stimuli, enabling humans to make rapid decisions and take actions. Although spatial and…

Artificial Intelligence · Computer Science 2018-11-06 Lisheng Wu , Minne Li , Jun Wang

Autonomous driving promises to transform road transport. Multi-vehicle and multi-lane scenarios, however, present unique challenges due to constrained navigation and unpredictable vehicle interactions. Learning-based methods---such as deep…

Robotics · Computer Science 2020-02-12 Rupert Mitchell , Jenny Fletcher , Jacopo Panerati , Amanda Prorok