English
Related papers

Related papers: Perception as prediction using general value funct…

200 papers

This paper investigates the vision-based autonomous driving with deep learning and reinforcement learning methods. Different from the end-to-end learning method, our method breaks the vision-based lateral control system down into a…

Machine Learning · Computer Science 2018-10-31 Dong Li , Dongbin Zhao , Qichao Zhang , Yaran Chen

Future autonomous systems promise significant societal benefits, yet their deployment raises concerns about safety and trustworthiness. A key concern is assuring the reliability of robot perception, as perception seeds safe decision-making.…

Robotics · Computer Science 2025-08-15 Troi Williams

For driving safely and efficiently in highway scenarios, autonomous vehicles (AVs) must be able to predict future behaviors of surrounding object vehicles (OVs), and assess collision risk accurately for reasonable decision-making. Aiming at…

Robotics · Computer Science 2023-04-13 Dejian Meng , Wei Xiao , Lijun Zhang , Zhuang Zhang , Zihao Liu

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

Ensuring robot safety can be challenging; user-defined constraints can miss edge cases, policies can become unsafe even when trained from safe data, and safety can be subjective. Thus, we learn about robot safety by showing policy…

Robotics · Computer Science 2025-01-10 Aaron O. Feldman , Joseph A. Vincent , Maximilian Adang , Jun En Low , Mac Schwager

General Value Functions (GVFs) (Sutton et al., 2011) represent predictive knowledge in reinforcement learning. Each GVF computes the expected return for a given policy, based on a unique reward. Existing methods relying on fixed behavior…

Machine Learning · Computer Science 2024-10-15 Arushi Jain , Josiah P. Hanna , Doina Precup

General regression and classification models are constructed as linear combinations of simple rules derived from the data. Each rule consists of a conjunction of a small number of simple statements concerning the values of individual input…

Applications · Statistics 2008-11-12 Jerome H. Friedman , Bogdan E. Popescu

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Knowing how the effects of directed actions generalise to new situations (e.g. moving North, South, East and West, or turning left, right, etc.) is key to rapid generalisation across new situations. Markovian tasks can be characterised by a…

Neurons and Cognition · Quantitative Biology 2021-03-24 Changmin Yu , Timothy E. J. Behrens , Neil Burgess

In the burgeoning field of autonomous vehicles (AVs), trajectory prediction remains a formidable challenge, especially in mixed autonomy environments. Traditional approaches often rely on computational methods such as time-series analysis.…

Predictive models have been at the core of many robotic systems, from quadrotors to walking robots. However, it has been challenging to develop and apply such models to practical robotic manipulation due to high-dimensional sensory…

Robotics · Computer Science 2020-09-14 Lucas Manuelli , Yunzhu Li , Pete Florence , Russ Tedrake

Model-free reinforcement learning has recently been shown to successfully learn navigation policies from raw sensor data. In this work, we address the problem of learning driving policies for an autonomous agent in a high-fidelity…

Machine Learning · Computer Science 2019-02-12 Qadeer Khan , Torsten Schön , Patrick Wenzel

Prediction of pedestrian crossing intention is a critical function in autonomous vehicles. Conventional vision-based methods of crossing intention prediction often struggle with generalizability, context understanding, and causal reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Mohsen Azarmi , Mahdi Rezaei , He Wang

Autonomous Vehicle (AV) perception systems have advanced rapidly in recent years, providing vehicles with the ability to accurately interpret their environment. Perception systems remain susceptible to errors caused by overly-confident…

The comprehension of environmental traffic situation largely ensures the driving safety of autonomous vehicles. Recently, the mission has been investigated by plenty of researches, while it is hard to be well addressed due to the limitation…

Computer Vision and Pattern Recognition · Computer Science 2020-01-09 Yanliang Zhu , Deheng Qian , Dongchun Ren , Huaxia Xia

Designing a controller for autonomous vehicles capable of providing adequate performance in all driving scenarios is challenging due to the highly complex environment and inability to test the system in the wide variety of scenarios which…

Machine Learning · Computer Science 2019-12-24 Sampo Kuutti , Richard Bowden , Yaochu Jin , Phil Barber , Saber Fallah

To learn directed behaviors in complex environments, intelligent agents need to optimize objective functions. Various objectives are known for designing artificial agents, including task rewards and intrinsic motivation. However, it is…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner , Pedro A. Ortega , Jimmy Ba , Thomas Parr , Karl Friston , Nicolas Heess

Autonomous vehicle (AV) evaluation has been the subject of increased interest in recent years both in industry and in academia. This paper focuses on the development of a novel framework for generating adversarial driving behavior of…

Artificial Intelligence · Computer Science 2023-10-17 Zhen Liu , Hang Gao , Hao Ma , Shuo Cai , Yunfeng Hu , Ting Qu , Hong Chen , Xun Gong

A fairly reliable trend in deep reinforcement learning is that the performance scales with the number of parameters, provided a complimentary scaling in amount of training data. As the appetite for large models increases, it is imperative…

Machine Learning · Computer Science 2023-06-14 Bogdan Mazoure , Walter Talbott , Miguel Angel Bautista , Devon Hjelm , Alexander Toshev , Josh Susskind

Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the…

Robotics · Computer Science 2023-09-29 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool