English
Related papers

Related papers: Perception as prediction using general value funct…

200 papers

Visual foresight gives an agent a window into the future, which it can use to anticipate events before they happen and plan strategic behavior. Although impressive results have been achieved on video prediction in constrained settings,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Lin Yen-Chen , Maria Bauza , Phillip Isola

Anticipating the motion of other road users is crucial for automated driving systems (ADS), as it enables safe and informed downstream decision-making and motion planning. Unfortunately, contemporary learning-based approaches for motion…

Machine Learning · Computer Science 2023-09-21 MReza Alipour Sormoli , Amir Samadi , Sajjad Mozaffari , Konstantinos Koufos , Mehrdad Dianati , Roger Woodman

Motivated by the intuitive understanding humans have about the space of possible interactions, and the ease with which they can generalize this understanding to previously unseen scenes, we develop an approach for learning visual…

Robotics · Computer Science 2023-05-30 Homanga Bharadhwaj , Abhinav Gupta , Shubham Tulsiani

In autonomous driving (AD), accurately predicting changes in the environment can effectively improve safety and comfort. Due to complex interactions among traffic participants, however, it is very hard to achieve accurate prediction for a…

Machine Learning · Computer Science 2020-12-29 Ershad Banijamali , Mohsen Rohani , Elmira Amirloo , Jun Luo , Pascal Poupart

Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything cooperative perception, which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Tao Huang , Jianan Liu , Xi Zhou , Dinh C. Nguyen , Mostafa Rahimi Azghadi , Yuxuan Xia , Qing-Long Han , Sumei Sun

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

In recent years, the field of autonomous driving has attracted increasingly significant public interest. Accurately forecasting the future behavior of various traffic participants is essential for the decision-making of Autonomous Vehicles…

Robotics · Computer Science 2025-02-14 Jianxin Shi , Jinhao Chen , Yuandong Wang , Li Sun , Chunyang Liu , Wei Xiong , Tianyu Wo

This paper presents a novel approach to improving autonomous vehicle control in environments lacking clear road markings by integrating a diffusion-based motion predictor within an Active Inference Framework (AIF). Using a simulated parking…

Robotics · Computer Science 2024-06-04 Yufei Huang , Yulin Li , Andrea Matta , Mohsen Jafari

Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works, and then use this learned model to plan coordinated sequences of actions to bring about desired outcomes.…

Machine Learning · Computer Science 2020-01-01 Karl Schmeckpeper , Annie Xie , Oleh Rybkin , Stephen Tian , Kostas Daniilidis , Sergey Levine , Chelsea Finn

Autonomous cars have to navigate in dynamic environment which can be full of uncertainties. The uncertainties can come either from sensor limitations such as occlusions and limited sensor range, or from probabilistic prediction of other…

Robotics · Computer Science 2019-05-06 Liting Sun , Wei Zhan , Ching-Yao Chan , Masayoshi Tomizuka

To maximize safety and driving comfort, autonomous driving systems can benefit from implementing foresighted action choices that take different potential scenario developments into account. While artificial scene prediction methods are…

Robotics · Computer Science 2022-04-15 Chao Wang , Thomas H. Weisswange , Matti Krueger , Christiane B. Wiebel-Herboth

Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. Since autonomous vehicles need to navigate in dynamically changing environments, they are expected to make accurate…

Robotics · Computer Science 2022-11-15 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

We present a Reverse Reinforcement Learning (Reverse RL) approach for representing retrospective knowledge. General Value Functions (GVFs) have enjoyed great success in representing predictive knowledge, i.e., answering questions about…

Machine Learning · Computer Science 2020-11-03 Shangtong Zhang , Vivek Veeriah , Shimon Whiteson

We present an integrated approach for perception and control for an autonomous vehicle and demonstrate this approach in a high-fidelity urban driving simulator. Our approach first builds a model for the environment, then trains a policy…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Ali Baheri , Ilya Kolmanovsky , Anouck Girard , H. Eric Tseng , Dimitar Filev

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

To plan a safe and efficient route, an autonomous vehicle should anticipate future trajectories of other agents around it. Trajectory prediction is an extremely challenging task which recently gained a lot of attention in the autonomous…

Robotics · Computer Science 2023-03-24 Apoorv Singh

Trajectory prediction is one of the key components of the autonomous driving software stack. Accurate prediction for the future movement of surrounding traffic participants is an important prerequisite for ensuring the driving efficiency…

Robotics · Computer Science 2023-05-17 Wenbo Shao , Jun Li , Hong Wang

Training intelligent agents that can drive autonomously in various urban and highway scenarios has been a hot topic in the robotics society within the last decades. However, the diversity of driving environments in terms of road topology…

Robotics · Computer Science 2022-04-06 Behrad Toghi , Rodolfo Valiente , Ramtin Pedarsani , Yaser P. Fallah

In this endeavor, we developed a comprehensive system that processes integrated visual features derived from video frames captured by a regular camera, along with depth details obtained from a point cloud scanner. This system is designed to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Alexander Liu