English
Related papers

Related papers: DeepDriving: Learning Affordance for Direct Percep…

200 papers

Training intelligent agents that can drive autonomously in various urban and highway scenarios has been a hot topic in the robotics society within the last decades. However, the diversity of driving environments in terms of road topology…

Robotics · Computer Science 2022-04-06 Behrad Toghi , Rodolfo Valiente , Ramtin Pedarsani , Yaser P. Fallah

In this paper we propose a novel end-to-end learnable network that performs joint perception, prediction and motion planning for self-driving vehicles and produces interpretable intermediate representations. Unlike existing neural motion…

Robotics · Computer Science 2020-08-14 Abbas Sadat , Sergio Casas , Mengye Ren , Xinyu Wu , Pranaab Dhawan , Raquel Urtasun

Accurate affordance detection and segmentation with pixel precision is an important piece in many complex systems based on interactions, such as robots and assitive devices. We present a new approach to affordance perception which enables…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Lorenzo Mur-Labadia , Jose J. Guerrero , Ruben Martinez-Cantin

In recent years, 3D object perception has become a crucial component in the development of autonomous driving systems, providing essential environmental awareness. However, as perception tasks in autonomous driving evolve, their variants…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yu Wang , Shaohua Wang , Yicheng Li , Mingchun Liu

This paper proposes a strategy for visual prediction in the context of autonomous driving. Humans, when not distracted or drunk, are still the best drivers you can currently find. For this reason we take inspiration from two theoretical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Alice Plebe , Mauro Da Lio

Current deep learning based autonomous driving approaches yield impressive results also leading to in-production deployment in certain controlled scenarios. One of the most popular and fascinating approaches relies on learning vehicle…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Luca Cultrera , Lorenzo Seidenari , Federico Becattini , Pietro Pala , Alberto Del Bimbo

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Sajjad Mozaffari , Omar Y. Al-Jarrah , Mehrdad Dianati , Paul Jennings , Alexandros Mouzakitis

Building a robot that can understand and learn to interact by watching humans has inspired several vision problems. However, despite some successful results on static datasets, it remains unclear how current models can be used on a robot…

Robotics · Computer Science 2023-04-18 Shikhar Bahl , Russell Mendonca , Lili Chen , Unnat Jain , Deepak Pathak

Deep neural perception and control networks are likely to be a key component of self-driving vehicles. These models need to be explainable - they should provide easy-to-interpret rationales for their behavior - so that passengers, insurance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Jinkyu Kim , John Canny

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visuomotor pathway where…

Neurons and Cognition · Quantitative Biology 2020-02-24 Aria Yuan Wang , Michael J. Tarr

Recent advances in machine learning, especially techniques such as deep neural networks, are enabling a range of emerging applications. One such example is autonomous driving, which often relies on deep learning for perception. However,…

Machine Learning · Computer Science 2019-10-07 Adith Boloor , Karthik Garimella , Xin He , Christopher Gill , Yevgeniy Vorobeychik , Xuan Zhang

Affordances, a foundational concept in human-computer interaction and design, have traditionally been explained by direct-perception theories, which assume that individuals perceive action possibilities directly from the environment.…

Human-Computer Interaction · Computer Science 2025-01-22 Yi-Chi Liao , Christian Holz

Traditional decision and planning frameworks for self-driving vehicles (SDVs) scale poorly in new scenarios, thus they require tedious hand-tuning of rules and parameters to maintain acceptable performance in all foreseeable cases.…

Robotics · Computer Science 2021-08-02 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

Environment perception is crucial for autonomous vehicle (AV) safety. Most existing AV perception algorithms have not studied the surrounding environment complexity and failed to include the environment complexity parameter. This paper…

Machine Learning · Computer Science 2021-06-22 Ce Zhang , Azim Eskandarian , Xuelai Du

In the realm of autonomous driving, conventional approaches for vehicle perception and decision-making primarily rely on sensor input and rule-based algorithms. However, these methodologies often suffer from lack of interpretability and…

Robotics · Computer Science 2025-02-25 Haidong Wang , Pengfei Xiao , Ao Liu , Qia Shan , Jianhua Zhang

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

Object detection and segmentation are two core modules of an autonomous vehicle perception system. They should have high efficiency and low latency while reducing computational complexity. Currently, the most commonly used algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Maciej Baczmanski , Robert Synoczek , Mateusz Wasala , Tomasz Kryjak

We propose FreeSim, a camera simulation method for autonomous driving. FreeSim emphasizes high-quality rendering from viewpoints beyond the recorded ego trajectories. In such viewpoints, previous methods have unacceptable degradation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Lue Fan , Hao Zhang , Qitai Wang , Hongsheng Li , Zhaoxiang Zhang

Ego-centric driving videos available online provide an abundant source of visual data for autonomous driving, yet their lack of annotations makes it difficult to learn representations that capture both semantic structure and 3D geometry.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Matthew Strong , Wei-Jer Chang , Quentin Herau , Jiezhi Yang , Yihan Hu , Chensheng Peng , Wei Zhan