English
Related papers

Related papers: Imitation with Spatial-Temporal Heatmap: 2nd Place…

200 papers

To navigate safely in urban environments, an autonomous vehicle (ego vehicle) must understand and anticipate its surroundings, in particular the behavior and intents of other road users (neighbors). Most of the times, multiple decision…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Thibault Buhet , Emilie Wirbel , Andrei Bursuc , Xavier Perrotton

This paper describes the approach we have taken in the challenge. We still adopted the two-stage scheme same as the last champion, that is, detection first and segmentation followed. We trained more powerful detector and segmentor…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jiajun Zhang , Boyu Chen , Zhilong Ji , Jinfeng Bai , Zonghai Hu

Our research introduces a modular motion planning framework for autonomous vehicles using a sampling-based trajectory planning algorithm. This approach effectively tackles the challenges of solution space construction and optimization in…

Robotics · Computer Science 2024-08-06 Rainer Trauth , Korbinian Moller , Gerald Wuersching , Johannes Betz

Conventional trajectory planning approaches for autonomous vehicles often assume a fixed vehicle model that remains constant regardless of the vehicle's location. This overlooks the critical fact that the tires and the surface are the two…

Robotics · Computer Science 2025-04-17 Frederik Werner , Ann-Kathrin Schwehn , Markus Lienkamp , Johannes Betz

Ensuring safety in autonomous vehicles necessitates advanced path planning and obstacle avoidance capabilities, particularly in dynamic environments. This paper introduces a bi-level control framework that efficiently augments road…

Robotics · Computer Science 2025-10-07 Mostafa Emam , Matthias Gerdts

We present a deep reinforcement learning (deep RL) algorithm that consists of learning-based motion planning and imitation to tackle challenging control problems. Deep RL has been an effective tool for solving many high-dimensional…

Robotics · Computer Science 2023-03-02 Nitish Sontakke , Sehoon Ha

Imitation learning aims to extract high-performance policies from logged demonstrations of expert behavior. It is common to frame imitation learning as a supervised learning problem in which one fits a function approximator to the…

Machine Learning · Computer Science 2022-05-24 Mengjiao Yang , Dale Schuurmans , Pieter Abbeel , Ofir Nachum

We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Sriram Narayanan , Dinesh Jayaraman , Manmohan Chandraker

The ability to accurately predict and simulate human driving behavior is critical for the development of intelligent transportation systems. Traditional modeling methods have employed simple parametric models and behavioral cloning. This…

Artificial Intelligence · Computer Science 2017-01-25 Alex Kuefler , Jeremy Morton , Tim Wheeler , Mykel Kochenderfer

With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Autonomous racing with scaled race cars has gained increasing attention as an effective approach for developing perception, planning and control algorithms for safe autonomous driving at the limits of the vehicle's handling. To train agile…

Robotics · Computer Science 2023-05-30 Xiatao Sun , Mingyan Zhou , Zhijun Zhuang , Shuo Yang , Johannes Betz , Rahul Mangharam

This paper aims to investigate direct imitation learning from human drivers for the task of lane keeping assistance in highway and country roads using grayscale images from a single front view camera. The employed method utilizes…

Machine Learning · Computer Science 2017-09-13 Christopher Innocenti , Henrik Lindén , Ghazaleh Panahandeh , Lennart Svensson , Nasser Mohammadiha

The rapid advancement of autonomous systems, including self-driving vehicles and drones, has intensified the need to forge true Spatial Intelligence from multi-modal onboard sensor data. While foundation models excel in single-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Song Wang , Lingdong Kong , Xiaolu Liu , Hao Shi , Wentong Li , Jianke Zhu , Steven C. H. Hoi

Deep learning methods have achieved excellent performance in pose estimation, but the lack of robustness causes the keypoints to change drastically between similar images. In view of this problem, a stable heatmap regression method is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Yumeng Zhang , Li Chen , Yufeng Liu , Xiaoyan Guo , Wen Zheng , Junhai Yong

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

Machine Learning · Computer Science 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

Model-based control is a popular paradigm for robot navigation because it can leverage a known dynamics model to efficiently plan robust robot trajectories. However, it is challenging to use model-based methods in settings where the…

Robotics · Computer Science 2019-07-19 Somil Bansal , Varun Tolani , Saurabh Gupta , Jitendra Malik , Claire Tomlin

Large Language Models (LLMs) show growing promise in autonomous driving by reasoning over complex traffic scenarios to generate path plans. However, their tendencies toward overconfidence, and hallucinations raise critical safety concerns.…

Machine Learning · Computer Science 2025-05-16 Achref Doula , Max Mühlhäuser , Alejandro Sanchez Guinea

In this technical report, we briefly introduce the solution of our team ''summer'' for Atomospheric Turbulence Mitigation in UG$^2$+ Challenge in CVPR 2022. In this task, we propose a unified end-to-end framework to reconstruct a high…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Zhuang Liu , Zhichao Zhao , Ye Yuan , Zhi Qiao , Jinfeng Bai , Zhilong Ji

We present a new method for multi-modal, long-term vehicle trajectory prediction. Our approach relies on using lane centerlines captured in rich maps of the environment to generate a set of proposed goal paths for each vehicle. Using these…

Machine Learning · Computer Science 2020-11-17 Lingyao Zhang , Po-Hsun Su , Jerrick Hoang , Galen Clark Haynes , Micol Marchetti-Bowick

Recent research in robot exploration and mapping has focused on sampling environmental hotspot fields. This exploration task is formalized by Low, Dolan, and Khosla (2008) in a sequential decision-theoretic planning under uncertainty…

Machine Learning · Computer Science 2013-05-28 Kian Hsiang Low , John M. Dolan , Pradeep Khosla