English
Related papers

Related papers: HorizonDrive: Self-Corrective Autoregressive World…

200 papers

In autonomous vehicle (AV) technology, the ability to accurately predict the movements of surrounding vehicles is paramount for ensuring safety and operational efficiency. Incorporating human decision-making insights enables AVs to more…

Artificial Intelligence · Computer Science 2024-03-01 Haicheng Liao , Yongkang Li , Zhenning Li , Chengyue Wang , Zhiyong Cui , Shengbo Eben Li , Chengzhong Xu

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

Diffusion-based planners have shown strong potential for autonomous driving by capturing multi-modal driving behaviors. A key challenge is how to effectively guide these models for safe and reactive planning in closed-loop settings, where…

Artificial Intelligence · Computer Science 2026-03-06 Shu Liu , Wenlin Chen , Weihao Li , Zheng Wang , Lijin Yang , Jianing Huang , Yipin Zhang , Zhongzhan Huang , Ze Cheng , Hao Yang

Training intelligent agents that can drive autonomously in various urban and highway scenarios has been a hot topic in the robotics society within the last decades. However, the diversity of driving environments in terms of road topology…

Robotics · Computer Science 2022-04-06 Behrad Toghi , Rodolfo Valiente , Ramtin Pedarsani , Yaser P. Fallah

Reinforcement learning (RL) has become a critical paradigm for LLM post-training, yet the rollout phase -- accounting for 50--80% of total step time -- is bottlenecked by skewed generation: long-tailed trajectories indispensable for model…

We present ReinDriveGen, a framework that enables full controllability over dynamic driving scenes, allowing users to freely edit actor trajectories to simulate safety-critical corner cases such as front-vehicle collisions, drifting cars,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hao Zhang , Lue Fan , Weikang Bian , Zehuan Wu , Lewei Lu , Zhaoxiang Zhang , Hongsheng Li

Embodied navigation in open, dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time. We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jintao Chen , Junjun Hu , Haochen Bai , Minghua Luo , Xinda Xue , Botao Ren , Chengyu Bai , Shichao Xie , Ziyi Chen , Fei Liu , Zedong Chu , Xiaolong Wu , Mu Xu , Shanghang Zhang

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

We address the problem of simultaneously learning and control in an online receding horizon control setting. We consider the control of an unknown linear dynamical system with general cost functions and affine constraints on the control…

Optimization and Control · Mathematics 2022-11-02 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

Accurately and safely predicting the trajectories of surrounding vehicles is essential for fully realizing autonomous driving (AD). This paper presents the Human-Like Trajectory Prediction model (HLTP++), which emulates human cognitive…

Artificial Intelligence · Computer Science 2024-07-10 Haicheng Liao , Yongkang Li , Zhenning Li , Chengyue Wang , Chunlin Tian , Yuming Huang , Zilin Bian , Kaiqun Zhu , Guofa Li , Ziyuan Pu , Jia Hu , Zhiyong Cui , Chengzhong Xu

End-to-end autonomous driving has emerged as a compelling alternative to traditional modular pipelines by directly mapping raw sensor data to driving actions. While recent approaches achieve strong performance on single-domain datasets,…

Robotics · Computer Science 2026-05-20 Hoonhee Cho , Giwon Lee , Jae-Young Kang , Hyemin Yang , Heejun Park , Kuk-Jin Yoon

Autoregressive (AR) visual generators model images as sequences of discrete tokens and are trained with a next-token likelihood objective. This strict causal supervision optimizes each step based only on the immediate next token, which can…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yonghao Yu , Lang Huang , Zerun Wang , Runyi Li , Toshihiko Yamasaki

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural ordering, persistent action execution, and scene consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yu Yang , Yue Liao , Jianbiao Mei , Baisen Wang , Xuemeng Yang , Licheng Wen , Jiangning Zhang , Xiangtai Li , Liang Lv , Hanlin Chen , Botian Shi , Yong Liu , Shuicheng Yan , Gim Hee Lee

This paper presents CLIP-RLDrive, a new reinforcement learning (RL)-based framework for improving the decision-making of autonomous vehicles (AVs) in complex urban driving scenarios, particularly in unsignalized intersections. To achieve…

Robotics · Computer Science 2024-12-24 Erfan Doroudian , Hamid Taghavifar

Trajectory prediction is crucial to advance autonomous driving, improving safety, and efficiency. Although end-to-end models based on deep learning have great potential, they often do not consider vehicle dynamic limitations, leading to…

Robotics · Computer Science 2025-08-20 Alexander Fertig , Lakshman Balasubramanian , Michael Botsch

This paper proposes a novel inverse reinforcement learning framework using a diffusion-based adaptive lookahead planner (IRL-DAL) for autonomous vehicles. Training begins with imitation from an expert finite state machine (FSM) controller…

Robotics · Computer Science 2026-02-02 Seyed Ahmad Hosseini Miangoleh , Amin Jalal Aghdasian , Farzaneh Abdollahi

Two less addressed issues of deep reinforcement learning are (1) lack of generalization capability to new target goals, and (2) data inefficiency i.e., the model requires several (and often costly) episodes of trial and error to converge,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-19 Yuke Zhu , Roozbeh Mottaghi , Eric Kolve , Joseph J. Lim , Abhinav Gupta , Li Fei-Fei , Ali Farhadi

Vision-language models (VLMs) have exhibited impressive capabilities across diverse image understanding tasks, but still struggle in settings that require reasoning over extended sequences of camera frames from a video. This limits their…

Computation and Language · Computer Science 2025-12-01 Philip Schroeder , Ondrej Biza , Thomas Weng , Hongyin Luo , James Glass

Advanced Driver Assistance Systems (ADAS) are increasingly important in improving driving safety and comfort, with Adaptive Cruise Control (ACC) being one of the most widely used. However, pre-defined ACC settings may not always align with…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Zhouqiao Zhao , Xishun Liao , Amr Abdelraouf , Kyungtae Han , Rohit Gupta , Matthew J. Barth , Guoyuan Wu