English
Related papers

Related papers: HorizonDrive: Self-Corrective Autoregressive World…

200 papers

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

Training robots to navigate diverse environments is a challenging problem as it involves the confluence of several different perception tasks such as mapping and localization, followed by optimal path-planning and control. Recently released…

Robotics · Computer Science 2021-01-07 Kaushik Balakrishnan , Punarjay Chakravarty , Shubham Shrivastava

Recent advances in autonomous driving research towards motion planners that are robust, safe, and adaptive. However, existing rule-based and data-driven planners lack adaptability to long-tail scenarios, while knowledge-driven methods offer…

Robotics · Computer Science 2026-04-10 Huaiyuan Yao , Pengfei Li , Bu Jin , Yupeng Zheng , An Liu , Lisen Mu , Qing Su , Qian Zhang , Yilun Chen , Peng Li

Robots have been successfully used to perform tasks with high precision. In real-world environments with sparse rewards and multiple goals, learning is still a major challenge and Reinforcement Learning (RL) algorithms fail to learn good…

Robotics · Computer Science 2023-08-21 Tejaswini Manjunath , Mozhgan Navardi , Prakhar Dixit , Bharat Prakash , Tinoosh Mohsenin

Generating multi-view videos for autonomous driving training has recently gained much attention, with the challenge of addressing both cross-view and cross-frame consistency. Existing methods typically apply decoupled attention mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Hannan Lu , Xiaohe Wu , Shudong Wang , Xiameng Qin , Xinyu Zhang , Junyu Han , Wangmeng Zuo , Ji Tao

Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the…

Machine Learning · Computer Science 2020-07-02 Zhangjie Cao , Erdem Bıyık , Woodrow Z. Wang , Allan Raventos , Adrien Gaidon , Guy Rosman , Dorsa Sadigh

Scalable embodied intelligence is constrained by the scarcity of diverse, long-horizon robotic manipulation data. Existing video world models in this domain are limited to synthesizing short clips of simple actions and often rely on…

Hydra-MDP++ introduces a novel teacher-student knowledge distillation framework with a multi-head decoder that learns from human demonstrations and rule-based experts. Using a lightweight ResNet-34 network without complex components, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Kailin Li , Zhenxin Li , Shiyi Lan , Yuan Xie , Zhizhong Zhang , Jiayi Liu , Zuxuan Wu , Zhiding Yu , Jose M. Alvarez

As multi-object tracking (MOT) tasks continue to evolve toward more general and multi-modal scenarios, the rigid and task-specific architectures of existing MOT methods increasingly hinder their applicability across diverse tasks and limit…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Lianjie Jia , Yuhan Wu , Binghao Ran , Yifan Wang , Lijun Wang , Huchuan Lu

Foundational world models must be both interactive and preserve spatiotemporal coherence for effective future planning with action choices. However, present models for long video generation have limited inherent world modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Taiye Chen , Xun Hu , Zihan Ding , Chi Jin

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising…

Continual reinforcement learning challenges agents to acquire new skills while retaining previously learned ones with the goal of improving performance in both past and future tasks. Most existing approaches rely on model-free methods with…

Machine Learning · Computer Science 2026-05-19 Abdulaziz Alyahya , Abdallah Al Siyabi , Markus R. Ernst , Luke Yang , Levin Kuhlmann , Gideon Kowadlo

Executing drift maneuvers during high-speed cornering presents significant challenges for autonomous vehicles, yet offers the potential to minimize turning time and enhance driving dynamics. While reinforcement learning (RL) has shown…

Robotics · Computer Science 2024-11-26 Shiyue Zhao , Junzhi Zhang , Neda Masoud , Yuhong Jiang , Heye Huang , Tao Liu

Closed-loop simulation is a core component of autonomous vehicle (AV) development, enabling scalable testing, training, and safety validation before real-world deployment. Neural scene reconstruction converts driving logs into interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianshi Cao , Jiawei Ren , Yuxuan Zhang , Jaewoo Seo , Jiahui Huang , Shikhar Solanki , Haotian Zhang , Mingfei Guo , Haithem Turki , Muxingzi Li , Yue Zhu , Sipeng Zhang , Zan Gojcic , Sanja Fidler , Kangxue Yin

This paper addresses the challenges of training end-to-end autonomous driving agents using Reinforcement Learning (RL). RL agents are typically trained in a fixed set of scenarios and nominal behavior of surrounding road users in…

Robotics · Computer Science 2026-03-06 Ahmed Abouelazm , Tim Weinstein , Tim Joseph , Philip Schörner , J. Marius Zöllner

This investigation introduces a novel deep reinforcement learning-based suite to control floating platforms in both simulated and real-world environments. Floating platforms serve as versatile test-beds to emulate micro-gravity environments…

Well-established optimization-based methods can guarantee an optimal trajectory for a short optimization horizon, typically no longer than a few seconds. As a result, choosing the optimal trajectory for this short horizon may still result…

Machine Learning · Computer Science 2020-12-08 Branka Mirchevska , Maria Hügle , Gabriel Kalweit , Moritz Werling , Joschka Boedecker

Drifting is a complicated task for autonomous vehicle control. Most traditional methods in this area are based on motion equations derived by the understanding of vehicle dynamics, which is difficult to be modeled precisely. We propose a…

Robotics · Computer Science 2020-03-10 Peide Cai , Xiaodong Mei , Lei Tai , Yuxiang Sun , Ming Liu

Existing end-to-end autonomous driving (AD) algorithms typically follow the Imitation Learning (IL) paradigm, which faces challenges such as causal confusion and an open-loop gap. In this work, we propose RAD, a 3DGS-based closed-loop…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hao Gao , Shaoyu Chen , Bo Jiang , Bencheng Liao , Yiang Shi , Xiaoyang Guo , Yuechuan Pu , Haoran Yin , Xiangyu Li , Xinbang Zhang , Ying Zhang , Wenyu Liu , Qian Zhang , Xinggang Wang

Hand-eye calibration through visual localization is a critical capability for robotic manipulation in open-world environments. However, most deep learning-based calibration models suffer from catastrophic forgetting when adapting into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Fazeng Li , Gan Sun , Chenxi Liu , Yao He , Wei Cong , Yang Cong