English
Related papers

Related papers: Occ-LLM: Enhancing Autonomous Driving with Occupan…

200 papers

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables…

Robotics · Computer Science 2025-11-19 Vinit Mehta , Charu Sharma , Karthick Thiyagarajan

Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling…

Artificial Intelligence · Computer Science 2026-03-04 Xiangyu Li , Tianyi Wang , Xi Cheng , Rakesh Chowdary Machineni , Zhaomiao Guo , Sikai Chen , Junfeng Jiao , Christian Claudel

We provide a sober look at the application of Multimodal Large Language Models (MLLMs) in autonomous driving, challenging common assumptions about their ability to interpret dynamic driving scenarios. Despite advances in models like GPT-4o,…

Robotics · Computer Science 2024-10-29 Shiva Sreeram , Tsun-Hsuan Wang , Alaa Maalouf , Guy Rosman , Sertac Karaman , Daniela Rus

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Existing learning-based occupancy prediction methods rely on large-scale 3D annotations and generalize poorly across environments. We present FreeOcc, a training-free framework for open-vocabulary occupancy prediction from monocular or…

Robotics · Computer Science 2026-05-01 Zeyu Jiang , Changqing Zhou , Xingxing Zuo , Changhao Chen

Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yining Hong , Haoyu Zhen , Peihao Chen , Shuhong Zheng , Yilun Du , Zhenfang Chen , Chuang Gan

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

The latest advancements in multi-modal large language models (MLLMs) have spurred a strong renewed interest in end-to-end motion planning approaches for autonomous driving. Many end-to-end approaches rely on human annotations to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yichen Xie , Runsheng Xu , Tong He , Jyh-Jing Hwang , Katie Luo , Jingwei Ji , Hubert Lin , Letian Chen , Yiren Lu , Zhaoqi Leng , Dragomir Anguelov , Mingxing Tan

Large Language Model (LLM)-based optimization has recently shown promise for autonomous problem solving, yet most approaches still cast LLMs as passive constraint checkers rather than proactive strategy designers, limiting their…

Artificial Intelligence · Computer Science 2026-04-06 Beidan Liu , Zhengqiu Zhu , Chen Gao , Tianle Pu , Yong Zhao , Wei Qi , Quanjun Yin

Deep learning architectures with powerful reasoning capabilities have driven significant advancements in autonomous driving technology. Large language models (LLMs) applied in this field can describe driving scenes and behaviors with a…

Artificial Intelligence · Computer Science 2024-10-01 Yizhou Huang , Yihua Cheng , Kezhi Wang

Occupancy prediction reconstructs 3D structures of surrounding environments. It provides detailed information for autonomous driving planning and navigation. However, most existing methods heavily rely on the LiDAR point clouds to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Chubin Zhang , Juncheng Yan , Yi Wei , Jiaxin Li , Li Liu , Yansong Tang , Yueqi Duan , Jiwen Lu

Large language models (LLMs) exhibit remarkable flexibility: they can adapt to novel tasks from in-context examples without any parameter updates, a capability known as in-context learning (ICL). Prior work on synthetic tasks has shown that…

Computation and Language · Computer Science 2026-05-29 Hua-Dong Xiong , Li Ji-An , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

Artificial Intelligence · Computer Science 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

Traffic congestion in metropolitan areas presents a formidable challenge with far-reaching economic, environmental, and societal ramifications. Therefore, effective congestion management is imperative, with traffic signal control (TSC)…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Maonan Wang , Aoyu Pang , Yuheng Kan , Man-On Pun , Chung Shue Chen , Bo Huang

Large Language Models (LLMs) exhibit remarkable capabilities in the hierarchical decomposition of complex tasks through semantic reasoning. However, their application in embodied systems faces challenges in ensuring reliable execution of…

Robotics · Computer Science 2025-03-04 Mingcong Lei , Ge Wang , Yiming Zhao , Zhixin Mai , Qing Zhao , Yao Guo , Zhen Li , Shuguang Cui , Yatong Han , Jinke Ren

3D semantic occupancy prediction is one of the crucial tasks of autonomous driving. It enables precise and safe interpretation and navigation in complex environments. Reliable predictions rely on effective sensor fusion, as different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tomislav Pavković , Mohammad-Ali Nikouei Mahani , Johannes Niedermayer , Johannes Betz

Vision-and-Language Navigation (VLN) refers to the task of enabling autonomous robots to navigate unfamiliar environments by following natural language instructions. While recent Large Vision-Language Models (LVLMs) have shown promise in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Vebjørn Haug Kåsene , Pierre Lison

The use of Multimodal Large Language Models (MLLMs) as an end-to-end solution for Embodied AI and Autonomous Driving has become a prevailing trend. While MLLMs have been extensively studied for visual semantic understanding tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yun Li , Yiming Zhang , Tao Lin , Xiangrui Liu , Wenxiao Cai , Zheng Liu , Bo Zhao

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

Ride-hailing platforms face significant challenges in optimizing order dispatching and driver repositioning operations in dynamic urban environments. Traditional approaches based on combinatorial optimization, rule-based heuristics, and…

Machine Learning · Computer Science 2025-05-30 Tengfei Lyu , Siyuan Feng , Hao Liu , Hai Yang