English
Related papers

Related papers: LMMCoDrive: Cooperative Driving with Large Multimo…

200 papers

We introduce M$^3$CAD, a comprehensive benchmark designed to advance research in generic cooperative autonomous driving. M$^3$CAD comprises 204 sequences with 30,000 frames. Each sequence includes data from multiple vehicles and different…

Robotics · Computer Science 2026-03-10 Morui Zhu , Yongqi Zhu , Yihao Zhu , Qi Chen , Deyuan Qu , Song Fu , Qing Yang

Connected automated vehicles (CAVs) have brought new opportunities to improve traffic throughput and reduce energy consumption. However, the uncertain lane-change behaviors (LCBs) of surrounding vehicles (SVs) as an uncontrollable factor…

Systems and Control · Electrical Eng. & Systems 2022-09-05 Bohui Wang , Rong Su

The design of Autonomous Vehicles (AVs) and the design of AVs-enabled mobility systems are closely coupled. Indeed, knowledge about the intended service of AVs would impact their design and deployment process, whilst insights about their…

Systems and Control · Electrical Eng. & Systems 2021-03-09 Gioele Zardini , Nicolas Lanzetti , Mauro Salazar , Andrea Censi , Emilio Frazzoli , Marco Pavone

We consider the problem of intelligent and efficient resource management framework in mobile edge computing (MEC), which can reduce delay and energy consumption, featuring distributed optimization and efficient congestion avoidance…

Networking and Internet Architecture · Computer Science 2020-06-09 Xiaoxiong Zhong , Xinghan Wang , Li Li , Yuanyuan Yang , Yang Qin , Tingting Yang , Bin Zhang , Weizhe Zhang

Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck for large-scale deployment. To address this challenge, some works use LLMs and VLMs for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hao Shao , Letian Wang , Yang Zhou , Yuxuan Hu , Zhuofan Zong , Steven L. Waslander , Wei Zhan , Hongsheng Li

This paper proposes a novel Large Vision-Language Model (LVLM) and Model Predictive Control (MPC) integration framework that delivers both task scalability and safety for Autonomous Driving (AD). LVLMs excel at high-level task planning…

Robotics · Computer Science 2025-07-16 Kazuki Atsuta , Kohei Honda , Hiroyuki Okuda , Tatsuya Suzuki

Navigating autonomous vehicles in open scenarios is a challenge due to the difficulties in handling unseen objects. Existing solutions either rely on small models that struggle with generalization or large models that are…

Robotics · Computer Science 2025-04-28 Jiayi Chen , Shuai Wang , Guoliang Li , Wei Xu , Guangxu Zhu , Derrick Wing Kwan Ng , Chengzhong Xu

Modeling and evaluation of automated vehicles (AVs) in mixed-autonomy traffic is essential prior to their safe and efficient deployment. This is especially important at urban junctions where complex multi-agent interactions occur. Current…

Optimization and Control · Mathematics 2025-07-30 Saeed Rahmani , Simeon C. Calvert , Bart van Arem

The design of autonomous vehicles (AVs) and the design of AV-enabled mobility systems are closely coupled. Indeed, knowledge about the intended service of AVs would impact their design and deployment process, whilst insights about their…

Systems and Control · Electrical Eng. & Systems 2021-03-09 Gioele Zardini , Nicolas Lanzetti , Mauro Salazar , Andrea Censi , Emilio Frazzoli , Marco Pavone

Large Multimodal Models (LMMs) have recently gained prominence in autonomous driving research, showcasing promising capabilities across various emerging benchmarks. LMMs specifically designed for this domain have demonstrated effective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ayesha Ishaq , Jean Lahoud , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer

This paper proposes a novel method for multi-lane convoy formation control that uses large language models (LLMs) to tackle coordination challenges in dynamic highway environments. Each connected and autonomous vehicle in the convoy uses a…

Multiagent Systems · Computer Science 2025-02-28 Liping Lu , Zhican He , Duanfeng Chu , Rukang Wang , Saiqian Peng , Pan Zhou

A distributed coordination method for solving multi-vehicle lane changes for connected autonomous vehicles (CAVs) is presented. Existing approaches to multi-vehicle lane changes are passive and opportunistic as they are implemented only…

Robotics · Computer Science 2025-10-14 Hansung Kim , Francesco Borrelli

Vision-language models enable the understanding and reasoning of complex traffic scenarios through multi-source information fusion, establishing it as a core technology for autonomous driving. However, existing vision-language models are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Minghui Hou , Wei-Hsing Huang , Shaofeng Liang , Daizong Liu , Tai-Hao Wen , Gang Wang , Runwei Guan , Weiping Ding

In this paper we present a model predictive control (MPC) approach to optimize vehicle scheduling and routing in an autonomous mobility-on-demand (AMoD) system. In AMoD systems, robotic, self-driving vehicles transport customers within an…

Systems and Control · Computer Science 2017-08-15 Rick Zhang , Federico Rossi , Marco Pavone

Unmanned aerial vehicles (UAVs) have been widely adopted in various real-world applications. However, the control and optimization of multi-UAV systems remain a significant challenge, particularly in dynamic and constrained environments.…

Machine Learning · Computer Science 2025-06-10 Zijiang Yan , Hao Zhou , Jianhua Pei , Hina Tabassum

The cooperation of connected and automated vehicles (CAVs) has shown great potential in improving traffic efficiency during intersection management. Existing research mainly focuses on intersections where lane changing is prohibited, which…

Optimization and Control · Mathematics 2021-09-30 Chaoyi Chen , Mengchi Cai , Jiawei Wang , Kai Li , Qing Xu , Jianqiang Wang , Keqiang Li

Cooperative decision-making of Connected Autonomous Vehicles (CAVs) presents a longstanding challenge due to its inherent nonlinearity, non-convexity, and discrete characteristics, compounded by the diverse road topologies encountered in…

Robotics · Computer Science 2024-01-11 Zhenmin Huang , Shaojie Shen , Jun Ma

Multi-modal learning has emerged as a key technique for improving performance across domains such as autonomous driving, robotics, and reasoning. However, in certain scenarios, particularly in resource-constrained environments, some…

Robotics · Computer Science 2026-01-01 Rui Liu , Yu Shen , Peng Gao , Pratap Tokekar , Ming Lin

Connected automated vehicles (CAVs) possess the ability to communicate and coordinate with one another, enabling cooperative platooning that enhances both energy efficiency and traffic flow. However, during the initial stage of CAV…

Artificial Intelligence · Computer Science 2026-01-21 Zeyu Mu , Shangtong Zhang , B. Brian Park

Highway on-ramp merging areas are common bottlenecks to traffic congestion and accidents. Currently, a cooperative control strategy based on connected and automated vehicles (CAVs) is a fundamental solution to this problem. While CAVs are…

Robotics · Computer Science 2025-07-17 Tianyi Wang , Yangyang Wang , Jie Pan , Junfeng Jiao , Christian Claudel