English
Related papers

Related papers: LMMCoDrive: Cooperative Driving with Large Multimo…

200 papers

Adaptive collaboration is critical to a team of autonomous robots to perform complicated navigation tasks in large-scale unknown environments. An effective collaboration strategy should be determined and adapted according to each robot's…

Robotics · Computer Science 2025-05-21 Abhinav Rajvanshi , Pritish Sahu , Tixiao Shan , Karan Sikka , Han-Pang Chiu

Connected and autonomous driving is developing rapidly in recent years. However, current autonomous driving systems, which are primarily based on data-driven approaches, exhibit deficiencies in interpretability, generalization, and…

Artificial Intelligence · Computer Science 2024-04-23 Senkang Hu , Zhengru Fang , Zihan Fang , Yiqin Deng , Xianhao Chen , Yuguang Fang

The cooperative driving technology of Connected and Autonomous Vehicles (CAVs) is crucial for improving the efficiency and safety of transportation systems. Learning-based methods, such as Multi-Agent Reinforcement Learning (MARL), have…

Robotics · Computer Science 2025-08-12 Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun , Wei Zhan , Masayoshi Tomizuka , Mingyu Ding

This paper proposes a fully decentralized model predictive control (MPC) framework with control barrier function (CBF) constraints for safety-critical trajectory planning in multi-robot legged systems. The incorporation of CBF constraints…

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Artificial Intelligence · Computer Science 2025-10-06 Jean Douglas Carvalho , Hugo Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

The ever-increasing heavy traffic congestion potentially impedes the accessibility of emergency vehicles (EVs), resulting in detrimental impacts on critical services and even safety of people's lives. Hence, it is significant to propose an…

Artificial Intelligence · Computer Science 2022-02-22 Lige Ding , Dong Zhao , Zhaofeng Wang , Guang Wang , Chang Tan , Lei Fan , Huadong Ma

Situational awareness as a necessity in the connected and autonomous vehicles (CAV) domain is the subject of a significant number of researches in recent years. The driver's safety is directly dependent on the robustness, reliability, and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ehsan Emad Marvasti , Arash Raftari , Amir Emad Marvasti , Yaser P. Fallah

In this paper we study models and coordination policies for intermodal Autonomous Mobility-on-Demand (AMoD), wherein a fleet of self-driving vehicles provides on-demand mobility jointly with public transit. Specifically, we first present a…

Systems and Control · Computer Science 2018-09-06 Mauro Salazar , Federico Rossi , Maximilian Schiffer , Christopher H. Onder , Marco Pavone

Recently, large language models (LLMs) have gained significant attention for their ability to generate fast and accurate answer to the given query. These models have evolved into large multimodal models (LMMs), which can interpret and…

Information Theory · Computer Science 2026-01-13 Sunwoo Kim , Byonghyo Shim

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather data via vehicle-to-vehicle (V2V) communication, such as processed LIDAR and camera data from other vehicles. In this work, we design an…

Robotics · Computer Science 2023-02-16 Songyang Han , Shanglin Zhou , Lynn Pepin , Jiangwei Wang , Caiwen Ding , Fei Miao

Safe autonomous driving in mixed traffic requires a unified understanding of multimodal interactions and dynamic planning under uncertainty. Existing learning based approaches struggle to capture rare but safety critical behaviors, while…

Robotics · Computer Science 2025-12-03 Heye Huang , Yibin Yang , Mingfeng Fan , Haoran Wang , Xiaocong Zhao , Jianqiang Wang

The advent of autonomous driving and electrification is enabling the deployment of Electric Autonomous Mobility-on-Demand (E-AMoD) systems, whereby electric autonomous vehicles provide on-demand mobility. Crucially, the design of the…

Systems and Control · Electrical Eng. & Systems 2023-09-25 Fabio Paparella , Theo Hofman , Mauro Salazar

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Despite the success of AI-enabled onboard perception, on-ramp merging has been one of the main challenges for autonomous driving. Due to limited sensing range of onboard sensors, a merging vehicle can hardly observe main road conditions and…

Robotics · Computer Science 2022-08-16 Gaurav Bagwe , Jian Li , Xiaoyong Yuan , Lan Zhang

Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling…

Artificial Intelligence · Computer Science 2026-03-04 Xiangyu Li , Tianyi Wang , Xi Cheng , Rakesh Chowdary Machineni , Zhaomiao Guo , Sikai Chen , Junfeng Jiao , Christian Claudel

Developments in cooperative trajectory planning of connected autonomous vehicles (CAVs) have gathered considerable momentum and research attention. Generally, such problems present strong non-linearity and non-convexity, rendering great…

Robotics · Computer Science 2023-01-12 Zhenmin Huang , Shaojie Shen , Jun Ma

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

Civil aviation is a cornerstone of global transportation and commerce, and ensuring its safety, efficiency and customer satisfaction is paramount. Yet conventional Artificial Intelligence (AI) solutions in aviation remain siloed and narrow,…

Artificial Intelligence · Computer Science 2026-01-19 Wenbin Li , Jingling Wu , Xiaoyong Lin. Jing Chen , Cong Chen

Deep learning-based Autonomous Driving (AD) models often exhibit poor generalization due to data heterogeneity in an ever domain-shifting environment. While Federated Learning (FL) could improve the generalization of an AD model (known as…