English
Related papers

Related papers: Application of Multimodal Large Language Models in…

200 papers

With the rapid advancement of autonomous driving, deploying Vision-Language Models (VLMs) to enhance perception and decision-making has become increasingly common. However, the real-time application of VLMs is hindered by high latency and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lianming Huang , Haibo Hu , Yufei Cui , Jiacheng Zuo , Shangyu Wu , Nan Guan , Chun Jason Xue

Large vision-language models (VLMs) for autonomous driving (AD) are evolving beyond perception and cognition tasks toward motion planning. However, we identify two critical challenges in this direction: (1) VLMs tend to learn shortcuts by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yue Li , Meng Tian , Dechang Zhu , Jiangtong Zhu , Zhenyu Lin , Zhiwei Xiong , Xinhai Zhao

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

Computation and Language · Computer Science 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Recent advancements in autonomous vehicles (AVs) use Large Language Models (LLMs) to perform well in normal driving scenarios. However, ensuring safety in dynamic, high-risk environments and managing safety-critical long-tail events remain…

Artificial Intelligence · Computer Science 2024-12-20 Zhiyuan Zhou , Heye Huang , Boqi Li , Shiyue Zhao , Yao Mu , Jianqiang Wang

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and…

Computational Engineering, Finance, and Science · Computer Science 2025-03-28 Yimo Yan , Yejia Liao , Guanhao Xu , Ruili Yao , Huiying Fan , Jingran Sun , Xia Wang , Jonathan Sprinkle , Ziyan An , Meiyi Ma , Xi Cheng , Tong Liu , Zemian Ke , Bo Zou , Matthew Barth , Yong-Hong Kuo

The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content. While prior studies have…

Artificial Intelligence · Computer Science 2024-09-30 Lin Li , Guikun Chen , Hanrong Shi , Jun Xiao , Long Chen

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Multimodal large language models (MLLMs) are increasingly integrated into autonomous driving (AD) systems; however, they remain vulnerable to diverse safety threats, particularly in accident-prone scenarios. Recent safeguard mechanisms have…

Artificial Intelligence · Computer Science 2026-05-12 Tianyuan Zhang , Peng Yue , Zihao Peng , Jiangfan Liu , Zonghao Ying , Jiakai Wang , Tianlin Li , Jian Yang , Yaodong Yang , Aishan Liu , Xianglong Liu

Recently, the astonishing performance of large language models (LLMs) in natural language comprehension and generation tasks triggered lots of exploration of using them as central controllers to build agent systems. Multiple studies focus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chenyu Wang , Weixin Luo , Sixun Dong , Xiaohua Xuan , Zhengxin Li , Lin Ma , Shenghua Gao

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

Computation and Language · Computer Science 2024-06-12 Sylvio Barbon Junior , Paolo Ceravolo , Sven Groppe , Mustafa Jarrar , Samira Maghool , Florence Sèdes , Soror Sahri , Maurice Van Keulen

Human decision-making belongs to the foundation of our society and civilization, but we are on the verge of a future where much of it will be delegated to artificial intelligence. The arrival of Large Language Models (LLMs) has transformed…

Artificial Intelligence · Computer Science 2025-06-23 Hao Li , Gengrui Zhang , Petter Holme , Shuyue Hu , Zhen Wang

As AI moves beyond text, large language models (LLMs) increasingly power vision, audio, and document understanding; however, their high inference costs hinder real-time, scalable deployment. Conversely, smaller open-source models offer cost…

Computation and Language · Computer Science 2025-11-11 Mayank Saini , Arit Kumar Bishwas

Large Language Models (LLMs) show potential for enhancing robotic path planning. This paper assesses visual input's utility for multimodal LLMs in such tasks via a comprehensive benchmark. We evaluated 15 multimodal LLMs on generating valid…

Robotics · Computer Science 2025-07-17 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Mobility analysis is a crucial element in the research area of transportation systems. Forecasting traffic information offers a viable solution to address the conflict between increasing transportation demands and the limitations of…

Machine Learning · Computer Science 2025-02-24 Zijian Zhang , Yujie Sun , Zepu Wang , Yuqi Nie , Xiaobo Ma , Ruolin Li , Peng Sun , Xuegang Ban

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

In the progress of industrial anomaly detection, general anomaly detection (GAD) is an emerging trend and also the ultimate goal. Unlike the conventional single- and multi-class AD, general AD aims to train a general AD model that can…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xincheng Yao , Zefeng Qian , Chao Shi , Jiayang Song , Chongyang Zhang

Recent advancements in vision foundation models (VFMs) have revolutionized visual perception in 2D, yet their potential for 3D scene understanding, particularly in autonomous driving applications, remains underexplored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Lingdong Kong , Xiang Xu , Youquan Liu , Jun Cen , Runnan Chen , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu

Multimodal Large Language Models (MLLMs) struggle with continual learning, often suffering from catastrophic forgetting when adapting to sequential tasks. We introduce a routing-based architecture that integrates new capabilities while…

Machine Learning · Computer Science 2026-04-08 Jay Mohta , Kenan Emir Ak , Gwang Lee , Dimitrios Dimitriadis , Yan Xu , Mingwei Shen