中文
相关论文

相关论文: ExpressMind: A Multimodal Pretrained Large Languag…

200 篇论文

Existing efforts to improve logical reasoning ability of language models have predominantly relied on supervised fine-tuning, hindering generalization to new domains and/or tasks. The development of Large Langauge Models (LLMs) has…

计算与语言 · 计算机科学 2024-06-18 Fangkai Jiao , Zhiyang Teng , Bosheng Ding , Zhengyuan Liu , Nancy F. Chen , Shafiq Joty

Cross-modal reasoning (CMR), the intricate process of synthesizing and drawing inferences across divergent sensory modalities, is increasingly recognized as a crucial capability in the progression toward more sophisticated and…

计算与语言 · 计算机科学 2024-10-01 Shengsheng Qian , Zuyi Zhou , Dizhan Xue , Bing Wang , Changsheng Xu

Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most…

机器学习 · 计算机科学 2026-04-21 Seerat Kaur , Sukhjit Singh Sehra , Dariush Ebrahimi

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to…

人工智能 · 计算机科学 2025-09-17 Wei Cai , Shujuan Liu , Jian Zhao , Ziyan Shi , Yusheng Zhao , Yuchen Yuan , Tianle Zhang , Chi Zhang , Xuelong Li

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated satisfactory performance across various vision-language tasks. Current approaches for vision and language interaction fall into two categories:…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Feipeng Ma , Yizhou Zhou , Zheyu Zhang , Shilin Yan , Hebei Li , Zilong He , Siying Wu , Fengyun Rao , Yueyi Zhang , Xiaoyan Sun

Multimodal large language models (MLLMs) hold the potential to enhance autonomous driving by combining domain-independent world knowledge with context-specific language guidance. Their integration into autonomous driving systems shows…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Tin Stribor Sohn , Philipp Reis , Maximilian Dillitzer , Johannes Bach , Jason J. Corso , Eric Sax

In today's world, emotional support is increasingly essential, yet it remains challenging for both those seeking help and those offering it. Multimodal approaches to emotional support show great promise by integrating diverse data sources…

Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling…

This paper proposes a novel method for multi-lane convoy formation control that uses large language models (LLMs) to tackle coordination challenges in dynamic highway environments. Each connected and autonomous vehicle in the convoy uses a…

多智能体系统 · 计算机科学 2025-02-28 Liping Lu , Zhican He , Duanfeng Chu , Rukang Wang , Saiqian Peng , Pan Zhou

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

机器人学 · 计算机科学 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Crash detection from video feeds is a critical problem in intelligent transportation systems. Recent developments in large language models (LLMs) and vision-language models (VLMs) have transformed how we process, reason about, and summarize…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

Bus holding control is a widely-adopted strategy for maintaining stability and improving the operational efficiency of bus systems. Traditional model-based methods often face challenges with the low accuracy of bus state prediction and…

人工智能 · 计算机科学 2025-04-15 Jiajie Yu , Yuhong Wang , Wei Ma

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

计算与语言 · 计算机科学 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

Analogical reasoning, particularly in multimodal contexts, is the foundation of human perception and creativity. Multimodal Large Language Model (MLLM) has recently sparked considerable discussion due to its emergent capabilities. In this…

计算与语言 · 计算机科学 2024-11-05 Diandian Guo , Cong Cao , Fangfang Yuan , Dakui Wang , Wei Ma , Yanbing Liu , Jianhui Fu

Multimodal large language models (MLLMs) have achieved remarkable progress across a range of vision-language tasks and demonstrate strong potential for traffic accident understanding. However, existing MLLMs in this domain primarily focus…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Zihao Sheng , Zilin Huang , Yansong Qu , Jiancong Chen , Yuhao Luo , Yen-Jung Chen , Yue Leng , Sikai Chen

In an era defined by the explosive growth of data and rapid technological advancements, Multimodal Large Language Models (MLLMs) stand at the forefront of artificial intelligence (AI) systems. Designed to seamlessly integrate diverse data…

Multi-modal Large Language Models (MLLMs) are increasingly prominent in the field of artificial intelligence. These models not only excel in traditional vision-language tasks but also demonstrate impressive performance in contemporary…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Xiaotian Han , Quanzeng You , Yongfei Liu , Wentao Chen , Huangjie Zheng , Khalil Mrini , Xudong Lin , Yiqi Wang , Bohan Zhai , Jianbo Yuan , Heng Wang , Hongxia Yang

Pre-trained large language models (LLMs) have demonstrated strong common-sense reasoning abilities, making them promising for robotic navigation and planning tasks. However, despite recent progress, bridging the gap between language…

机器人学 · 计算机科学 2025-12-29 Mingfeng Yuan , Letian Wang , Steven L. Waslander

Multimodal Large Models (MLMs) are becoming a significant research focus, combining powerful large language models with multimodal learning to perform complex tasks across different data modalities. This review explores the latest…

机器学习 · 计算机科学 2024-07-02 Xinji Mai , Zeng Tao , Junxiong Lin , Haoran Wang , Yang Chang , Yanlan Kang , Yan Wang , Wenqiang Zhang

While large multimodal models (LMMs) have demonstrated strong performance across various Visual Question Answering (VQA) tasks, certain challenges require complex multi-step reasoning to reach accurate answers. One particularly challenging…