English
Related papers

Related papers: Multimodal Reasoning with LLM for Encrypted Traffi…

200 papers

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Phrases are fundamental linguistic units through which humans convey semantics. This study critically examines the capacity of API-based large language models (LLMs) to comprehend phrase semantics, utilizing three human-annotated datasets.…

Computation and Language · Computer Science 2024-10-04 Rui Meng , Ye Liu , Lifu Tu , Daqing He , Yingbo Zhou , Semih Yavuz

Systematic evaluation of Multimodal Large Language Models (MLLMs) is crucial for advancing Artificial General Intelligence (AGI). However, existing benchmarks remain insufficient for rigorously assessing their reasoning capabilities under…

The digitization of traffic sensing infrastructure has significantly accumulated an extensive traffic data warehouse, which presents unprecedented challenges for transportation analytics. The complexities associated with querying…

Multiagent Systems · Computer Science 2024-05-07 Bingzhang Wang , Zhiyu Cai , Muhammad Monjurul Karim , Chenxi Liu , Yinhai Wang

Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck for large-scale deployment. To address this challenge, some works use LLMs and VLMs for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hao Shao , Letian Wang , Yang Zhou , Yuxuan Hu , Zhuofan Zong , Steven L. Waslander , Wei Zhan , Hongsheng Li

The rapidly evolving cloud platforms and the escalating complexity of network traffic demand proper network traffic monitoring and anomaly detection to ensure network security and performance. This paper introduces a large language model…

Networking and Internet Architecture · Computer Science 2025-04-28 Ze Yang , Yihong Jin , Juntian Liu , Xinhe Xu , Yihan Zhang , Shuyang Ji

Multimodal large language models (MLLMs) have achieved impressive progress in vision-language reasoning, yet their ability to understand temporally unfolding narratives in videos remains underexplored. True narrative understanding requires…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hyeonjeong Ha , Jinjin Ge , Bo Feng , Kaixin Ma , Gargi Chakraborty

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

Traffic Signal Control (TSC) is a crucial component in urban traffic management, aiming to optimize road network efficiency and reduce congestion. Traditional TSC methods, primarily based on transportation engineering and reinforcement…

Artificial Intelligence · Computer Science 2024-12-18 Siqi Lai , Zhao Xu , Weijia Zhang , Hao Liu , Hui Xiong

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Traffic prediction, an essential component for intelligent transportation systems, endeavours to use historical data to foresee future traffic features at specific locations. Although existing traffic prediction models often emphasize…

Machine Learning · Computer Science 2024-07-09 Chenxi Liu , Sun Yang , Qianxiong Xu , Zhishuai Li , Cheng Long , Ziyue Li , Rui Zhao

With enhanced capabilities and widespread applications, Multimodal Large Language Models (MLLMs) are increasingly required to process and reason over multiple images simultaneously. However, existing MLLM benchmarks focus either on…

Natural language processing (NLP) is a key component of intelligent transportation systems (ITS), but it faces many challenges in the transportation domain, such as domain-specific knowledge and data, and multi-modal inputs and outputs.…

Computation and Language · Computer Science 2024-02-13 Peng Wang , Xiang Wei , Fangxu Hu , Wenjuan Han

Multimodal large language models (MLLMs) have made significant progress in vision-language understanding, yet effectively aligning different modalities remains a fundamental challenge. We present a framework that unifies multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Wanpeng Zhang , Yicheng Feng , Hao Luo , Yijiang Li , Zihao Yue , Sipeng Zheng , Zongqing Lu

Roadway safety and mobility remain critical challenges for modern transportation systems, demanding innovative analytical frameworks capable of addressing complex, dynamic, and heterogeneous environments. While traditional engineering…

Artificial Intelligence · Computer Science 2025-12-10 Muhammad Monjurul Karim , Yan Shi , Shucheng Zhang , Bingzhang Wang , Mehrdad Nasri , Yinhai Wang

Network traffic includes data transmitted across a network, such as web browsing and file transfers, and is organized into packets (small units of data) and flows (sequences of packets exchanged between two endpoints). Classifying encrypted…

Cryptography and Security · Computer Science 2024-12-23 Xu-Yang Chen , Lu Han , De-Chuan Zhan , Han-Jia Ye

Traffic scene understanding from unmanned aerial vehicle (UAV) platforms is crucial for intelligent transportation systems due to its flexible deployment and wide-area monitoring capabilities. However, existing methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yu Zhang , Zhicheng Zhao , Ze Luo , Chenglong Li , Jin Tang

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

Computation and Language · Computer Science 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai