English
Related papers

Related papers: ST-LINK: Spatially-Aware Large Language Models for…

200 papers

Multimodal Large Language Models (MLLMs) have demonstrated impressive performance in general vision-language tasks. However, recent studies have exposed critical limitations in their spatial reasoning capabilities. This deficiency in…

Machine Learning · Computer Science 2025-06-04 Huanyu Zhang , Chengzu Li , Wenshan Wu , Shaoguang Mao , Yifan Zhang , Haochen Tian , Ivan Vulić , Zhang Zhang , Liang Wang , Tieniu Tan , Furu Wei

Large language models (LLMs) show remarkable capabilities across a variety of tasks. Despite the models only seeing text in training, several recent studies suggest that LLM representations implicitly capture aspects of the underlying…

Computation and Language · Computer Science 2024-04-16 Yutaro Yamada , Yihan Bao , Andrew K. Lampinen , Jungo Kasai , Ilker Yildirim

Spatial reasoning is a cornerstone capability for intelligent systems to perceive and interact with the physical world. However, multimodal large language models (MLLMs) frequently suffer from hallucinations and imprecision when parsing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shi-Yu Tian , Zhi Zhou , Kun-Yang Yu , Ming Yang , Yang Chen , Ziqiao Shang , Lan-Zhe Guo , Yu-Feng Li

The growth in the number of parameters of Large Language Models (LLMs) has led to a significant surge in computational requirements, making them challenging and costly to deploy. Speculative decoding (SD) leverages smaller models to…

Computation and Language · Computer Science 2025-04-04 Matthieu Zimmer , Milan Gritta , Gerasimos Lampouras , Haitham Bou Ammar , Jun Wang

In recent years, advancements in deep learning have spurred the development of numerous models for Long-term Time Series Forecasting (LTSF). However, most existing approaches struggle to fully capture the complex and structured dependencies…

Machine Learning · Computer Science 2025-06-04 Zixuan Weng , Jindong Han , Wenzhao Jiang , Hao Liu

Multimodal Large Language Models (MLLMs) struggle with continual learning, often suffering from catastrophic forgetting when adapting to sequential tasks. We introduce a routing-based architecture that integrates new capabilities while…

Machine Learning · Computer Science 2026-04-08 Jay Mohta , Kenan Emir Ak , Gwang Lee , Dimitrios Dimitriadis , Yan Xu , Mingwei Shen

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

The growing demand for real-time, safety-critical systems has significantly increased both the adoption and complexity of Time Sensitive Networking (TSN). Configuring an optimized TSN network is highly challenging, requiring careful…

Networking and Internet Architecture · Computer Science 2025-10-02 Rubi Debnath , Luxi Zhao , Mohammadreza Barzegaran , Sebastian Steinhorst

Large Language Model (LLM) agents deployed in complex real-world scenarios increasingly operate as spatially distributed entities. However, this physical dispersion constrains agents to limited local perception and finite temporal horizons.…

Multiagent Systems · Computer Science 2026-03-18 Handi Chen , Running Zhao , Xiuzhe Wu , Edith C. H. Ngai

Current evaluation paradigms for large language models (LLMs) represent a critical blind spot in AI research--relying on opaque numerical metrics that conceal fundamental limitations in spatial reasoning while providing no intuitive…

Computation and Language · Computer Science 2025-11-05 Liuhao Lin , Ke Li , Zihan Xu , Yuchen Shi , Yulei Qin , Yan Zhang , Xing Sun , Rongrong Ji

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Retrieval and recommendation are two essential tasks in modern search tools. This paper introduces a novel retrieval-reranking framework leveraging Large Language Models (LLMs) to enhance the spatiotemporal and semantic associated mining…

Information Retrieval · Computer Science 2024-11-21 Yuanyuan Tian , Wenwen Li , Lei Hu , Xiao Chen , Michael Brook , Michael Brubaker , Fan Zhang , Anna K. Liljedahl

Short-term passenger demand forecasting is of great importance to the on-demand ride service platform, which can incentivize vacant cars moving from over-supply regions to over-demand regions. The spatial dependences, temporal dependences,…

Machine Learning · Computer Science 2018-02-13 Jintao Ke , Hongyu Zheng , Hai Yang , Xiqun , Chen

Spatial relation reasoning is a crucial task for multimodal large language models (MLLMs) to understand the objective world. However, current benchmarks have issues like relying on bounding boxes, ignoring perspective substitutions, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jingping Liu , Ziyan Liu , Zhedong Cen , Yan Zhou , Yinan Zou , Weiyan Zhang , Haiyun Jiang , Tong Ruan

Traffic Signal Control (TSC) plays a critical role in urban traffic management by optimizing traffic flow and mitigating congestion. While Large Language Models (LLMs) have recently emerged as promising tools for TSC due to their…

Machine Learning · Computer Science 2025-03-18 Zirui Yuan , Siqi Lai , Hao Liu

Mobility Foundation Models (MFMs) have advanced the modeling of human movement patterns, yet they face a ceiling due to limitations in data scale and semantic understanding. While Large Language Models (LLMs) offer powerful semantic…

Machine Learning · Computer Science 2026-04-14 Fanjin Meng , Yuan Yuan , Jingtao Ding , Jie Feng , Chonghua Han , Yong Li

Accurate Traffic Prediction is a challenging task in intelligent transportation due to the spatial-temporal aspects of road networks. The traffic of a road network can be affected by long-distance or long-term dependencies where existing…

Machine Learning · Computer Science 2024-04-10 Zhengyang Zhao , Haitao Yuan , Nan Jiang , Minxiao Chen , Ning Liu , Zengxiang Li

As a core technology of Intelligent Transportation System (ITS), traffic flow prediction has a wide range of applications. Traffic flow data are spatial-temporal, which are not only correlated to spatial locations in road networks, but also…

Artificial Intelligence · Computer Science 2024-12-24 Xiao Xu , Lei Zhang , Bailong Liu , Zhizhen Liang , Xuefei Zhang

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Current multimodal large language models (MLLMs) still face significant challenges in complex visual tasks (e.g., spatial understanding, fine-grained perception). Prior methods have tried to incorporate visual reasoning, however, they fail…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhangquan Chen , Ruihui Zhao , Chuwei Luo , Mingze Sun , Xinlei Yu , Yangyang Kang , Ruqi Huang