English
Related papers

Related papers: Inherent limitations of LLMs regarding spatial inf…

200 papers

Current evaluation paradigms for large language models (LLMs) represent a critical blind spot in AI research--relying on opaque numerical metrics that conceal fundamental limitations in spatial reasoning while providing no intuitive…

Computation and Language · Computer Science 2025-11-05 Liuhao Lin , Ke Li , Zihan Xu , Yuchen Shi , Yulei Qin , Yan Zhang , Xing Sun , Rongrong Ji

Humans naturally understand 3D spatial relationships, enabling complex reasoning like predicting collisions of vehicles from different directions. Current large multimodal models (LMMs), however, lack of this capability of 3D spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wufei Ma , Luoxin Ye , Celso M de Melo , Jieneng Chen , Alan Yuille

This paper investigates the novel application of Large Language Models (LLMs) with vision capabilities to analyze satellite imagery for village-level poverty prediction. Although LLMs were originally designed for natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Hamid Sarmadi , Ola Hall , Thorsteinn Rögnvaldsson , Mattias Ohlsson

This paper proposes a framework for quantitatively evaluating interactive LLMs such as ChatGPT using publicly available data sets. We carry out an extensive technical evaluation of ChatGPT using 23 data sets covering 8 different common NLP…

Computation and Language · Computer Science 2023-11-29 Yejin Bang , Samuel Cahyawijaya , Nayeon Lee , Wenliang Dai , Dan Su , Bryan Wilie , Holy Lovenia , Ziwei Ji , Tiezheng Yu , Willy Chung , Quyet V. Do , Yan Xu , Pascale Fung

Since the advent of ChatGPT, Large Language Models (LLMs) have excelled in various tasks but remain as black-box systems. Understanding the reasoning bottlenecks of LLMs has become a critical challenge, as these limitations are deeply tied…

Computation and Language · Computer Science 2024-12-24 Zifan Zheng , Yezhaohui Wang , Yuxin Huang , Shichao Song , Mingchuan Yang , Bo Tang , Feiyu Xiong , Zhiyu Li

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

Artificial Intelligence · Computer Science 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: (1) the inflexibility of…

Computation and Language · Computer Science 2023-09-20 Yucheng Shi , Hehuan Ma , Wenliang Zhong , Qiaoyu Tan , Gengchen Mai , Xiang Li , Tianming Liu , Junzhou Huang

ChatGPT and other state-of-the-art large language models (LLMs) are rapidly transforming multiple fields, offering powerful tools for a wide range of applications. These models, commonly trained on vast datasets, exhibit human-like text…

Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code and mathematics. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates…

Computation and Language · Computer Science 2025-05-28 Sirui Xia , Aili Chen , Xintao Wang , Tinghui Zhu , Yikai Zhang , Jiangjie Chen , Yanghua Xiao

Artificial intelligence (AI) has made remarkable progress across various domains, with large language models like ChatGPT gaining substantial attention for their human-like text-generation capabilities. Despite these achievements, spatial…

Artificial Intelligence · Computer Science 2024-01-11 Fangjun Li , David C. Hogg , Anthony G. Cohn

Vision language models (VLMs) are an exciting emerging class of language models (LMs) that have merged classic LM capabilities with those of image processing systems. However, the ways that these capabilities combine are not always…

Computation and Language · Computer Science 2024-07-03 Qiucheng Wu , Handong Zhao , Michael Saxon , Trung Bui , William Yang Wang , Yang Zhang , Shiyu Chang

3D spatial understanding is essential in real-world applications such as robotics, autonomous vehicles, virtual reality, and medical imaging. Recently, Large Language Models (LLMs), having demonstrated remarkable success across various…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jirong Zha , Yuxuan Fan , Xiao Yang , Chen Gao , Xinlei Chen

Large language models (LLMs) and vision language models (VLMs), such as DeepSeek R1,OpenAI o3, and Gemini 2.5 Pro, have demonstrated remarkable reasoning capabilities across logical inference, problem solving, and decision making. However,…

Artificial Intelligence · Computer Science 2025-11-19 Xiaoxing Lian , Aidong Yang , Jun Zhu , Peng Wang , Yue Zhang

Large Language Models (LLMs) have demonstrated unprecedented capabilities across various natural language processing tasks. Their ability to process and generate viable text and code has made them ubiquitous in many fields, while their…

Machine Learning · Computer Science 2025-05-13 Stef De Sabbata , Stefano Mizzaro , Kevin Roitero

We explore the application of large language models (LLMs) to empower domain experts in integrating large, heterogeneous, and noisy urban spatial datasets. Traditional rule-based integration methods are unable to cover all edge cases,…

Artificial Intelligence · Computer Science 2025-08-08 Bin Han , Robert Wolfe , Anat Caspi , Bill Howe

Large language models, pivotal in artificial intelligence, find diverse applications. ChatGPT (Chat Generative Pre-trained Transformer), an OpenAI creation, stands out as a widely adopted, powerful tool. It excels in chatbots, content…

Computation and Language · Computer Science 2025-05-28 Walid Hariri

Large Language Models (LLMs) such as GPT-4, trained on huge amount of datasets spanning multiple domains, exhibit significant reasoning, understanding, and planning capabilities across various tasks. This study presents the first-ever work…

Computation and Language · Computer Science 2025-06-18 Malak Mansour , Ahmed Aly , Bahey Tharwat , Sarim Hashmi , Dong An , Ian Reid

Despite the impressive performance of Large Language Models (LLM) for various natural language processing tasks, little is known about their comprehension of geographic data and related ability to facilitate informed geospatial…

Computation and Language · Computer Science 2023-10-23 Prabin Bhandari , Antonios Anastasopoulos , Dieter Pfoser

Large Language Models (LLMs) like ChatGPT have demonstrated amazing capabilities in comprehending user intents and generate reasonable and useful responses. Beside their ability to chat, their capabilities in various natural language…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu

Over the last few years, large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) that fundamentally transform research and developments in the field. ChatGPT represents one of the…

Computation and Language · Computer Science 2023-04-13 Viet Dac Lai , Nghia Trung Ngo , Amir Pouran Ben Veyseh , Hieu Man , Franck Dernoncourt , Trung Bui , Thien Huu Nguyen