English
Related papers

Related papers: Spatial Language Representation with Multi-Level G…

200 papers

3D visual grounding aims to localize the unique target described by natural languages in 3D scenes. The significant gap between 3D and language modalities makes it a notable challenge to distinguish multiple similar objects through the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Feng Xiao , Hongbin Xu , Guocan Zhao , Wenxiong Kang

Accurately reconstructing road surfaces is pivotal for various applications especially in autonomous driving. This paper introduces a position encoding Multi-Layer Perceptrons (MLPs) framework to reconstruct road surfaces, with input as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Ruibo Wang , Song Zhang , Ping Huang , Donghai Zhang , Haoyu Chen

Hierarchical multi-label classification (HMLC) is essential for modeling structured label dependencies in remote sensing. Yet existing approaches struggle in multi-path settings, where images may activate multiple taxonomic branches,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Boshko Koloski , Marjan Stoimchev , Jurica Levatić , Dragi Kocev , Sašo Džeroski

Understanding the latent space geometry of large language models (LLMs) is key to interpreting their behavior and improving alignment. Yet it remains unclear to what extent LLMs linearly organize representations related to semantic…

Computation and Language · Computer Science 2026-01-22 Baturay Saglam , Paul Kassianik , Blaine Nelson , Sajana Weerawardhena , Yaron Singer , Amin Karbasi

Large Language Models (LLM) have emerged as a tool for robots to generate task plans using common sense reasoning. For the LLM to generate actionable plans, scene context must be provided, often through a map. Recent works have shifted from…

Robotics · Computer Science 2024-09-25 Mike Zhang , Kaixian Qu , Vaishakh Patil , Cesar Cadena , Marco Hutter

Agricultural landscape segmentation in the Global South is challenging as it is characterized by fragmented plots, high intra-class variance, and a scarcity of labeled training data. Recent advances in segmentation have been made by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Piyush Tiwary , Utkarsh Ahuja , Depanshu Sani , Aishwarya Jayagopal , Sagar Gubbi , Subhashini Venugopalan , Alok Talekar , Vaibhav Rajan

LLMs are increasingly used to support qualitative research, yet existing systems produce outputs that vary widely--from trace-faithful summaries to theory-mediated explanations and system models. To make these differences explicit, we…

Computation and Language · Computer Science 2026-01-21 Xinyu Pi , Qisen Yang , Chuong Nguyen , Hua Shen

This paper proposes ReaGeo, an end-to-end geocoding framework based on large language models, designed to overcome the limitations of traditional multi-stage approaches that rely on text or vector similarity retrieval over geographic…

Artificial Intelligence · Computer Science 2026-04-24 Jian Cui , Zhiyuan Ren , Desheng Weng , Yongqi Zhao , Gong Wenbin , Yu Lei , Zhenning Dong

We present Multi-Scale Manifold Alignment(MSMA), an information-geometric framework that decomposes LLM representations into local, intermediate, and global manifolds and learns cross-scale mappings that preserve geometry and information.…

Computation and Language · Computer Science 2025-10-14 Yukun Zhang , Qi Dong

Multi-modal large language models (MLLMs) have rapidly advanced in visual tasks, yet their spatial understanding remains limited to single images, leaving them ill-suited for physical-world applications that require multi-frame reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runsen Xu , Weiyao Wang , Hao Tang , Xingyu Chen , Xiaodong Wang , Fu-Jen Chu , Matt Feiszli , Kevin J. Liang

Natural-language Guided Cross-view Geo-localization (NGCG) aims to retrieve geo-tagged satellite imagery using textual descriptions of ground scenes. While recent NGCG methods commonly rely on CLIP-style dual-encoder architectures, they…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqi Chen , Xiaohan Zhang , Ahmad Arrabi , Waqas Sultani , Chen Chen , Safwan Wshah

Large Language Models (LLMs) have demonstrated unprecedented capabilities across various natural language processing tasks. Their ability to process and generate viable text and code has made them ubiquitous in many fields, while their…

Machine Learning · Computer Science 2025-05-13 Stef De Sabbata , Stefano Mizzaro , Kevin Roitero

Variation in spatial categorization across languages is often studied by eliciting human labels for the relations depicted in a set of scenes known as the Topological Relations Picture Series (TRPS). We demonstrate that labels generated by…

Computation and Language · Computer Science 2026-03-11 Wanchun Li , Alexandra Carstensen , Yang Xu , Terry Regier , Charles Kemp

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but continue to struggle with geometric reasoning, primarily due to the perception bottleneck regarding fine-grained visual elements. While formal languages have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Peijie Wang , Ming-Liang Zhang , Jun Cao , Chao Deng , Dekang Ran , Hongda Sun , Pi Bu , Xuan Zhang , Yingyao Wang , Jun Song , Bo Zheng , Fei Yin , Cheng-Lin Liu

Heterogeneous graph neural networks (HGNNs) excel at capturing structural and semantic information in heterogeneous graphs (HGs), while struggling to generalize across domains and tasks. With the rapid advancement of large language models…

Social and Information Networks · Computer Science 2025-07-31 Jinyu Yang , Cheng Yang , Shanyuan Cui , Zeyuan Guo , Liangwei Yang , Muhan Zhang , Zhiqiang Zhang , Chuan Shi

Recent advances in cellular research demonstrate that scRNA-seq characterizes cellular heterogeneity, while spatial transcriptomics reveals the spatial distribution of gene expression. Cell representation is the fundamental issue in the two…

Genomics · Quantitative Biology 2025-01-16 Kai Zheng , Shaokai Wang , Yunpei Xu , Qiming Lei , Qichang Zhao , Xiao Liang , Qilong Feng , Yaohang Li , Min Li , Jinhui Xu , Jianxin Wang

Systems which incrementally create 3D semantic maps from image sequences must store and update representations of both geometry and semantic entities. However, while there has been much work on the correct formulation for geometrical…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Shuaifeng Zhi , Michael Bloesch , Stefan Leutenegger , Andrew J. Davison

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

Artificial Intelligence · Computer Science 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

Our method for multi-lingual geoparsing uses monolingual tools and resources along with machine translation and alignment to return location words in many languages. Not only does our method save the time and cost of developing geoparsers…

Computation and Language · Computer Science 2015-11-09 Xu Chen , Han Zhang , Judith Gelernter

Multilingual language models (LMs) organize representations for typologically and orthographically diverse languages into a shared parameter space, yet the nature of this internal organization remains elusive. In this work, we investigate…

Computation and Language · Computer Science 2026-04-22 Aastha A K Verma , Anwoy Chatterjee , Mehak Gupta , Tanmoy Chakraborty