English
Related papers

Related papers: Vision-Language Reasoning for Geolocalization: A R…

200 papers

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for multimodal large language models (MLLMs) have mainly focused on improving final answer correctness and strengthening visual grounding. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jinda Lu , Junkang Wu , Jinghan Li , Kexin Huang , Shuo Yang , Mingzhu Chen , Jiancan Wu , Kuien Liu , Xiang Wang

Spatial reasoning remains a critical yet underdeveloped capability in existing vision-language models (VLMs), especially for Spatial Visual Question Answering (Spatial VQA) tasks that require understanding relative positions, distances, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peiyao Wang , Haibin Ling

Interpreting ultra-high-resolution (UHR) remote sensing images requires models to search for sparse and tiny visual evidence across large-scale scenes. Existing remote sensing vision-language models can inspect local regions with zooming…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiashun Zhu , Ronghao Fu , Jiasen Hu , Nachuan Xing , Xu Na , Xiao Yang , Zhiwen Lin , Weipeng Zhang , Lang Sun , Zhiheng Xue , Haoran Liu , Weijie Zhang , Bo Yang

Multimodal large language models (MLLMs) have undergone rapid development in advancing geospatial scene understanding. Recent studies have sought to enhance the reasoning capabilities of remote sensing MLLMs, typically through cold-start…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Di Wang , Shunyu Liu , Wentao Jiang , Fengxiang Wang , Yi Liu , Xiaolei Qin , Zhiming Luo , Chaoyang Zhou , Haonan Guo , Jing Zhang , Bo Du , Dacheng Tao , Liangpei Zhang

Reinforcement learning with verifiable rewards (RLVR) succeeds in reasoning tasks (e.g., math and code) by checking the final verifiable answer (i.e., a verifiable dot signal). However, extending this paradigm to open-ended generation is…

Computation and Language · Computer Science 2026-01-27 Yuxin Jiang , Yufei Wang , Qiyuan Zhang , Xingshan Zeng , Liangyou Li , Jierun Chen , Chaofan Tao , Haoli Bai , Lifeng Shang

Recent studies have extended the application of large language models (LLMs) to geographic problems, revealing surprising geospatial competence even without explicit spatial supervision. However, LLMs still face challenges in spatial…

Artificial Intelligence · Computer Science 2025-08-07 Jinfan Tang , Kunming Wu , Ruifeng Gongxie , Yuya He , Yuankai Wu

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Generalization is a pivotal challenge for agents following natural language instructions. To approach this goal, we leverage a vision-language model (VLM) for visual grounding and transfer its vision-language knowledge into reinforcement…

Artificial Intelligence · Computer Science 2024-08-06 Haobin Jiang , Zongqing Lu

The proliferation of remote sensing satellites has resulted in a massive amount of remote sensing images. However, due to human and material resource constraints, the vast majority of remote sensing images remain unlabeled. As a result, it…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Wenyuan Li , Keyan Chen , Hao Chen , Zhenwei Shi

Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the cost of tool calls or rely on localized patch-based embeddings that are insufficient to…

Computation and Language · Computer Science 2026-04-10 Mengdan Zhu , Senhao Cheng , Liang Zhao

In low- and middle-income countries, public safety and urban planning initiatives frequently face a critical shortage of accurate, location-specific road crash data. Extracting reliable geospatial information from unstructured text requires…

Artificial Intelligence · Computer Science 2026-05-19 MD Thamed Bin Zaman Chowdhury , Moazzem Hossain

Geolocation is now a vital aspect of modern life, offering numerous benefits but also presenting serious privacy concerns. The advent of large vision-language models (LVLMs) with advanced image-processing capabilities introduces new risks,…

Cryptography and Security · Computer Science 2024-08-20 Yi Liu , Junchen Ding , Gelei Deng , Yuekang Li , Tianwei Zhang , Weisong Sun , Yaowen Zheng , Jingquan Ge , Yang Liu

We propose a new spatial memory module and a spatial reasoner for the Visual Grounding (VG) task. The goal of this task is to find a certain object in an image based on a given textual query. Our work focuses on integrating the regions of a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Thierry Deruyttere , Guillem Collell , Marie-Francine Moens

The choice of representation for geographic location significantly impacts the accuracy of models for a broad range of geospatial tasks, including fine-grained species classification, population density estimation, and biome classification.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Aayush Dhakal , Srikumar Sastry , Subash Khanal , Adeel Ahmad , Eric Xing , Nathan Jacobs

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

The interpretation of spatial references is highly contextual, requiring joint inference over both language and the environment. We consider the task of spatial reasoning in a simulated environment, where an agent can act and receive…

Computation and Language · Computer Science 2017-11-15 Michael Janner , Karthik Narasimhan , Regina Barzilay

Generative retrieval (GR) is an emerging paradigm that leverages large language models (LLMs) to autoregressively generate document identifiers (docids) relevant to a given query. Prior works have focused on leveraging the generative…

Information Retrieval · Computer Science 2025-10-22 Yingchen Zhang , Ruqing Zhang , Jiafeng Guo , Wenjun Peng , Sen Li , Fuyu Lv

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Rapid urbanization intensifies the demand for Urban General Intelligence (UGI), referring to AI systems that can understand and reason about complex urban environments. Recent studies have built urban foundation models using supervised…

Artificial Intelligence · Computer Science 2025-10-21 Qiongyan Wang , Xingchen Zou , Yutian Jiang , Haomin Wen , Jiaheng Wei , Qingsong Wen , Yuxuan Liang