English
Related papers

Related papers: Vision-Language Reasoning for Geolocalization: A R…

200 papers

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Tables present unique challenges for language models due to their structured row-column interactions, necessitating specialized approaches for effective comprehension. While large language models (LLMs) have demonstrated potential in table…

Computation and Language · Computer Science 2026-05-14 Zhenhe Wu , Jian Yang , Zhongjiang He , Changzai Pan , Jie Zhang , Jiaheng Liu , Xianjie Wu , Yu Zhao , Shuangyong Song , Yongxiang Li , Zhoujun Li , Xueling Li

We propose a new, training-free method, Graph Reasoning via Retrieval Augmented Framework (GRRAF), that harnesses retrieval-augmented generation (RAG) alongside the code-generation capabilities of large language models (LLMs) to address a…

Artificial Intelligence · Computer Science 2025-09-17 Hanqing Li , Kiran Sheena Jyothi , Henry Liang , Sharika Mahadevan , Diego Klabjan

Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentially reinforcing flawed traces that get correct answers by chance. We observe that better…

Machine Learning · Computer Science 2026-03-11 Tiehua Mei , Minxuan Lv , Leiyu Pan , Zhenpeng Su , Hongru Hou , Hengrui Chen , Ao Xu , Deqing Yang

LiDAR relocalization has attracted increasing attention as it can deliver accurate 6-DoF pose estimation in complex 3D environments. Recent learning-based regression methods offer efficient solutions by directly predicting global poses…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jianshi Wu , Minghang Zhu , Dunqiang Liu , Wen Li , Sheng Ao , Siqi Shen , Chenglu Wen , Cheng Wang

GUI grounding aims to align natural language instructions with precise regions in complex user interfaces. Advanced multimodal large language models show strong ability in visual GUI grounding but still struggle with small or visually…

Artificial Intelligence · Computer Science 2025-12-02 Aiden Yiliu Li , Bizhi Yu , Daoan Lei , Tianhe Ren , Shilong Liu

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

Computation and Language · Computer Science 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Existing visual localization methods are typically either 2D image-based, which are easy to build and maintain but limited in effective geometric reasoning, or 3D structure-based, which achieve high accuracy but require a centralized…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Xudong Jiang , Fangjinhua Wang , Silvano Galliani , Christoph Vogel , Marc Pollefeys

Robust visual localization under a wide range of viewing conditions is a fundamental problem in computer vision. Handling the difficult cases of this problem is not only very challenging but also of high practical relevance, e.g., in the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Johannes L. Schönberger , Marc Pollefeys , Andreas Geiger , Torsten Sattler

Video-based spatial reasoning -- such as estimating distances, judging directions, or understanding layouts from multiple views -- requires selecting informative frames and, when needed, actively seeking additional viewpoints during…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jiaxu Wan , Xu Wang , Mengwei Xie , Hang Zhang , Mu Xu , Yang Han , Hong Zhang , Ding Yuan , Yifan Yang

Visual reasoning, particularly spatial reasoning, is a challenging cognitive task that requires understanding object relationships and their interactions within complex environments, especially in robotics domain. Existing vision_language…

Robotics · Computer Science 2025-11-03 Simindokht Jahangard , Mehrzad Mohammadi , Abhinav Dhall , Hamid Rezatofighi

Planet-scale photo geolocalization is the complex task of estimating the location depicted in an image solely based on its visual content. Due to the success of convolutional neural networks (CNNs), current approaches achieve super-human…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Jonas Theiner , Eric Mueller-Budack , Ralph Ewerth

Reasoning-centric video object segmentation is an inherently complex task: the query often refers to dynamics, causality, and temporal interactions, rather than static appearances. Yet existing solutions generally collapse these factors…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifan Li , Yingda Yin , Lingting Zhu , Weikai Chen , Shengju Qian , Xin Wang , Yanwei Fu

Many problems can be viewed as forms of geospatial search aided by aerial imagery, with examples ranging from detecting poaching activity to human trafficking. We model this class of problems in a visual active search (VAS) framework, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Anindya Sarkar , Michael Lanier , Scott Alfeld , Jiarui Feng , Roman Garnett , Nathan Jacobs , Yevgeniy Vorobeychik

Despite rapid progress, pretrained vision-language models still struggle when answers depend on tiny visual details or on combining clues spread across multiple regions, as in documents and compositional queries. We address this by framing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Marcel Gröpl , Jaewoo Jung , Seungryong Kim , Marc Pollefeys , Sunghwan Hong

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Neuro-symbolic reinforcement learning (NS-RL) has emerged as a promising paradigm for explainable decision-making, characterized by the interpretability of symbolic policies. NS-RL entails structured state representations for tasks with…

Artificial Intelligence · Computer Science 2024-06-14 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

We propose an end-to-end approach to the natural language object retrieval task, which localizes an object within an image according to a natural language description, i.e., referring expression. Previous works divide this problem into two…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Fan Wu , Zhongwen Xu , Yi Yang

Vision-language models benefit from high-resolution images, but the increase in visual-token count incurs high compute overhead. Humans resolve this tension via foveation: a coarse view guides "where to look", while selectively acquired…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Juhong Min , Lazar Valkov , Vitali Petsiuk , Hossein Souri , Deen Dayal Mohan

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu