English
Related papers

Related papers: Turning Generators into Retrievers: Unlocking MLLM…

200 papers

The recent advancements in generative language models have demonstrated their ability to memorize knowledge from documents and recall knowledge to respond to user queries effectively. Building upon this capability, we propose to enable…

Multimedia · Computer Science 2024-02-19 Yongqi Li , Wenjie Wang , Leigang Qu , Liqiang Nie , Wenjie Li , Tat-Seng Chua

Recent advances in Multimodal Large Language Models (MLLMs) have achieved remarkable progress in general domains and demonstrated promise in multimodal mathematical reasoning. However, applying MLLMs to geometry problem solving (GPS)…

Computation and Language · Computer Science 2025-04-18 Yicheng Pan , Zhenrong Zhang , Pengfei Hu , Jiefeng Ma , Jun Du , Jianshu Zhang , Quan Liu , Jianqing Gao , Feng Ma

Large Language Models(LLMs) have revolutionized text generation and multimodal perception,but their capabilities in 3D content generation remain underexplored. Existing methods compromise by producing either low-resolution meshes or coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Junming Huang , Chi Wang , Letian Li , Guangkai Xu , Donglin Huang , Hao Chen , Qiang Dai , Weiwei Xu

Multimodal large language models (MLLMs) have achieved significant progress in image and language tasks due to the strong reasoning capability of large language models (LLMs). Nevertheless, most MLLMs suffer from limited spatial reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiajie Guo , Qingpeng Zhu , Jin Zeng , Xiaolong Wu , Changyong He , Weida Wang

The rapid advancement of multimodal large language models (LLMs) has opened new frontiers in artificial intelligence, enabling the integration of diverse large-scale data types such as text, images, and spatial information. In this paper,…

Artificial Intelligence · Computer Science 2025-03-21 Long Yuan , Fengran Mo , Kaiyu Huang , Wenjie Wang , Wangyuxuan Zhai , Xiaoyu Zhu , You Li , Jinan Xu , Jian-Yun Nie

Street-level geolocalization from images is crucial for a wide range of essential applications and services, such as navigation, location-based recommendations, and urban planning. With the growing popularity of social media data and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yunus Serhat Bicakci , Joseph Shingleton , Anahid Basiri

Cross-View Geo-Localization (CVGL) focuses on identifying correspondences between images captured from distinct perspectives of the same geographical location. However, existing CVGL approaches are typically restricted to a single view or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xudong Lu , Zhi Zheng , Yi Wan , Yongxiang Yao , Annan Wang , Renrui Zhang , Panwang Xia , Qiong Wu , Qingyun Li , Weifeng Lin , Xiangyu Zhao , Peifeng Ma , Xue Yang , Hongsheng Li

Multimodal Large Language Models (MLLMs) have demonstrated strong cross-modal reasoning capabilities, yet their potential for vision-only tasks remains underexplored. We investigate MLLMs as training-free similarity estimators for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Bahey Tharwat , Giorgos Kordopatis-Zilos , Pavel Suma , Ian Reid , Giorgos Tolias

Language-guided grasping has emerged as a promising paradigm for enabling robots to identify and manipulate target objects through natural language instructions, yet it remains highly challenging in cluttered or occluded scenes. Existing…

Robotics · Computer Science 2026-02-05 Rui Tang , Guankun Wang , Long Bai , Huxin Gao , Jiewen Lai , Chi Kit Ng , Jiazheng Wang , Fan Zhang , Hongliang Ren

Multi-modal large language models (MLLMs) have demonstrated remarkable success in vision and visual-language tasks within the natural image domain. Owing to the significant diversities between the natural and remote sensing (RS) images, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Wei Zhang , Miaoxin Cai , Tong Zhang , Yin Zhuang , Xuerui Mao

The integration of advanced Natural Language Processing (NLP) methodologies and Large Language Models (LLMs) has significantly enhanced the extraction and analysis of geospatial data from multilingual texts, impacting sectors such as…

Computation and Language · Computer Science 2024-12-31 Kalin Kopanov

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

This paper proposes MapGPT which is a novel approach that integrates the capabilities of language models, specifically large language models (LLMs), with spatial data processing techniques. This paper introduces MapGPT, which aims to bridge…

Artificial Intelligence · Computer Science 2023-10-19 Ashley Fernandez , Swaraj Dube

With the advancement of remote sensing satellite technology and the rapid progress of deep learning, remote sensing change detection (RSCD) has become a key technique for regional monitoring. Traditional change detection (CD) methods and…

Image and Video Processing · Electrical Eng. & Systems 2026-03-11 Chengming Wang , Guodong Fan , Jinjiang Li , Min Gan , C. L. Philip Chen

Despite the remarkable success of multimodal large language models (MLLMs) in generative tasks, we observe that they exhibit a counterintuitive deficiency in the zero-shot multimodal retrieval task. In this work, we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hengyi Feng , Zeang Sheng , Meiyi Qiang , Yang Li , Wentao Zhang

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

Generative cross-modal retrieval, which treats retrieval as a generation task, has emerged as a promising direction with the rise of Multimodal Large Language Models (MLLMs). In this setting, the model responds to a text query by generating…

Information Retrieval · Computer Science 2025-11-04 Tianyuan Li , Lei Wang , Ahtamjan Ahmat , Yating Yang , Bo Ma , Rui Dong , Bangju Han

Objectives: The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly enhanced their reasoning capabilities, enabling a wide range of intelligent applications. However, these advancements also raise critical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Xian Zhang , Xiang Cheng

Geolocation is a fundamental component of route planning and navigation for unmanned vehicles, but GNSS-based geolocation fails under denial-of-service conditions. Cross-view geo-localization (CVGL), which aims to estimate the geographical…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Jianwei Zhao , Qiang Zhai , Pengbo Zhao , Rui Huang , Hong Cheng

Multimodal Large Language Models (MLLMs) demonstrate exceptional semantic reasoning but struggle with 3D spatial perception when restricted to pure RGB inputs. Despite leveraging implicit geometric priors from 3D reconstruction models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiaxin Zhang , Junjun Jiang , Haijie Li , Youyu Chen , Kui Jiang , Dave Zhenyu Chen
‹ Prev 1 2 3 10 Next ›