中文
相关论文

相关论文: Large Vision-Language Models for Remote Sensing Vi…

200 篇论文

The remote sensing community has recently seen the emergence of methods based on Large Vision and Language Models (LVLMs) that can address multiple tasks at the intersection of computer vision and natural language processing. To fully…

计算机视觉与模式识别 · 计算机科学 2025-12-18 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Vision language models can now generate long-form answers to questions about images - long-form visual question answers (LFVQA). We contribute VizWiz-LF, a dataset of long-form answers to visual questions posed by blind and low vision (BLV)…

计算与语言 · 计算机科学 2025-07-28 Mina Huh , Fangyuan Xu , Yi-Hao Peng , Chongyan Chen , Hansika Murugu , Danna Gurari , Eunsol Choi , Amy Pavel

With the rapid development of remote sensing image archives, asking questions about images has become an effective way of gathering specific information or performing semantic image retrieval. However, current automatically generated…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Siran Li , Li Mi , Javiera Castillo-Navarro , Devis Tuia

Inspired by the success of Large Language Models in dealing with new tasks via In-Context Learning (ICL) in NLP, researchers have also developed Large Vision-Language Models (LVLMs) with ICL capabilities. However, when implementing ICL…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Li Li , Jiawei Peng , Huiyi Chen , Chongyang Gao , Xu Yang

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their corresponding…

计算与语言 · 计算机科学 2024-10-16 Jingyuan Qi , Zhiyang Xu , Rulin Shao , Yang Chen , Jin Di , Yu Cheng , Qifan Wang , Lifu Huang

The global shortage of healthcare workers has demanded the development of smart healthcare assistants, which can help monitor and alert healthcare workers when necessary. We examine the healthcare knowledge of existing Large Vision Language…

计算与语言 · 计算机科学 2024-10-10 Sourjyadip Ray , Kushal Gupta , Soumi Kundu , Payal Arvind Kasat , Somak Aditya , Pawan Goyal

Large Vision-Language Models (LVLMs) have achieved strong performance on vision-language tasks, particularly Visual Question Answering (VQA). While prior work has explored unimodal biases in VQA, the problem of selection bias in…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Md. Atabuzzaman , Ali Asgarov , Chris Thomas

In high-stakes domains, small task-specific vision models are crucial due to their low computational requirements and the availability of numerous methods to explain their results. However, these explanations often reveal that the models do…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Alexander Koebler , Lukas Kuhn , Ingo Thon , Florian Buettner

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Recent advancements in dialogue systems have highlighted the significance of integrating multimodal responses, which enable conveying ideas through diverse modalities rather than solely relying on text-based interactions. This enrichment…

计算与语言 · 计算机科学 2024-07-08 Chang-Sheng Kao , Yun-Nung Chen

Medical Visual Question Answering (MedVQA) enables natural language queries over medical images to support clinical decision-making and patient care. The MEDIQA-WV 2025 shared task addressed wound-care VQA, requiring systems to generate…

计算与语言 · 计算机科学 2025-10-17 A H M Rezaul Karim , Ozlem Uzuner

Multi-modal Large Language Models (MLLMs) have introduced a novel dimension to document understanding, i.e., they endow large language models with visual comprehension capabilities; however, how to design a suitable image-text pre-training…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Zining Wang , Tongkun Guan , Pei Fu , Chen Duan , Qianyi Jiang , Zhentao Guo , Shan Guo , Junfeng Luo , Wei Shen , Xiaokang Yang

Large Vision Language Models (LVLMs) have demonstrated remarkable abilities in understanding and reasoning about both visual and textual information. However, existing evaluation methods for LVLMs, primarily based on benchmarks like Visual…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Xinyu Wang , Bohan Zhuang , Qi Wu

Retrieval-augmented generation (RAG) with large language models (LLMs) plays a crucial role in question answering, as LLMs possess limited knowledge and are not updated with continuously growing information. Most recent work on RAG has…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Shichao Kan , Yuhai Deng , Jiale Fu , Lihui Cen , Zhe Qu , Linna Zhang , Yixiong Liang , Yigang Cen

Vision-language models (VLMs) are emerging as powerful generalist tools for remote sensing, capable of integrating information across diverse tasks and enabling flexible, instruction-based interactions via a chat interface. In this work, we…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Aysim Toker , Andreea-Maria Oncescu , Roy Miles , Ismail Elezi , Jiankang Deng

Existing Multimodal Large Language Models (MLLMs) follow the paradigm that perceives visual information by aligning visual features with the input space of Large Language Models (LLMs), and concatenating visual tokens with text tokens to…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Feipeng Ma , Hongwei Xue , Guangting Wang , Yizhou Zhou , Fengyun Rao , Shilin Yan , Yueyi Zhang , Siying Wu , Mike Zheng Shou , Xiaoyan Sun

Large Vision-Language Models (LVLMs) have shown significant potential in assisting medical diagnosis by leveraging extensive biomedical datasets. However, the advancement of medical image understanding and reasoning critically depends on…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Guohao Sun , Can Qin , Huazhu Fu , Linwei Wang , Zhiqiang Tao

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Vision-language models (VLMs) have made significant progress in recent visual-question-answering (VQA) benchmarks that evaluate complex visio-linguistic reasoning. However, are these models truly effective? In this work, we show that VLMs…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Baiqi Li , Zhiqiu Lin , Wenxuan Peng , Jean de Dieu Nyandwi , Daniel Jiang , Zixian Ma , Simran Khanuja , Ranjay Krishna , Graham Neubig , Deva Ramanan

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala