中文
相关论文

相关论文: Medico 2025: Visual Question Answering for Gastroi…

200 篇论文

The remarkable success of deep learning has prompted interest in its application to medical imaging diagnosis. Even though state-of-the-art deep learning models have achieved human-level accuracy on the classification of different types of…

图像与视频处理 · 电气工程与系统科学 2023-09-20 Cristiano Patrício , João C. Neves , Luís F. Teixeira

The intersection of medical Visual Question Answering (Med-VQA) is a challenging research topic with advantages including patient engagement and clinical expert involvement for second opinions. However, existing Med-VQA methods based on…

机器学习 · 计算机科学 2024-06-24 Lin Fan , Xun Gong , Cenyang Zheng , Yafei Ou

Medical Visual Question Answering (MedVQA) is a promising tool to assist radiologists by automating medical image interpretation through question answering. Despite advances in models and datasets, MedVQA's integration into clinical…

计算与语言 · 计算机科学 2025-07-15 Deepali Mishra , Chaklam Silpasuwanchai , Ashutosh Modi , Madhumita Sushil , Sorayouth Chumnanvej

Medical vision-language models (VLMs) and AI agents have made significant progress in learning to analyze and reason about clinical images. However, existing medical visual question answering (VQA) benchmarks collapse model capabilities…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Yixiong Chen , Wenjie Xiao , Pedro R. A. S. Bassi , Boyan Wang , Liang He , Xinze Zhou , Sezgin Er , Ibrahim Ethem Hamamci , Zongwei Zhou , Alan Yuille

Multimodal/vision language models (VLMs) are increasingly being deployed in healthcare settings worldwide, necessitating robust benchmarks to ensure their safety, efficacy, and fairness. Multiple-choice question and answer (QA) datasets…

Visual Question Answering in Medical domain (VQA-Med) plays an important role in providing medical assistance to the end-users. These users are expected to raise either a straightforward question with a Yes/No answer or a challenging…

计算与语言 · 计算机科学 2020-09-29 Deepak Gupta , Swati Suman , Asif Ekbal

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

The escalating global mortality and morbidity rates associated with gastrointestinal (GI) bleeding, compounded by the complexities and limitations of traditional endoscopic methods, underscore the urgent need for a critical review of…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Tanisha Singh , Shreshtha Jha , Nidhi Bhatt , Palak Handa , Nidhi Goel , Sreedevi Indu

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria

Visual question answering (VQA) in surgery is largely unexplored. Expert surgeons are scarce and are often overloaded with clinical and academic workloads. This overload often limits their time answering questionnaires from patients,…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Lalithkumar Seenivasan , Mobarakol Islam , Adithya K Krishna , Hongliang Ren

Medical Visual Question Answering (VQA) systems play a supporting role to understand clinic-relevant information carried by medical images. The questions to a medical image include two categories: close-end (such as Yes/No question) and…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Yunyi Liu , Zhanyu Wang , Dong Xu , Luping Zhou

Multipanel images, commonly seen as web screenshots, posters, etc., pervade our daily lives. These images, characterized by their composition of multiple subfigures in distinct layouts, effectively convey information to people. Toward…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Yue Fan , Jing Gu , Kaiwen Zhou , Qianqi Yan , Shan Jiang , Ching-Chen Kuo , Xinze Guan , Xin Eric Wang

We present a new dataset for Visual Question Answering (VQA) on document images called DocVQA. The dataset consists of 50,000 questions defined on 12,000+ document images. Detailed analysis of the dataset in comparison with similar datasets…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Minesh Mathew , Dimosthenis Karatzas , C. V. Jawahar

Medical Visual Question Answering (Med-VQA) is a very important task in healthcare industry, which answers a natural language question with a medical image. Existing VQA techniques in information systems can be directly applied to solving…

人工智能 · 计算机科学 2023-12-14 Xiaojie Hong , Zixin Song , Liangzhi Li , Xiaoli Wang , Feiyan Liu

Visual question answering is an important task in both natural language and vision understanding. However, in most of the public visual question answering datasets such as VQA, CLEVR, the questions are human generated that specific to the…

计算与语言 · 计算机科学 2022-08-08 Bingning Wang , Feiyang Lv , Ting Yao , Yiming Yuan , Jin Ma , Yu Luo , Haijin Liang

Video capsule endoscopy has transformed gastrointestinal endoscopy (GIE) diagnostics by offering a non-invasive method for capturing detailed images of the gastrointestinal tract, enabling early disease detection. However, its potential is…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Marcel Roth , Micha V. Nowak , Adrian Krenzer , Frank Puppe

Infographic Visual Question Answering (InfographicVQA) evaluates a model's ability to read and reason over data-rich, layout-heavy visuals that combine text, charts, icons, and design elements. Compared with scene-text or natural-image VQA,…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Tue-Thu Van-Dinh , Hoang-Duy Tran , Truong-Binh Duong , Mai-Hanh Pham , Binh-Nam Le-Nguyen , Quoc-Thai Nguyen

With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of eXplainable Artificial…

图像与视频处理 · 电气工程与系统科学 2022-05-06 Bas H. M. van der Velden , Hugo J. Kuijf , Kenneth G. A. Gilhuijs , Max A. Viergever