English
Related papers

Related papers: Multimodal AI for Gastrointestinal Diagnostics: Ta…

200 papers

VQA (Visual Question Answering) combines Natural Language Processing (NLP) with image understanding to answer questions about a given image. It has enormous potential for the development of medical diagnostic AI systems. Such a system can…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Gaurav Parajuli

In recent years, artificial intelligence has played an important role in medicine and disease diagnosis, with many applications to be mentioned, one of which is Medical Visual Question Answering (MedVQA). By combining computer vision and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Triet M. Thai , Anh T. Vo , Hao K. Tieu , Linh N. P. Bui , Thien T. B. Nguyen

We present a multi-task framework for the MediaEval Medico 2025 challenge, leveraging a LoRA-tuned Florence-2 model for simultaneous visual question answering (VQA), explanation generation, and visual grounding. The proposed system…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Itbaan Safwan , Muhammad Annas Shaikh , Muhammad Haaris , Ramail Khan , Muhammad Atif Tahir

The Medico 2025 challenge addresses Visual Question Answering (VQA) for Gastrointestinal (GI) imaging, organized as part of the MediaEval task series. The challenge focuses on developing Explainable Artificial Intelligence (XAI) models that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Sushant Gautam , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Steven Hicks

The major limitations of gastrointestinal (GI) endoscopy AI systems arise from a shortage of annotated data, strict privacy policies, and significant bottlenecks in conventional model fine-tuning. Such limitations impede the successful…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ojonugwa Oluwafemi Ejiga Peter , Frederick Akor Ejiga , Fahmi Khalifa , Md Mahmudur Rahman

Medical Visual Question Answering (MedVQA) is a promising field for developing clinical decision support systems, yet progress is often limited by the available datasets, which can lack clinical complexity and visual diversity. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

Medical Visual Question Answering (VQA) enhances clinical decision-making by enabling systems to interpret medical images and answer clinical queries. However, developing efficient, high-performance VQA models is challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Belal Alsinglawi , Chris McCarthy , Sara Webb , Christopher Fluke , Navid Toosy Saidy

Multimodal/vision language models (VLMs) are increasingly being deployed in healthcare settings worldwide, necessitating robust benchmarks to ensure their safety, efficacy, and fairness. Multiple-choice question and answer (QA) datasets…

Accurate diagnosis of ophthalmic diseases relies heavily on the interpretation of multimodal ophthalmic images, a process often time-consuming and expertise-dependent. Visual Question Answering (VQA) presents a potential interdisciplinary…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Xiaolan Chen , Ruoyu Chen , Pusheng Xu , Weiyi Zhang , Xianwen Shang , Mingguang He , Danli Shi

Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal…

Medical visual question answering (VQA) is a challenging multimodal task, where Vision-Language Pre-training (VLP) models can effectively improve the generalization performance. However, most methods in the medical field treat VQA as an…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jiawei Chen , Dingkang Yang , Yue Jiang , Yuxuan Lei , Lihua Zhang

Multimodal Large Language Models are increasingly applied to biomedical imaging, yet scientific reasoning for microscopy remains limited by the scarcity of large-scale, high-quality training data. We introduce MicroVQA++, a three-stage,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Manyu Li , Ruian He , Chenxi Ma , Weimin Tan , Bo Yan

Visual question answering (VQA) in medical imaging aims to support clinical diagnosis by automatically interpreting complex imaging data in response to natural language queries. Existing studies typically rely on distinct visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yuanhe Tian , Chen Su , Junwen Duan , Yan Song

Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple images rather than interpreting a single view. We introduce MedThinkVQA, an expert-annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zonghai Yao , Benlu Wang , Yifan Zhang , Junda Wang , Iris Xia , Zhipeng Tang , Shuo Han , Feiyun Ouyang , Zhichao Yang , Arman Cohan , Hong Yu

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in various multimodal tasks. However, their potential in the medical domain remains largely unexplored. A significant challenge arises from the scarcity of…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Yutao Hu , Tianbin Li , Quanfeng Lu , Wenqi Shao , Junjun He , Yu Qiao , Ping Luo

Gastrointestinal (GI) endoscopy is essential in identifying GI tract abnormalities in order to detect diseases in their early stages and improve patient outcomes. Although deep learning has shown success in supporting GI diagnostics and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Alina Devkota , Annahita Amireskandari , Joel Palko , Shyam Thakkar , Donald Adjeroh , Xiajun Jiang , Binod Bhattarai , Prashnna K. Gyawali

Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in medical image analysis. However, their application in gastrointestinal endoscopy is currently hindered by two critical limitations: the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Huan Zheng , Yucheng Zhou , Tianyi Yan , Dubing Chen , Hongbo Lu , Wenlong Liao , Tao He , Pai Peng , Jianbing Shen

Medical Visual Question Answering (VQA) is a multi-modal challenging task widely considered by research communities of the computer vision and natural language processing. Since most current medical VQA models focus on visual content,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Haiwei Pan , Shuning He , Kejia Zhang , Bo Qu , Chunling Chen , Kun Shi

Recent vision-language models (VLMs) have shown strong generalization and multimodal reasoning abilities in natural domains. However, their application to medical diagnosis remains limited by the lack of comprehensive and structured…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sheng Lu , Hao Chen , Rui Yin , Juyan Ba , Yu Zhang , Yuanzhe Li

Medical visual question answering (VQA) aims to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficiency of medical professionals while relieving the burden on the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xinyue Hu , Lin Gu , Kazuma Kobayashi , Qiyuan An , Qingyu Chen , Zhiyong Lu , Chang Su , Tatsuya Harada , Yingying Zhu
‹ Prev 1 2 3 10 Next ›