English
Related papers

Related papers: Parameter-Efficient VLMs for Gastrointestinal Endo…

200 papers

VQA (Visual Question Answering) combines Natural Language Processing (NLP) with image understanding to answer questions about a given image. It has enormous potential for the development of medical diagnostic AI systems. Such a system can…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Gaurav Parajuli

This paper describes our approach to Subtask 1 of the ImageCLEFmed MEDVQA 2025 Challenge, which targets visual question answering (VQA) for gastrointestinal endoscopy. We adopt the Florence model-a large-scale multimodal foundation model-as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Sujata Gaihre , Amir Thapa Magar , Prasuna Pokharel , Laxmi Tiwari

Gastrointestinal (GI) endoscopy is essential in identifying GI tract abnormalities in order to detect diseases in their early stages and improve patient outcomes. Although deep learning has shown success in supporting GI diagnostics and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Alina Devkota , Annahita Amireskandari , Joel Palko , Shyam Thakkar , Donald Adjeroh , Xiajun Jiang , Binod Bhattarai , Prashnna K. Gyawali

In recent years, artificial intelligence has played an important role in medicine and disease diagnosis, with many applications to be mentioned, one of which is Medical Visual Question Answering (MedVQA). By combining computer vision and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Triet M. Thai , Anh T. Vo , Hao K. Tieu , Linh N. P. Bui , Thien T. B. Nguyen

Despite recent advancements in the field of medical image analysis with the use of pretrained foundation models, the issue of distribution shifts between cross-source images largely remains adamant. To circumvent that issue, investigators…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Sanjaya Poudel , Nikita Kunwor , Raj Simkhada , Mustafa Munir , Manish Dhakal , Khem Poudel

Medical Visual Question Answering (MedVQA) is a promising field for developing clinical decision support systems, yet progress is often limited by the available datasets, which can lack clinical complexity and visual diversity. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

The Medico 2025 challenge addresses Visual Question Answering (VQA) for Gastrointestinal (GI) imaging, organized as part of the MediaEval task series. The challenge focuses on developing Explainable Artificial Intelligence (XAI) models that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Sushant Gautam , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Steven Hicks

Background and Aims: This study evaluates the medical reasoning performance of large language models (LLMs) and vision language models (VLMs) in gastroenterology. Methods: We used 300 gastroenterology board exam-style multiple-choice…

We present a multi-task framework for the MediaEval Medico 2025 challenge, leveraging a LoRA-tuned Florence-2 model for simultaneous visual question answering (VQA), explanation generation, and visual grounding. The proposed system…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Itbaan Safwan , Muhammad Annas Shaikh , Muhammad Haaris , Ramail Khan , Muhammad Atif Tahir

Conventional medical artificial intelligence (AI) models face barriers in clinical application and ethical issues owing to their inability to handle the privacy-sensitive characteristics of medical data. We present a novel personalized…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 He Zhu , Ren Togo , Takahiro Ogawa , Miki Haseyama

With the advent of large pre-trained transformer models, fine-tuning these models for various downstream tasks is a critical problem. Paucity of training data, the existence of data silos, and stringent privacy constraints exacerbate this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Naif Alkhunaizi , Faris Almalik , Rouqaiah Al-Refai , Muzammal Naseer , Karthik Nandakumar

The integration of artificial intelligence (AI) in medical diagnostics represents a significant advancement in managing upper gastrointestinal (GI) cancer, a major cause of global cancer mortality. Specifically for gastric cancer (GC),…

Geometric Dimensioning and Tolerancing (GD&T) plays a critical role in manufacturing by defining acceptable variations in part features to ensure component quality and functionality. However, extracting GD&T information from 2D engineering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Muhammad Tayyab Khan , Lequn Chen , Ye Han Ng , Wenhe Feng , Nicholas Yew Jin Tan , Seung Ki Moon

Multimodal Large Language Models (MLLMs) show promise in gastroenterology, yet their performance against comprehensive clinical workflows and human benchmarks remains unverified. To systematically evaluate state-of-the-art MLLMs across a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yan Zhu , Te Luo , Pei-Yao Fu , Zhen Zhang , Zi-Long Wang , Yi-Fan Qu , Zi-Han Geng , Jia-Qi Xu , Lu Yao , Li-Yun Ma , Wei Su , Wei-Feng Chen , Quan-Lin Li , Shuo Wang , Ping-Hong Zhou

Visual Question Answering (VQA) within the surgical domain, utilizing Large Language Models (LLMs), offers a distinct opportunity to improve intra-operative decision-making and facilitate intuitive surgeon-AI interaction. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Runlong He , Mengya Xu , Adrito Das , Danyal Z. Khan , Sophia Bano , Hani J. Marcus , Danail Stoyanov , Matthew J. Clarkson , Mobarakol Islam

This paper presents an extensive examination of Parameter-Efficient Fine-Tuning (PEFT) for embedding domain specific facts into Large Language Models (LLMs), focusing on improving the fine-tuning process by categorizing question-answer (QA)…

Computation and Language · Computer Science 2025-10-28 Shivam Ratnakar , Abhiroop Talasila , Raghav Chamadiya , Nikhil Agarwal , Vinayak K Doifode

Vision-Language Models (VLMs) in visual question answering (VQA) offer a unique opportunity to enhance intra-operative decision-making, promote intuitive interactions, and significantly advancing surgical education. However, the development…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Runlong He , Danyal Z. Khan , Evangelos B. Mazomenos , Hani J. Marcus , Danail Stoyanov , Matthew J. Clarkson , Mobarakol Islam

The MEDVQA-GI challenge addresses the integration of AI-driven text-to-image generative models in medical diagnostics, aiming to enhance diagnostic capabilities through synthetic image generation. Existing methods primarily focus on static…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Ojonugwa Oluwafemi Ejiga Peter , Md Mahmudur Rahman , Fahmi Khalifa

Fine-tuning large vision models (LVMs) and large language models (LLMs) under differentially private federated learning (DPFL) is hindered by a fundamental privacy-utility trade-off. Low-Rank Adaptation (LoRA), a promising…

Machine Learning · Computer Science 2026-04-21 Jin Liu , Yinbin Miao , Ning Xi , Junkang Liu

Video capsule endoscopy has transformed gastrointestinal endoscopy (GIE) diagnostics by offering a non-invasive method for capturing detailed images of the gastrointestinal tract, enabling early disease detection. However, its potential is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Marcel Roth , Micha V. Nowak , Adrian Krenzer , Frank Puppe
‹ Prev 1 2 3 10 Next ›