English
Related papers

Related papers: Visual question answering-based image-finding gene…

200 papers

Vision-language foundation models (VLMs) have shown impressive performance in guiding image generation through text, with emerging applications in medical imaging. In this work, we are the first to investigate the question: 'Can fine-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Amar Kumar , Anita Kriz , Barak Pertzov , Tal Arbel

In this paper, we propose a method to obtain robust explanations for visual question answering(VQA) that correlate well with the answers. Our model explains the answers obtained through a VQA model by providing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Badri N. Patro , Shivansh Pate , Vinay P. Namboodiri

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

Lung cancer follow-up is a complex, error prone, and time consuming task for clinical radiologists. Several lung CT scan images taken at different time points of a given patient need to be individually inspected, looking for possible…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Xavier Rafael-Palou , Anton Aubanell , Ilaria Bonavita , Mario Ceresa , Gemma Piella , Vicent Ribas , Miguel Ángel González Ballester

Follow-up serves an important role in the management of pulmonary nodules for lung cancer. Imaging diagnostic guidelines with expert consensus have been made to help radiologists make clinical decision for each patient. However, tumor…

Image and Video Processing · Electrical Eng. & Systems 2020-10-12 Yamin Li , Jiancheng Yang , Yi Xu , Jingwei Xu , Xiaodan Ye , Guangyu Tao , Xueqian Xie , Guixue Liu

Chest X-ray is one of the most widespread examinations of the human body. In interventional radiology, its use is frequently associated with the need to visualize various tube-like objects, such as puncture needles, guiding sheaths, wires,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Ilyas Sirazitdinov , Heinrich Schulz , Axel Saalbach , Steffen Renisch , Dmitry V. Dylov

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Geeticka Chauhan , Ruizhi Liao , William Wells , Jacob Andreas , Xin Wang , Seth Berkowitz , Steven Horng , Peter Szolovits , Polina Golland

Visual Question Answering in Medical domain (VQA-Med) plays an important role in providing medical assistance to the end-users. These users are expected to raise either a straightforward question with a Yes/No answer or a challenging…

Computation and Language · Computer Science 2020-09-29 Deepak Gupta , Swati Suman , Asif Ekbal

Objective: Although medical imaging datasets are increasingly available, abnormal and annotation-intensive findings critical to lung cancer screening, particularly small pulmonary nodules, remain underrepresented and inconsistently curated.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Fakrul Islam Tushar , Ehsan Samei , Cynthia Rudin , Joseph Y. Lo

We propose Encyclopedic-VQA, a large scale visual question answering (VQA) dataset featuring visual questions about detailed properties of fine-grained categories and instances. It contains 221k unique question+answer pairs each matched…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Thomas Mensink , Jasper Uijlings , Lluis Castrejon , Arushi Goel , Felipe Cadar , Howard Zhou , Fei Sha , André Araujo , Vittorio Ferrari

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

Growing interest in conversational agents promote twoway human-computer communications involving asking and answering visual questions have become an active area of research in AI. Thus, generation of visual questionanswer pair(s) becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Charani Alampalle , Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Whole slide imaging is routinely adopted for carcinoma diagnosis and prognosis. Abundant experience is required for pathologists to achieve accurate and reliable diagnostic results of whole slide images (WSI). The huge size and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Pingyi Chen , Chenglu Zhu , Sunyi Zheng , Honglin Li , Lin Yang

Deep learning-based automated diagnosis of lung cancer has emerged as a crucial advancement that enables healthcare professionals to detect and initiate treatment earlier. However, these models require extensive training datasets with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Aryan Goyal , Ashish Mittal , Pranav Rao , Manoj Tadepalli , Preetham Putha

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

Computation and Language · Computer Science 2020-06-05 Goonmeet Bajaj , Bortik Bandyopadhyay , Daniel Schmidt , Pranav Maneriker , Christopher Myers , Srinivasan Parthasarathy

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

Problems at the intersection of language and vision, like visual question answering, have recently been gaining a lot of attention in the field of multi-modal machine learning as computer vision research moves beyond traditional recognition…

Computation and Language · Computer Science 2018-09-25 Khyathi Raghavi Chandu , Mary Arpita Pyreddy , Matthieu Felix , Narendra Nath Joshi

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

Computation and Language · Computer Science 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu