English
Related papers

Related papers: Leveraging Medical Visual Question Answering with …

200 papers

Lightweight image super-resolution (SR) networks have the utmost significance for real-world applications. There are several deep learning based SR methods with remarkable performance, but their memory and computational cost are hindrances…

Image and Video Processing · Electrical Eng. & Systems 2020-09-22 Abdul Muqeet , Jiwon Hwang , Subin Yang , Jung Heum Kang , Yongwoo Kim , Sung-Ho Bae

The correct interpretation of breast density is important in the assessment of breast cancer risk. AI has been shown capable of accurately predicting breast density, however, due to the differences in imaging characteristics across…

We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Johanna P. Müller , Bernhard Kainz

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

Few-shot semantic segmentation (FSS) aims to achieve novel objects segmentation with only a few annotated samples and has made great progress recently. Most of the existing FSS models focus on the feature matching between support and query…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jie Liu , Yanqi Bao , Wenzhe Yin , Haochen Wang , Yang Gao , Jan-Jakob Sonke , Efstratios Gavves

Medical AI faces challenges in privacy-preserving collaborative learning while ensuring fairness across heterogeneous healthcare institutions. Current federated learning approaches suffer from static architectures, slow convergence (45-73…

Computers and Society · Computer Science 2025-10-24 Jahidul Arafat , Fariha Tasmin , Sanjaya Poudel , Iftekhar Haider

Federated Learning (FL) is a collaborative method for training models while preserving data privacy in decentralized settings. However, FL encounters challenges related to data heterogeneity, which can result in performance degradation. In…

Machine Learning · Computer Science 2023-11-23 Seongyoon Kim , Gihun Lee , Jaehoon Oh , Se-Young Yun

This work aims to address the problem of image-based question-answering (QA) with new models and datasets. In our work, we propose to use neural networks and visual semantic embeddings, without intermediate stages such as object detection…

Machine Learning · Computer Science 2015-12-01 Mengye Ren , Ryan Kiros , Richard Zemel

Much recent progress in Vision-to-Language problems has been achieved through a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). This approach does not explicitly represent high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-12-19 Qi Wu , Chunhua Shen , Anton van den Hengel , Peng Wang , Anthony Dick

This paper describes our approach to Subtask 1 of the ImageCLEFmed MEDVQA 2025 Challenge, which targets visual question answering (VQA) for gastrointestinal endoscopy. We adopt the Florence model-a large-scale multimodal foundation model-as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Sujata Gaihre , Amir Thapa Magar , Prasuna Pokharel , Laxmi Tiwari

Spiking Neural Networks (SNNs) offer a promising alternative to conventional Artificial Neural Networks (ANNs) for the implementation of on-device low-power online learning and inference. On-device training is, however, constrained by the…

Machine Learning · Computer Science 2019-10-24 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

We tackle the problem of computing counterfactual explanations -- minimal changes to the features that flip an undesirable model prediction. We propose a solution to this question for linear Support Vector Machine (SVMs) models. Moreover,…

Machine Learning · Computer Science 2022-12-16 Sebastian Salazar , Samuel Denton , Ansaf Salleb-Aouissi

Solving tough clinical questions that require both image and text understanding is still a major challenge in healthcare AI. In this work, we propose Q-FSRU, a new model that combines Frequency Spectrum Representation and Fusion (FSRU) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Rakesh Thakur , Yusra Tariq , Rakesh Chandra Joshi

Vision-extended LLMs have made significant strides in Visual Question Answering (VQA). Despite these advancements, VLLMs still encounter substantial difficulties in handling queries involving long-tail entities, with a tendency to produce…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Jielin Qiu , Andrea Madotto , Zhaojiang Lin , Paul A. Crook , Yifan Ethan Xu , Xin Luna Dong , Christos Faloutsos , Lei Li , Babak Damavandi , Seungwhan Moon

Visual question answering (Visual QA) has attracted significant attention these years. While a variety of algorithms have been proposed, most of them are built upon different combinations of image and language features as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Cheng Zhang , Wei-Lun Chao , Dong Xuan

Medical question-answering (QA) is a critical task for evaluating how effectively large language models (LLMs) encode clinical knowledge and assessing their potential applications in medicine. Despite showing promise on multiple-choice…

Computation and Language · Computer Science 2025-03-06 Guangfu Guo , Kai Zhang , Bryan Hoo , Yujun Cai , Xiaoqian Lu , Nanyun Peng , Yiwei Wang

Recently, neural networks based on multi-task learning have achieved promising performance on fake news detection, which focus on learning shared features among tasks as complementary features to serve different tasks. However, in most of…

Computation and Language · Computer Science 2019-09-05 Lianwei Wu , Yuan Rao , Haolin Jin , Ambreen Nazir , Ling Sun

Visual question answering (VQA) requires systems to perform concept-level reasoning by unifying unstructured (e.g., the context in question and answer; "QA context") and structured (e.g., knowledge graph for the QA context and scene;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Yanan Wang , Michihiro Yasunaga , Hongyu Ren , Shinya Wada , Jure Leskovec

In recent decades, Industrial Fault Diagnosis (IFD) has emerged as a crucial discipline concerned with detecting and gathering vital information about industrial equipment's health condition, thereby facilitating the identification of…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Huan Wang , Yan-Fu Li , Konstantinos Gryllias

Research in medical visual question answering (MVQA) can contribute to the development of computeraided diagnosis. MVQA is a task that aims to predict accurate and convincing answers based on given medical images and associated natural…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xiaofei Huang , Hongfang Gong