English
Related papers

Related papers: MedPix 2.0: A Comprehensive Multimodal Biomedical …

200 papers

In the past decade, deep learning (DL) has achieved unprecedented success in numerous fields including computer vision, natural language processing, and healthcare. In particular, DL is experiencing an increasing development in applications…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Liang Zhang , Johann Li , Ping Li , Xiaoyuan Lu , Peiyi Shen , Guangming Zhu , Syed Afaq Shah , Mohammed Bennarmoun , Kun Qian , Björn W. Schuller

The accelerating development of general medical artificial intelligence (GMAI), powered by multimodal large language models (MLLMs), offers transformative potential for addressing persistent healthcare challenges, including workforce…

Artificial Intelligence · Computer Science 2025-06-03 Sau Lai Yip , Sunan He , Yuxiang Nie , Shu Pui Chan , Yilin Ye , Sum Ying Lam , Hao Chen

Large vision-language models (LVLMs) have shown great promise in medical applications, particularly in visual question answering (MedVQA) and diagnosis from medical images. However, existing datasets and models often fail to consider…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Linjie Mu , Zhongzhen Huang , Shengqian Qin , Yakun Zhu , Shaoting Zhang , Xiaofan Zhang

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

Medical Vision-Language Pre-training (MedVLP) has made significant progress in enabling zero-shot tasks for medical image understanding. However, training MedVLP models typically requires large-scale datasets with paired, high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Che Liu , Zhongwei Wan , Haozhe Wang , Yinda Chen , Talha Qaiser , Chen Jin , Fariba Yousefi , Nikolay Burlutskiy , Rossella Arcucci

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is heterogeneous in…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Baraa Al Jorf , Farah Shamout

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marvin Seyfarth , Salman Ul Hassan Dar , Isabelle Ayx , Matthias Alexander Fink , Stefan O. Schoenberg , Hans-Ulrich Kauczor , Sandy Engelhardt

Large-scale population-based studies in medicine are a key resource towards better diagnosis, monitoring, and treatment of diseases. They also serve as enablers of clinical decision support systems, in particular Computer Aided Diagnosis…

Machine Learning · Computer Science 2022-03-01 Gerome Vivar , Anees Kazi , Hendrik Burwinkel , Andreas Zwergal , Nassir Navab , Seyed-Ahmad Ahmadi

Volumetric medical imaging technologies produce detailed 3D representations of anatomical structures. However, effective medical data visualization and exploration pose significant challenges, especially for individuals with limited medical…

Human-Computer Interaction · Computer Science 2025-07-01 Qixuan Liu , Shi Qiu , Yinqiao Wang , Xiwen Wu , Kenneth Siu Ho Chok , Chi-Wing Fu , Pheng-Ann Heng

Understanding 3D medical image volumes is a critical task in the medical domain. However, existing 3D convolution and transformer-based methods have limited semantic understanding of an image volume and also need a large set of volumes for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Qiuhui Chen , Huping Ye , Yi Hong

Large-scale medical imaging datasets have accelerated deep learning (DL) for medical image analysis. However, the large scale of these datasets poses a challenge for researchers, resulting in increased storage and bandwidth requirements for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Pranav Kulkarni , Adway Kanhere , Eliot Siegel , Paul H. Yi , Vishwa S. Parekh

Medicine is inherently multimodal, with rich data modalities spanning text, imaging, genomics, and more. Generalist biomedical artificial intelligence (AI) systems that flexibly encode, integrate, and interpret this data at scale can…

Medical vision-language pretraining models (VLPM) have achieved remarkable progress in fusing chest X-rays (CXR) with clinical texts, introducing image-text data binding approaches that enable zero-shot learning and downstream clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuan Gao , Sangwook Kim , David E Austin , Chris McIntosh

Artificial intelligence (AI)-enabled diagnostics in maxillofacial pathology require structured, high-quality multimodal datasets. However, existing resources provide limited ameloblastoma coverage and lack the format consistency needed for…

Artificial Intelligence · Computer Science 2026-02-06 Ajo Babu George , Anna Mariam John , Athul Anoop , Balu Bhasuran

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

This study introduces an evaluation framework for multimodal models in medical imaging diagnostics. We developed a pipeline incorporating data preprocessing, model inference, and preference-based evaluation, expanding an initial set of 500…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Cailian Ruan , Chengyue Huang , Yahe Yang

Screening mammography is high volume, time sensitive, and documentation heavy. Radiologists must translate subtle visual findings into consistent BI-RADS assessments, breast density categories, and structured narrative reports. While recent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Raiyan Jahangir , Nafiz Imtiaz Khan , Amritanand Sudheerkumar , Vladimir Filkov

In today's world of advanced AI technologies, data management is a critical component of any AI/ML solution. Effective data management is vital for the creation and maintenance of high-quality, diverse datasets, which significantly enhance…

Machine Learning · Computer Science 2024-09-20 Sai Vishwanath Venkatesh , Atra Akandeh , Madhu Lokanath

Medication recommendations aim to generate safe and effective medication sets from health records. However, accurately recommending medications hinges on inferring a patient's latent clinical condition from sparse and noisy observations,…

Information Retrieval · Computer Science 2026-03-20 Xiangxu Zhang , Xiao Zhou , Hongteng Xu , Jianxun Lian