English
Related papers

Related papers: Advancing Medical Representation Learning Through …

200 papers

Tabular medical records remain the most readily available data format for applying machine learning in healthcare. However, traditional data preprocessing ignores valuable contextual information in tables and requires substantial manual…

Medical image analysis suffers from a lack of labeled data due to several challenges including patient privacy and lack of experts. Although some AI models only perform well with large amounts of data, we will move to data augmentation…

Image and Video Processing · Electrical Eng. & Systems 2025-11-26 Khadija Rais , Mohamed Amroune , Mohamed Yassine Haouam , Abdelmadjid Benmachiche

Multimodal medical image fusion plays a crucial role in medical diagnosis by integrating complementary information from different modalities to enhance image readability and clinical applicability. However, existing methods mainly follow…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haozhe Xiang , Han Zhang , Yu Cheng , Xiongwen Quan , Wanwan Huang

The rise of multimodal large language models (MLLMs) has sparked an unprecedented wave of applications in the field of medical imaging analysis. However, as one of the earliest and most fundamental tasks integrated into this paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xun Zhu , Fanbin Mo , Xi Chen , Kaili Zheng , Shaoshuai Yang , Yiming Shi , Jian Gao , Miao Li , Ji Wu

In cross-modal retrieval tasks, such as image-to-report and report-to-image retrieval, accurately aligning medical images with relevant text reports is essential but challenging due to the inherent ambiguity and variability in medical data.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Shreyank N Gowda , Xiaobo Jin , Christian Wagner

Embedding vision-language models (VLMs) are typically pretrained with short text windows (<77 tokens), which forces the truncation of long-format captions. Yet, the distribution of biomedical captions from large-scale open source literature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Min Woo Sun , Alejandro Lozano , Javier Gamazo Tejero , Vishwesh Nath , Xiao Xiao Sun , James Burgess , Yuhui Zhang , Kun Yuan , Robert Tibshirani , Sean Huver , Serena Yeung-Levy

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

Paucity of medical data severely limits the generalizability of diagnostic ML models, as the full spectrum of disease variability can not be represented by a small clinical dataset. To address this, diffusion models (DMs) have been…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Janet Wang , Yunbei Zhang , Zhengming Ding , Jihun Hamm

Medical datasets are typically affected by issues such as missing values, class imbalance, a heterogeneous feature types, and a high number of features versus a relatively small number of samples, preventing machine learning models from…

The scarcity of high-quality data remains a primary bottleneck in adapting multimodal generative models for medical image editing. Existing medical image editing datasets often suffer from limited diversity, neglect of medical image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yongfan Lai , Wen Qian , Bo Liu , Hongyan Li , Hao Luo , Fan Wang , Bohan Zhuang , Shenda Hong

Vision-and-language multi-modal pretraining and fine-tuning have shown great success in visual question answering (VQA). Compared to general domain VQA, the performance of biomedical VQA suffers from limited data. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zheng Yuan , Qiao Jin , Chuanqi Tan , Zhengyun Zhao , Hongyi Yuan , Fei Huang , Songfang Huang

In the deployment of large language models (LLMs), accurate confidence estimation is critical for assessing the credibility of model predictions. However, existing methods often fail to overcome the issue of overconfidence on incorrect…

Computation and Language · Computer Science 2024-02-20 Pei Wang , Yejie Wang , Muxi Diao , Keqing He , Guanting Dong , Weiran Xu

Medical image segmentation plays a crucial role in clinical medicine, serving as a key tool for auxiliary diagnosis, treatment planning, and disease monitoring. However, traditional segmentation methods such as U-Net are often limited by…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Gaoyu Chen , Haixia Pan

High-quality labeled datasets play a crucial role in fueling the development of machine learning (ML), and in particular the development of deep learning (DL). However, since the emergence of the ImageNet dataset and the AlexNet model in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Zeyad Emam , Andrew Kondrich , Sasha Harrison , Felix Lau , Yushi Wang , Aerin Kim , Elliot Branson

The increase in the availability of online videos has transformed the way we access information and knowledge. A growing number of individuals now prefer instructional videos as they offer a series of step-by-step procedures to accomplish…

Computation and Language · Computer Science 2023-09-22 Deepak Gupta , Kush Attal , Dina Demner-Fushman

Multimodal large language models (MLLMs) have made significant strides, yet they face challenges in the medical domain due to limited specialized knowledge. While recent medical MLLMs demonstrate strong performance in lab settings, they…

Computation and Language · Computer Science 2024-10-22 Junda Wang , Yujan Ting , Eric Z. Chen , Hieu Tran , Hong Yu , Weijing Huang , Terrence Chen

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in general domains,…

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

The astounding success made by artificial intelligence (AI) in healthcare and other fields proves that AI can achieve human-like performance. However, success always comes with challenges. Deep learning algorithms are data-dependent and…

Image and Video Processing · Electrical Eng. & Systems 2021-06-25 Johann Li , Guangming Zhu , Cong Hua , Mingtao Feng , BasheerBennamoun , Ping Li , Xiaoyuan Lu , Juan Song , Peiyi Shen , Xu Xu , Lin Mei , Liang Zhang , Syed Afaq Ali Shah , Mohammed Bennamoun

Developing artificial intelligence (AI) and machine learning (ML) models for medical imaging typically involves extensive training and testing on large datasets, consuming significant computational time, energy, and resources. There is a…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Raj Hansini Khoiwal , Alan B. McMillan