English
Related papers

Related papers: Exploring scalable medical image encoders beyond t…

200 papers

The integration of artificial intelligence (AI) with radiology marks a transformative era in medicine. Vision foundation models have been adopted to enhance radiologic imaging analysis. However, the distinct complexities of radiologic 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Zhixiu Lu , Hailong Li , Nehal A. Parikh , Jonathan R. Dillman , Lili He

Vision-language pre-training for chest X-rays has made significant strides, primarily by utilizing paired radiographs and radiology reports. However, existing approaches often face challenges in encoding medical knowledge effectively. While…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Haozhe Luo , Ziyu Zhou , Corentin Royer , Anjany Sekuboyina , Bjoern Menze

Recent advancements in vision-language pre-training via contrastive learning have significantly improved performance across computer vision tasks. However, in the medical domain, obtaining multimodal data is often costly and challenging due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Ameera Bawazir , Kebin Wu , Wenbin Li

Self-supervised learning (SSL) has transformed vision encoder training in general domains but remains underutilized in medical imaging due to limited data and domain specific biases. We present MammoDINO, a novel SSL framework for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Sicheng Zhou , Lei Wu , Cao Xiao , Parminder Bhatia , Taha Kass-Hout

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

Although machine learning has become a powerful tool to augment doctors in clinical analysis, the immense amount of labeled data that is necessary to train supervised learning approaches burdens each development task as time and resource…

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

The DINO family of self-supervised vision models has shown remarkable transferability, yet effectively adapting their representations for segmentation remains challenging. Existing approaches often rely on heavy decoders with multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sicheng Yang , Hongqiu Wang , Zhaohu Xing , Sixiang Chen , Lei Zhu

Self-attention based transformer models have been dominating many computer vision tasks in the past few years. Their superb model qualities heavily depend on the excessively large labeled image datasets. In order to reduce the reliance on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Zejiang Hou , Fei Sun , Yen-Kuang Chen , Yuan Xie , Sun-Yuan Kung

The difficulties in both data acquisition and annotation substantially restrict the sample sizes of training datasets for 3D medical imaging applications. As a result, constructing high-performance 3D convolutional neural networks from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Shu Zhang , Zihao Li , Hong-Yu Zhou , Jiechao Ma , Yizhou Yu

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Maximilian Nielsen , Laura Wenderoth , Thilo Sentker , René Werner

Recent advancements in multimodal vision models have highlighted limitations in late-stage feature fusion and suboptimal query selection for hybrid prompts open-world segmentation, alongside constraints from caption-derived vocabularies. To…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yuchen Guan , Chong Sun , Canmiao Fu , Zhipeng Huang , Chun Yuan , Chen Li

This paper proposes leveraging vision-language pretraining on bone X-rays paired with French reports to address downstream tasks of interest on bone radiography. A practical processing pipeline is introduced to anonymize and process French…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Alexandre Englebert , Anne-Sophie Collin , Olivier Cornu , Christophe De Vleeschouwer

Within the domain of medical analysis, extensive research has explored the potential of mutual learning between Masked Autoencoders(MAEs) and multimodal data. However, the impact of MAEs on intermodality remains a key challenge. We…

Image and Video Processing · Electrical Eng. & Systems 2024-06-03 Lei Li , Tianfang Zhang , Xinglin Zhang , Jiaqi Liu , Bingqi Ma , Yan Luo , Tao Chen

Accurate prediction of cardiovascular diseases remains imperative for early diagnosis and intervention, necessitating robust and precise predictive models. Recently, there has been a growing interest in multi-modal learning for uncovering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Francesco Girlanda , Olga Demler , Bjoern Menze , Neda Davoudi

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Open-Vocabulary Segmentation (OVS) aims at segmenting images from free-form textual concepts without predefined training classes. While existing vision-language models such as CLIP can generate segmentation masks by leveraging coarse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Luca Barsellotti , Lorenzo Bianchi , Nicola Messina , Fabio Carrara , Marcella Cornia , Lorenzo Baraldi , Fabrizio Falchi , Rita Cucchiara

Supervised deep learning usually faces more challenges in medical images than in natural images. Since annotations in medical images require the expertise of doctors and are more time-consuming and expensive. Thus, some researchers turn to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Tao Yang , Lisheng Wang

Deep learning has greatly advanced medical image segmentation, but its success relies heavily on fully supervised learning, which requires dense annotations that are costly and time-consuming for 3D volumetric scans. Barely-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shuang Zeng , Boxu Xie , Lei Zhu , Xinliang Zhang , Jiakui Hu , Zhengjian Yao , Yuanwei Li , Yuxing Lu , Yanye Lu

A Content-Based Image Retrieval (CBIR) system which identifies similar medical images based on a query image can assist clinicians for more accurate diagnosis. The recent CBIR research trend favors the construction and use of binary codes…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Antonio Sze-To , Hamid R. Tizhoosh , Andrew K. C. Wong