English
Related papers

Related papers: CLIP Architecture for Abdominal CT Image-Text Alig…

200 papers

A large-scale image-text pair dataset has greatly contributed to the development of vision-language pre-training (VLP) models, which enable zero-shot or few-shot classification without costly annotation. However, in the medical domain, the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Kihyun You , Jawook Gu , Jiyeon Ham , Beomhee Park , Jiho Kim , Eun Kyoung Hong , Woonhyunk Baek , Byungseok Roh

In this retrospective multi-institutional study, a quantitative phenotyping framework, CT-IDP (CT Image-Derived Phenotypes) was developed on the MERLIN abdominal CT benchmark (training, validation, and test sets- 15,175, 5,018, and 5,082…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lavsen Dahal , Joseph Y. Lo

Semi-supervised learning (SSL) is a promising machine learning paradigm to address the issue of label scarcity in medical imaging. SSL methods were originally developed in image classification. The state-of-the-art SSL methods in image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mou-Cheng Xu , Yukun Zhou , Chen Jin , Marius De Groot , Neil P. Oxtoby , Daniel C. Alexander , Joseph Jacob

Popular zero-shot models suffer due to artifacts inherited from pretraining. One particularly detrimental issue, caused by unbalanced web-scale pretraining data, is mismatched label distribution. Existing approaches that seek to repair the…

Machine Learning · Computer Science 2024-10-31 Changho Shin , Jitian Zhao , Sonia Cromp , Harit Vishwakarma , Frederic Sala

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Florin C. Ghesu , Bogdan Georgescu , Awais Mansoor , Youngjin Yoo , Dominik Neumann , Pragneshkumar Patel , R. S. Vishwanath , James M. Balter , Yue Cao , Sasa Grbic , Dorin Comaniciu

Reliable identification of anatomical body regions is a prerequisite for many automated medical imaging workflows, yet existing solutions remain heavily dependent on unreliable DICOM metadata. Current solutions mainly use supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Farnaz Khun Jush , Grit Werner , Mark Klemens , Matthias Lenga

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Due to the large volume of medical imaging data, advanced AI methodologies are needed to assist radiologists in diagnosing thoracic diseases from chest X-rays (CXRs). Existing deep learning models often require large, labeled datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Prakhar Bhardwaj , Sheethal Bhat , Andreas Maier

Recent advancements in deep learning for Medical Artificial Intelligence have demonstrated that models can match the diagnostic performance of clinical experts in adult chest X-ray (CXR) interpretation. However, their application in the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sheng Cheng , Zbigniew A. Starosolski , Devika Subramanian

We introduce MM-Mixing, a multi-modal mixing alignment framework for 3D understanding. MM-Mixing applies mixing-based methods to multi-modal data, preserving and optimizing cross-modal connections while enhancing diversity and improving…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaze Wang , Yi Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

The scarcity of annotations poses a significant challenge in medical image analysis. Large-scale pre-training has emerged as a promising label-efficient solution, owing to the utilization of large-scale data, large models, and advanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Linshan Wu , Jiaxin Zhuang , Hao Chen

Body composition analysis provides valuable insights into aging, disease progression, and overall health conditions. Due to concerns of radiation exposure, two-dimensional (2D) single-slice computed tomography (CT) imaging has been used…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Lianrui Zuo , Xin Yu , Dingjie Su , Kaiwen Xu , Aravind R. Krishnan , Yihao Liu , Shunxing Bao , Fabien Maldonado , Luigi Ferrucci , Bennett A. Landman

Recent work has shown that label-efficient few-shot learning through self-supervision can achieve promising medical image segmentation results. However, few-shot segmentation models typically rely on prototype representations of the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Stine Hansen , Srishti Gautam , Robert Jenssen , Michael Kampffmeyer

Digital Breast Tomosynthesis (DBT) is a widely used medical imaging modality for breast cancer screening and diagnosis, offering higher spatial resolution and greater detail through its 3D-like breast volume imaging capability. However, the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Yuexi Du , Regina J. Hooley , John Lewin , Nicha C. Dvornek

Vision-language models (VLMs) are gaining attention in medical image analysis. These are pre-trained on large, heterogeneous data sources, yielding rich and transferable representations. Notably, the combination of modality-specialized VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Julio Silva-Rodríguez , Fereshteh Shakeri , Houda Bahig , Jose Dolz , Ismail Ben Ayed

Accurate segmentation of carotid artery structures in histopathological images is vital for cardiovascular disease research. This study systematically evaluates ten deep learning segmentation models including classical architectures, modern…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Phongsakon Mark Konrad , Andrei-Alexandru Popa , Yaser Sabzehmeidani , Liang Zhong , Madhulika Tripathy , Andrei Constantinescu , Elisa A. Liehn , Serkan Ayvaz

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

Semi-supervised 3D medical image segmentation aims to achieve accurate segmentation using few labelled data and numerous unlabelled data. The main challenge in the design of semi-supervised learning methods consists in the effective use of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yanyan Wang , Kechen Song , Yuyuan Liu , Shuai Ma , Yunhui Yan , Gustavo Carneiro

Vision-language pre-training (VLP) has great potential for developing multifunctional and general medical diagnostic capabilities. However, aligning medical images with a low signal-to-noise ratio (SNR) to reports with a high SNR presents a…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Weiwei Cao , Jianpeng Zhang , Zhongyi Shui , Sinuo Wang , Zeli Chen , Xi Li , Le Lu , Xianghua Ye , Tingbo Liang , Qi Zhang , Ling Zhang