English
Related papers

Related papers: CLIP Architecture for Abdominal CT Image-Text Alig…

200 papers

In this paper, we construct two research objectives: i) explore the learned embedding space of BiomedCLIP, an open-source large vision language model, to analyse meaningful class separations, and ii) quantify the limitations of BiomedCLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Nafiz Sadman , Farhana Zulkernine , Benjamin Kwan

Supervised learning has been very successful for automatic segmentation of images from a single scanner. However, several papers report deteriorated performances when using classifiers trained on images from one scanner to segment images…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Veronika Cheplygina , Annegreet van Opbroek , M. Arfan Ikram , Meike W. Vernooij , Marleen de Bruijne

Recent advances in zero-shot learning have enabled the use of paired image-text data to replace structured labels, replacing the need for expert annotated datasets. Models such as CLIP-based CheXzero utilize these advancements in the domain…

Medical Physics · Physics 2023-06-16 Aakash Mishra , Rajat Mittal , Christy Jestin , Kostas Tingos , Pranav Rajpurkar

Accurate detection and localization of traumatic injuries in abdominal CT scans remains a critical challenge in emergency radiology, primarily due to severe scarcity of annotated medical data. This paper presents a label-efficient approach…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Shivam Chaudhary , Sheethal Bhat , Andreas Maier

Purposes: This study aimed to develop a computed tomography (CT)-based multi-organ segmentation model for delineating organs-at-risk (OARs) in pediatric upper abdominal tumors and evaluate its robustness across multiple datasets. Materials…

Self-Supervised Learning (SSL) has demonstrated promising results in 3D medical image analysis. However, the lack of high-level semantics in pre-training still heavily hinders the performance of downstream tasks. We observe that 3D medical…

Image and Video Processing · Electrical Eng. & Systems 2024-04-19 Linshan Wu , Jiaxin Zhuang , Hao Chen

Industrial and medical anomaly detection faces critical challenges from data scarcity and prohibitive annotation costs, particularly in evolving manufacturing and healthcare settings. To address this, we propose CoZAD, a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Muhammad Aqeel , Danijel Skocaj , Marco Cristani , Francesco Setti

Existing medical imaging datasets for abdominal CT often lack three-dimensional annotations, multi-organ coverage, or precise lesion-to-organ associations, hindering robust representation learning and clinical applications. To address this…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Mehran Advand , Zahra Dehghanian , Navid Faraji , Reza Barati , Seyed Amir Ahmad Safavi-Naini , Hamid R. Rabiee

Recent trends in semi-supervised learning have significantly boosted the performance of 3D semi-supervised medical image segmentation. Compared with 2D images, 3D medical volumes involve information from different directions, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Heng Cai , Shumeng Li , Lei Qi , Qian Yu , Yinghuan Shi , Yang Gao

Recent advances in large generative models have shown that simple autoregressive formulations, when scaled appropriately, can exhibit strong zero-shot generalization across domains. Motivated by this trend, we investigate whether…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Yuxiang Lai , Jike Zhong , Ming Li , Yuheng Li , Xiaofeng Yang

In medical image classification tasks, it is common to find that the number of normal samples far exceeds the number of abnormal samples. In such class-imbalanced situations, reliable training of deep neural networks continues to be a major…

Machine Learning · Computer Science 2022-04-06 Sivaramakrishnan Rajaraman , Prasanth Ganesan , Sameer Antani

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen compositions from seen states and objects. The disparity between the manually labeled semantic information and its actual visual features causes a significant imbalance of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Chenyi Jiang , Dubing Chen , Shidong Wang , Yuming Shen , Haofeng Zhang , Ling Shao

Pretrained large-scale vision-language models like CLIP have exhibited strong generalization over unseen tasks. Yet imperceptible adversarial perturbations can significantly reduce CLIP's performance on new tasks. In this work, we identify…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chengzhi Mao , Scott Geng , Junfeng Yang , Xin Wang , Carl Vondrick

Accurate identification and localization of anatomical structures of varying size and appearance in laparoscopic imaging are necessary to leverage the potential of computer vision techniques for surgical decision support. Segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Fiona R. Kolbinger , Jiangpeng He , Jinge Ma , Fengqing Zhu

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Medical image segmentation of gadolinium enhancement magnetic resonance imaging (GE MRI) is an important task in clinical applications. However, manual annotation is time-consuming and requires specialized expertise. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yunsung Chung , Chanho Lim , Chao Huang , Nassir Marrouche , Jihun Hamm

Many strides have been made in semantic segmentation of multiple classes within an image. This has been largely due to advancements in deep learning and convolutional neural networks (CNNs). Features within a CNN are automatically learned…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Erik Gaasedelen , Alex Deakyne , Paul Iaizzo

Contrastive learning operates on a simple yet effective principle: Embeddings of positive pairs are pulled together, while those of negative pairs are pushed apart. In this paper, we propose a unified framework for understanding contrastive…

Machine Learning · Computer Science 2025-07-16 Chungpa Lee , Sehee Lim , Kibok Lee , Jy-yong Sohn

3D medical image segmentation methods have been successful, but their dependence on large amounts of voxel-level annotated data is a disadvantage that needs to be addressed given the high cost to obtain such annotation. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuyuan Liu , Yu Tian , Chong Wang , Yuanhong Chen , Fengbei Liu , Vasileios Belagiannis , Gustavo Carneiro

While developments in machine learning led to impressive performance gains on big data, many human subjects data are, in actuality, small and sparsely labeled. Existing methods applied to such data often do not easily generalize to…

Machine Learning · Computer Science 2023-04-04 Julie Jiang , Kristina Lerman , Emilio Ferrara