English
Related papers

Related papers: Building Universal Foundation Models for Medical I…

200 papers

Medical image segmentation plays an important role in many image-guided clinical approaches. However, existing segmentation algorithms mostly rely on the availability of fully annotated images with pixel-wise annotations for training, which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyan Shi , Jialu Ma , Jin Yang , Shasha Wang , Yichi Zhang

Foundation models hold promise for transforming AI in healthcare by providing modular components that are easily adaptable to downstream healthcare tasks, making AI development more scalable and cost-effective. Structured EHR foundation…

Accurate 3D scene reconstruction is essential for numerous medical tasks. Given the challenges in obtaining ground truth data, there has been an increasing focus on self-supervised learning (SSL) for endoscopic depth estimation as a basis…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Beilei Cui , Long Bai , Mobarakol Islam , An Wang , Zhiqi Ma , Yiming Huang , Feng Li , Zhen Chen , Zhongliang Jiang , Nassir Navab , Hongliang Ren

Machine learning techniques used in computer-aided medical image analysis usually suffer from the domain shift problem caused by different distributions between source/reference data and target data. As a promising solution, domain…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Hao Guan , Mingxia Liu

We propose a segmentation framework that uses deep neural networks and introduce two innovations. First, we describe a biophysics-based domain adaptation method. Second, we propose an automatic method to segment white and gray matter, and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Amir Gholami , Shashank Subramanian , Varun Shenoy , Naveen Himthani , Xiangyu Yue , Sicheng Zhao , Peter Jin , George Biros , Kurt Keutzer

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Universal medical image segmentation models have emerged as a promising paradigm due to their strong generalizability across diverse tasks, showing great potential for a wide range of clinical applications. This potential has been partly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yanwu Yang , Guinan Su , Jiesi Hu , Francesco Sammarco , Jonas Geiping , Thomas Wolfers

Recent advances in deep learning-based medical image segmentation studies achieve nearly human-level performance in fully supervised manner. However, acquiring pixel-level expert annotations is extremely expensive and laborious in medical…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Hyungseob Shin , Hyeongyu Kim , Sewon Kim , Yohan Jun , Taejoon Eo , Dosik Hwang

In most scenarios, conditional image generation can be thought of as an inversion of the image understanding process. Since generic image understanding involves solving multiple tasks, it is natural to aim at generating images via…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Ritika Chakraborty , Nikola Popovic , Danda Pani Paudel , Thomas Probst , Luc Van Gool

Learning-based image reconstruction models, such as those based on the U-Net, require a large set of labeled images if good generalization is to be guaranteed. In some imaging domains, however, labeled data with pixel- or voxel-level label…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Sean I. Young , Adrian V. Dalca , Enzo Ferrante , Polina Golland , Christopher A. Metzler , Bruce Fischl , Juan Eugenio Iglesias

In this study, we aim to initiate the development of Radiology Foundation Model, termed as RadFM. We consider the construction of foundational models from three perspectives, namely, dataset construction, model design, and thorough…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

This paper demonstrates that spatial information can be used to learn interpretable representations in medical images using Self-Supervised Learning (SSL). Our proposed method, ISImed, is based on the observation that medical images exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Nabil Jabareen , Dongsheng Yuan , Sören Lukassen

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-03 Linchuan Xu , Jun Huang , Atsushi Nitanda , Ryo Asaoka , Kenji Yamanishi

Supervised training a deep neural network aims to "teach" the network to mimic human visual perception that is represented by image-and-label pairs in the training data. Superpixelized (SP) images are visually perceivable to humans, but a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Yizhe Zhang , Lin Yang , Hao Zheng , Peixian Liang , Colleen Mangold , Raquel G. Loreto , David P. Hughes , Danny Z. Chen

Data scarcity is a major limiting factor for applying modern machine learning techniques to clinical tasks. Although sufficient data exists for some well-studied medical tasks, there remains a long tail of clinically relevant tasks with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Stefano Woerner , Christian F. Baumgartner

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Chen Tang , Xinzhu Ma , Encheng Su , Xiufeng Song , Xiaohong Liu , Wei-Hong Li , Lei Bai , Wanli Ouyang , Xiangyu Yue

Deep learning-based medical image segmentation typically requires large amount of labeled data for training, making it less applicable in clinical settings due to high annotation cost. Semi-supervised learning (SSL) has emerged as an…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Yichi Zhang , Bohao Lv , Le Xue , Wenbo Zhang , Yuchen Liu , Yu Fu , Yuan Cheng , Yuan Qi

Recently, we have witnessed great progress in the field of medical imaging classification by adopting deep neural networks. However, the recent advanced models still require accessing sufficiently large and representative datasets for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Haoliang Li , YuFei Wang , Renjie Wan , Shiqi Wang , Tie-Qiang Li , Alex C. Kot

Vision foundation models, which have demonstrated significant potential in many multimedia applications, are often underutilized in the natural sciences. This is primarily due to mismatches between the nature of domain-specific scientific…

Instrumentation and Methods for Astrophysics · Physics 2025-11-19 E. Lastufka , O. Bait , M. Drozdova , V. Kinakh , D. Piras , M. Audard , M. Dessauges-Zavadsky , T. Holotyak , D. Schaerer , S. Voloshynovskiy

Medical image analysis relies on accurate segmentation, and benefits from controllable synthesis (of new training images). Yet both tasks of the cyclical pipeline face spatial imbalance: lesions occupy small regions against vast…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Anugunj Naman , Ayushman Singh , Gaibo Zhang , Yaguang Zhang