English
Related papers

Related papers: MIS-FM: 3D Medical Image Segmentation using Founda…

200 papers

This study investigates the impact of self-supervised pretraining of 3D semantic segmentation models on a large-scale, domain-specific dataset. We introduce BRAINS-45K, a dataset of 44,756 brain MRI volumes from public sources, the largest…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Asbjørn Munk , Jakob Ambsdorf , Sebastian Llambias , Mads Nielsen

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

Segmentation is a critical step in medical image analysis. Fully Convolutional Networks (FCNs) have emerged as powerful segmentation models achieving state-of-the-art results in various medical image datasets. Network architectures are…

Image and Video Processing · Electrical Eng. & Systems 2019-07-29 Maria G. Baldeon Calisto , Susana K. Lai-Yuen

Given the large-scale data and the high annotation cost, pretraining-finetuning becomes a popular paradigm in multiple computer vision tasks. Previous research has covered both the unsupervised pretraining and supervised finetuning in this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yichen Xie , Han Lu , Junchi Yan , Xiaokang Yang , Masayoshi Tomizuka , Wei Zhan

The Vision Transformer (ViT) has demonstrated remarkable performance in Self-Supervised Learning (SSL) for 3D medical image analysis. Masked AutoEncoder (MAE) for feature pre-training can further unleash the potential of ViT on various…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Jiaxin Zhuang , Linshan Wu , Qiong Wang , Peng Fei , Varut Vardhanabhuti , Lin Luo , Hao Chen

Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained on manually segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Pawel Mlynarski , Hervé Delingette , Antonio Criminisi , Nicholas Ayache

State-of-the-art vessel segmentation methods typically require large-scale annotated datasets and suffer from severe performance degradation under domain shifts. In clinical practice, however, acquiring extensive annotations for every new…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Kirato Yoshihara , Yohei Sugawara , Yuta Tokuoka , Lihang Hong

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

Masked Autoencoders (MAEs) have been shown to be effective in pre-training Vision Transformers (ViTs) for natural and medical image analysis problems. By reconstructing missing pixel/voxel information in visible patches, a ViT encoder can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Pengfei Gu , Huimin Li , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Automatic fetal brain tissue segmentation can enhance the quantitative assessment of brain development at this critical stage. Deep learning methods represent the state of the art in medical image segmentation and have also achieved…

Image and Video Processing · Electrical Eng. & Systems 2023-01-05 Davood Karimi , Caitlin K. Rollins , Clemente Velasco-Annis , Abdelhakim Ouaalam , Ali Gholipour

Volumetric medical segmentation is a critical component of 3D medical image analysis that delineates different semantic regions. Deep neural networks have significantly improved volumetric medical segmentation, but they generally require…

Image and Video Processing · Electrical Eng. & Systems 2024-07-18 Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan

Vision foundation models (VFMs) have emerged as powerful tools for surgical scene understanding. However, current approaches predominantly rely on unimodal RGB pre-training, overlooking the complex 3D geometry inherent to surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 John J. Han , Adam Schmidt , Muhammad Abdullah Jamal , Chinedu Nwoye , Anita Rau , Jie Ying Wu , Omid Mohareri

Liver cancer is one of the most common malignant diseases in the world. Segmentation and labeling of liver tumors and blood vessels in CT images can provide convenience for doctors in liver tumor diagnosis and surgical intervention. In the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-01 Xiangyu Meng , Xudong Zhang , Gan Wang , Ying Zhang , Xin Shi , Huanhuan Dai , Zixuan Wang , Xun Wang

Multi-parametric magnetic resonance (MR) imaging is an indispensable tool in the clinic. Consequently, automatic volume-of-interest segmentation based on multi-parametric MR imaging is crucial for computer-aided disease diagnosis, treatment…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Cheng Li , Yousuf Babiker M. Osman , Weijian Huang , Zhenzhen Xue , Hua Han , Hairong Zheng , Shanshan Wang

Visible and infrared image fusion (VIF) has attracted significant attention in recent years. Traditional VIF methods primarily focus on generating fused images with high visual quality, while recent advancements increasingly emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zixian Zhao , Andrew Howes , Xingchen Zhang

Current multi-modal image fusion methods typically rely on task-specific models, leading to high training costs and limited scalability. While generative methods provide a unified modeling perspective, they often suffer from slow inference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Huayi Zhu , Xiu Shu , Youqiang Xiong , Qiao Liu , Rui Chen , Di Yuan , Xiaojun Chang , Zhenyu He

Foundation models such as Segment Anything Model 2 (SAM 2) exhibit strong generalization on natural images and videos but perform poorly on medical data due to differences in appearance statistics, imaging physics, and three-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Satrajit Chakrabarty , Sourya Sengupta , Gopal Avinash , Ravi Soni

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Convolutional Neural Networks (CNNs) have been recently employed to solve problems from both the computer vision and medical image analysis fields. Despite their popularity, most approaches are only able to process 2D images while most…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Fausto Milletari , Nassir Navab , Seyed-Ahmad Ahmadi

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu