English
Related papers

Related papers: FedFMS: Exploring Federated Foundation Models for …

200 papers

In this work, we propose a fast adaptive federated meta-learning (FAM) framework for collaboratively learning a single global model, which can then be personalized locally on individual clients. Federated learning enables multiple clients…

Machine Learning · Computer Science 2023-09-04 Indrajeet Kumar Sinha , Shekhar Verma , Krishna Pratap Singh

Medical image segmentation involves partitioning medical images into meaningful regions, with a focus on identifying anatomical structures and lesions. It has broad applications in healthcare, and deep learning methods have enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Donghang Lyu , Ruochen Gao , Marius Staring

In medical imaging, developing generalized segmentation models that can handle multiple organs and lesions is crucial. However, the scarcity of fully annotated datasets and strict privacy regulations present significant barriers to data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Pochuan Wang , Chen Shen , Masahiro Oda , Chiou-Shann Fuh , Kensaku Mori , Weichung Wang , Holger R. Roth

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Medical vision foundational models are used for a wide variety of tasks, including medical image segmentation and registration. This work evaluates the ability of these models to predict disease progression using a simple linear probe. We…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Basar Demir , Soumitri Chattopadhyay , Thomas Hastings Greer , Boqi Chen , Marc Niethammer

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

The research community has witnessed the powerful potential of self-supervised Masked Image Modeling (MIM), which enables the models capable of learning visual representation from unlabeled data. In this paper, to incorporate both the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenxuan Wang , Jing Wang , Chen Chen , Jianbo Jiao , Yuanxiu Cai , Shanshan Song , Jiangyun Li

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

This paper presents FeTal-SAM, a novel adaptation of the Segment Anything Model (SAM) tailored for fetal brain MRI segmentation. Traditional deep learning methods often require large annotated datasets for a fixed set of labels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Qi Zeng , Weide Liu , Bo Li , Ryne Didier , P. Ellen Grant , Davood Karimi

Foundation models (FMs) have demonstrated remarkable performance in machine learning but demand extensive training data and computational resources. Federated learning (FL) addresses the challenges posed by FMs, especially related to data…

Machine Learning · Computer Science 2023-10-24 Jiyun Shin , Jinhyun Ahn , Honggu Kang , Joonhyuk Kang

Medical image segmentation is a critical task in computer-aided diagnosis and treatment planning. However, deep learning models often struggle to generalize across datasets due to domain shifts arising from variations in imaging protocols,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Phuoc-Nguyen Bui , Van-Nguyen Pham , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Huanli Zhuo , Leilei Ma , Haifeng Zhao , Shiwei Zhou , Dengdi Sun , Yanping Fu

Adapting large pre-trained foundation models, e.g., SAM, for medical image segmentation remains a significant challenge. A crucial step involves the formulation of a series of specialized prompts that incorporate specific clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiuqi Zheng , Yuhang Zhang , Haoran Zhang , Hongrui Liang , Xueqi Bao , Zhuqing Jiang , Qicheng Lao

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Collaborative training across multiple institutions is becoming essential for building reliable medical image segmentation models. However, privacy regulations, data silos, and uneven data availability prevent hospitals from sharing raw…

Quantitative Methods · Quantitative Biology 2026-03-09 Saheed Ademola Bello , Muhammad Shahid Jabbar , Muhammad Sohail Ibrahim , Shujaat Khan

The field of medical image segmentation is hindered by the scarcity of large, publicly available annotated datasets. Not all datasets are made public for privacy reasons, and creating annotations for a large dataset is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Iira Häkkinen , Iaroslav Melekhov , Erik Englesson , Hossein Azizpour , Juho Kannala

Medical image segmentation is a fundamental and critical step in many image-guided clinical approaches. Recent success of deep learning-based segmentation methods usually relies on a large amount of labeled data, which is particularly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Rushi Jiao , Yichi Zhang , Le Ding , Rong Cai , Jicong Zhang

Privacy data protection in the medical field poses challenges to data sharing, limiting the ability to integrate data across hospitals for training high-precision auxiliary diagnostic models. Traditional centralized training methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Tian Bowen , Xu Zhengyang , Yin Zhihao , Wang Jingying , Yue Yutao

Despite significant advances in deep learning for image and video segmentation, existing models continue to face challenges in cross-domain adaptability and generalization. Image and video segmentation are fundamental tasks in computer…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhang Jiaxing , Tang Hao