English
Related papers

Related papers: Blackbox Adaptation for Medical Image Segmentation

200 papers

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

Medical image segmentation poses challenges due to domain gaps, data modality variations, and dependency on domain knowledge or experts, especially for low- and middle-income countries (LMICs). Whereas for humans, given a few exemplars…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chen Xu , Qiming Huang , Yuqi Hou , Jiangxing Wu , Fan Zhang , Hyung Jin Chang , Jianbo Jiao

Medical image segmentation is crucial for clinical diagnosis. The Segmentation Anything Model (SAM) serves as a powerful foundation model for visual segmentation and can be adapted for medical image segmentation. However, medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yuxi Liu , Guibo Luo , Yuesheng Zhu

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

Foundation medical segmentation models, with MedSAM being the most popular, have achieved promising performance across organs and lesions. However, MedSAM still suffers from compromised performance on specific lesions with intricate…

Quantitative Methods · Quantitative Biology 2025-07-16 Kecheng Chen , Xinyu Luo , Tiexin Qin , Jie Liu , Hui Liu , Victor Ho Fun Lee , Hong Yan , Haoliang Li

Vision foundation models have achieved remarkable progress across various image analysis tasks. In the image segmentation task, foundation models like the Segment Anything Model (SAM) enable generalizable zero-shot segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xingxin He , Yifan Hu , Zhaoye Zhou , Mohamed Jarraya , Fang Liu

This paper addresses the domain adaptation challenge for semantic segmentation in medical imaging. Despite the impressive performance of recent foundational segmentation models like SAM on natural images, they struggle with medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Javier Gamazo Tejero , Moritz Schmid , Pablo Márquez Neila , Martin S. Zinkernagel , Sebastian Wolf , Raphael Sznitman

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

The Segment Anything Model (SAM) has demonstrated remarkable capabilities of scaled-up segmentation models, enabling zero-shot generalization across a variety of domains. By leveraging large-scale foundational models as pre-trained models,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Weijia Feng , Lingting Zhu , Lequan Yu

The development of high quality medical image segmentation algorithms depends on the availability of large datasets with pixel-level labels. The challenges of collecting such datasets, especially in case of 3D volumes, motivate to develop…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Ekaterina Redekop , Alexey Chernyavskiy

Existing self-supervised learning methods based on contrastive learning and masked image modeling have demonstrated impressive performances. However, current masked image modeling methods are mainly utilized in natural images, and their…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Xiangtao Wang , Ruizhi Wang , Biao Tian , Jiaojiao Zhang , Shuo Zhang , Junyang Chen , Thomas Lukasiewicz , Zhenghua Xu

The MedSAM model, built upon the SAM framework, enhances medical image segmentation through generalizable training but still exhibits notable limitations. First, constraints in the perturbation window settings during training can cause…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Boyi Li , Ye Yuan , Wenjun Tan

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have significantly impacted medical image segmentation, especially in retinal imaging, where precise segmentation is vital for diagnosis. Despite this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Shahrooz Faghihroohi , Kai Huang , Nassir Navab , M. Ali Nasseri

The recent popularity of foundation models and the pre-train-and-adapt paradigm, where a large-scale model is transferred to downstream tasks, is gaining attention for volumetric medical image segmentation. However, current transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Julio Silva-Rodríguez , Jose Dolz , Ismail Ben Ayed