English
Related papers

Related papers: Continual Alignment for SAM: Rethinking Foundation…

200 papers

Segment Anything Model (SAM), known for its remarkable zero-shot segmentation capabilities, has garnered significant attention in the community. Nevertheless, its performance is challenged when dealing with what we refer to as visually…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Guangqian Guo , Pengfei Chen , Yong Guo , Huafeng Chen , Boqiang Zhang , Shan Gao

Foundation models for image segmentation have shown strong generalization in natural images, yet their applicability to 3D medical imaging remains limited. In this work, we study the zero-shot use of Segment Anything Model 2 (SAM2) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Miquel Lopez Escoriza , Pau Amargant Alvarez

The universality of deep neural networks across different modalities and their generalization capabilities to unseen domains play an essential role in medical image segmentation. The recent segment anything model (SAM) has demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Qing Xu , Jiaxuan Li , Xiangjian He , Chenxin Li , Fiseha B. Tesem , Wenting Duan , Zhen Chen , Rong Qu , Jonathan M. Garibaldi , Chang Wen Chen

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu

In this paper, we explore the zero-shot capability of the Segment Anything Model (SAM) for food image segmentation. To address the lack of class-specific information in SAM-generated masks, we propose a novel framework, called FoodSAM. This…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xing Lan , Jiayi Lyu , Hanyu Jiang , Kun Dong , Zehai Niu , Yi Zhang , Jian Xue

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan

Continual learning protocols are attracting increasing attention from the medical imaging community. In continual environments, datasets acquired under different conditions arrive sequentially; and each is only available for a limited…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Camila Gonzalez , Nick Lemke , Georgios Sakas , Anirban Mukhopadhyay

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

This study introduces SAMatch, a SAM-guided Match-based framework for semi-supervised medical image segmentation, aimed at improving pseudo label quality in data-scarce scenarios. While Match-based frameworks are effective, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Guoping Xu , Xiaoxue Qian , Hua Chieh Shao , Jax Luo , Weiguo Lu , You Zhang

Large-scale foundation models have become the mainstream deep learning method, while in civil engineering, the scale of AI models is strictly limited. In this work, a vision foundation model is introduced for crack segmentation. Two…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Kang Ge , Chen Wang , Yutao Guo , Yansong Tang , Zhenzhong Hu , Hongbing Chen

Segment Anything (SAM), an advanced universal image segmentation model trained on an expansive visual dataset, has set a new benchmark in image segmentation and computer vision. However, it faced challenges when it came to distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiao Feng Zhang , Tian Yi Song , Jia Wei Yao

Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Jing Hu , Kaiwei Yu , Hongjiang Xian , Shu Hu , Xin Wang

Semi-supervised learning has become increasingly popular in medical image segmentation due to its ability to leverage large amounts of unlabeled data to extract additional information. However, most existing semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shengbo Gao , Ziji Zhang , Jiechao Ma , Zihao Li , Shu Zhang

Segment Anything Model (SAM) struggles in open-world scenarios with diverse domains. In such settings, naive fine-tuning with a well-designed learning module is inadequate and often causes catastrophic forgetting issue when learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zeqing Wang , Kangye Ji , Di Wang , Haibin Zhang , Fei Cheng

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

Given a single labeled example, in-context segmentation aims to segment corresponding objects. This setting, known as one-shot segmentation in few-shot learning, explores the segmentation model's generalization ability and has been applied…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Mengshi Qi , Pengfei Zhu , Xiangtai Li , Xiaoyang Bi , Lu Qi , Huadong Ma , Ming-Hsuan Yang