English
Related papers

Related papers: SAM-PARSER: Fine-tuning SAM Efficiently by Paramet…

200 papers

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Segment Anything Model (SAM) has gained significant recognition in the field of semantic segmentation due to its versatile capabilities and impressive performance. Despite its success, SAM faces two primary limitations: (1) it relies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuchen Li , Li Zhang , Youwei Liang , Pengtao Xie

Parameter-efficient fine-tuning (PEFT) is an effective methodology to unleash the potential of large foundation models in novel scenarios with limited training data. In the computer vision community, PEFT has shown effectiveness in image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Lingxi Xie , Qi Tian , Wei Shen

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

The Segment Anything Model (SAM) stands as a foundational framework for image segmentation. While it exhibits remarkable zero-shot generalization in typical scenarios, its advantage diminishes when applied to specialized domains like…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zihan Zhong , Zhiqiang Tang , Tong He , Haoyang Fang , Chun Yuan

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Vision foundation models like the Segment Anything Model (SAM), pretrained on large-scale natural image datasets, often struggle in medical image segmentation due to a lack of domain-specific adaptation. In clinical practice, fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zelin Liu , Sicheng Dong , Bocheng Li , Yixuan Yang , Jiacheng Ruan , Chenxu Zhou , Suncheng Xiang

Fine-tuning pre-trained models has been ubiquitously proven to be effective in a wide range of NLP tasks. However, fine-tuning the whole model is parameter inefficient as it always yields an entirely new model for each task. Currently, many…

Computation and Language · Computer Science 2022-11-29 Zihao Fu , Haoran Yang , Anthony Man-Cho So , Wai Lam , Lidong Bing , Nigel Collier

Recently, Segment Anything Model (SAM) shows exceptional performance in generating high-quality object masks and achieving zero-shot image segmentation. However, as a versatile vision model, SAM is primarily trained with large-scale natural…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Tianyu Yan , Zifu Wan , Xinhao Deng , Pingping Zhang , Yang Liu , Huchuan Lu

The recently introduced Segment Anything Model (SAM) combines a clever architecture and large quantities of training data to obtain remarkable image segmentation capabilities. However, it fails to reproduce such results for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Tal Shaharabany , Aviad Dahan , Raja Giryes , Lior Wolf

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Robotic perception in unstructured environments remains challenging despite the zero-shot capabilities of foundation models such as SAM. This work attributes performance degradation to non-uniform representation shifts across transformer…

Robotics · Computer Science 2026-05-26 Wenhui Chu

The Segment Anything Model (SAM) is a foundation model for general image segmentation. Although it exhibits impressive performance predominantly on natural images, understanding its robustness against various image perturbations and domains…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yuqing Wang , Yun Zhao , Linda Petzold

Recently, the first foundation model developed specifically for image segmentation tasks was developed, termed the "Segment Anything Model" (SAM). SAM can segment objects in input imagery based on cheap input prompts, such as one (or more)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simiao Ren , Francesco Luzi , Saad Lahrichi , Kaleb Kassaw , Leslie M. Collins , Kyle Bradbury , Jordan M. Malof

The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and image editing.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Xu Zhao , Wenchao Ding , Yongqi An , Yinglong Du , Tao Yu , Min Li , Ming Tang , Jinqiao Wang

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

The Segment Anything Model (SAM) has achieved remarkable successes in the realm of natural image segmentation, but its deployment in the medical imaging sphere has encountered challenges. Specifically, the model struggles with medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shreyank N Gowda , David A. Clifton

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

Recently, foundation models have been introduced demonstrating various tasks in the field of computer vision. These models such as Segment Anything Model (SAM) are generalized models trained using huge datasets. Currently, ongoing research…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shurong Chai , Rahul Kumar Jain , Shiyu Teng , Jiaqing Liu , Yinhao Li , Tomoko Tateyama , Yen-wei Chen