English
Related papers

Related papers: From SAM to SAM 2: Exploring Improvements in Meta'…

200 papers

The recently released Segment Anything Model (SAM) has shown powerful zero-shot segmentation capabilities through a semi-automatic annotation setup in which the user can provide a prompt in the form of clicks or bounding boxes. There is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Benjamin Towle , Xin Chen , Ke Zhou

Interactive medical image segmentation (IMIS) has shown significant potential in enhancing segmentation accuracy by integrating iterative feedback from medical professionals. However, the limited availability of enough 3D medical data…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chuyun Shen , Wenhao Li , Yuhang Shi , Xiangfeng Wang

Recently, large vision model, Segment Anything Model (SAM), has revolutionized the computer vision field, especially for image segmentation. SAM presented a new promptable segmentation paradigm that exhibit its remarkable zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chenglong Wang , Dexuan Li , Sucheng Wang , Chengxiu Zhang , Yida Wang , Yun Liu , Guang Yang

Recently, the Segment Anything Model (SAM) gains lots of attention rapidly due to its impressive segmentation performance on images. Regarding its strong ability on image segmentation and high interactivity with different prompts, we found…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Jinyu Yang , Mingqi Gao , Zhe Li , Shang Gao , Fangjing Wang , Feng Zheng

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

Segmented light field images can serve as a powerful representation in many of computer vision tasks exploiting geometry and appearance of objects, such as object pose tracking. In the light field domain, segmentation presents an additional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Nikolai Goncharov , Donald G. Dansereau

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Foundation models have taken over natural language processing and image generation domains due to the flexibility of prompting. With the recent introduction of the Segment Anything Model (SAM), this prompt-driven paradigm has entered image…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Saikat Roy , Tassilo Wald , Gregor Koehler , Maximilian R. Rokuss , Nico Disch , Julius Holzschuh , David Zimmerer , Klaus H. Maier-Hein

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

Previous work has reported that vision foundation models show promising zero-shot performance in eye image segmentation. Here we examine whether the latest iteration of the Segment Anything Model, SAM3, offers better eye image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Diederick C. Niehorster , Marcus Nyström

With breakthroughs in large-scale modeling, the Segment Anything Model (SAM) and its extensions have been attempted for applications in various underwater visualization tasks in marine sciences, and have had a significant impact on the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shijie Lian , Hua Li

Segment Anything Model (SAM), known for its remarkable zero-shot segmentation capabilities, has garnered significant attention in the community. Nevertheless, its performance is challenged when dealing with what we refer to as visually…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Guangqian Guo , Pengfei Chen , Yong Guo , Huafeng Chen , Boqiang Zhang , Shan Gao

In this paper, we explore the zero-shot capability of the Segment Anything Model (SAM) for food image segmentation. To address the lack of class-specific information in SAM-generated masks, we propose a novel framework, called FoodSAM. This…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xing Lan , Jiayi Lyu , Hanyu Jiang , Kun Dong , Zehai Niu , Yi Zhang , Jian Xue

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chaoning Zhang , Dongshen Han , Sheng Zheng , Jinwoo Choi , Tae-Ho Kim , Choong Seon Hong

With the development of large language models, many remarkable linguistic systems like ChatGPT have thrived and achieved astonishing success on many tasks, showing the incredible power of foundation models. In the spirit of unleashing the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Dingyuan Zhang , Dingkang Liang , Hongcheng Yang , Zhikang Zou , Xiaoqing Ye , Zhe Liu , Xiang Bai

Foundation models for image segmentation have shown strong generalization in natural images, yet their applicability to 3D medical imaging remains limited. In this work, we study the zero-shot use of Segment Anything Model 2 (SAM2) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Miquel Lopez Escoriza , Pau Amargant Alvarez

We explore the transformative potential of SAM 2, a vision foundation model, in advancing gaze estimation and eye tracking technologies. By significantly reducing annotation time, lowering technical barriers through its ease of deployment,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marco Carminati , Enkelejda Kasneci

Background: The segment-anything model (SAM), introduced in April 2023, shows promise as a benchmark model and a universal solution to segment various natural images. It comes without previously-required re-training or fine-tuning specific…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Sheng He , Rina Bao , Jingpeng Li , Jeffrey Stout , Atle Bjornerud , P. Ellen Grant , Yangming Ou

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li