English
Related papers

Related papers: How Universal Are SAM2 Features?

200 papers

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Segment Anything Model 2 (SAM2) has emerged as a strong base model in various pinhole imaging segmentation tasks. However, when applying it to $360^\circ$ domain, the significant field-of-view (FoV) gap between pinhole ($70^\circ \times…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ding Zhong , Xu Zheng , Chenfei Liao , Yuanhuiyi Lyu , Jialei Chen , Shengyang Wu , Linfeng Zhang , Xuming Hu

Semantic Image Segmentation facilitates a multitude of real-world applications ranging from autonomous driving over industrial process supervision to vision aids for human beings. These models are usually trained in a supervised fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Volker Knauthe , Arne Rak , Tristan Wirth , Thomas Pöllabauer , Simon Metzler , Arjan Kuijper , Dieter W. Fellner

Existing image foundation models are not optimized for spherical images having been trained primarily on perspective images. PanoSAMic integrates the pre-trained Segment Anything (SAM) encoder to make use of its extensive training and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Mahdi Chamseddine , Didier Stricker , Jason Rambach

We investigate feature universality in Gemma-2 language models (Gemma-2-2B and Gemma-2-9B), asking whether models with a four-fold difference in scale still converge on comparable internal concepts. Using the Sparse Autoencoder (SAE)…

Computation and Language · Computer Science 2025-08-01 Daniel Son , Sanjana Rathore , Andrew Rufail , Adrian Simon , Daniel Zhang , Soham Dave , Cole Blondin , Kevin Zhu , Sean O'Brien

With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 SeungKyu Kim , Hyun-Jic Oh , Seonghui Min , Won-Ki Jeong

Since the release of Segment Anything 2 (SAM2), the medical imaging community has been actively evaluating its performance for 3D medical image segmentation. However, different studies have employed varying evaluation pipelines, resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yufan He , Pengfei Guo , Yucheng Tang , Andriy Myronenko , Vishwesh Nath , Ziyue Xu , Dong Yang , Can Zhao , Daguang Xu , Wenqi Li

Foundation models like the Segment Anything Model (SAM) show strong generalization, yet adapting them to medical images remains difficult due to domain shift, scarce labels, and the inability of Parameter-Efficient Fine-Tuning (PEFT) to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Vi Vu , Thanh-Huy Nguyen , Tien-Thinh Nguyen , Ba-Thinh Lam , Hoang-Thien Nguyen , Tianyang Wang , Xingjian Li , Min Xu

Despite its flexibility to learn diverse inductive biases in machine learning programs, meta learning (i.e., learning to learn) has long been recognized to suffer from poor scalability due to its tremendous compute/memory costs, training…

Machine Learning · Computer Science 2023-10-24 Sang Keun Choe , Sanket Vaibhav Mehta , Hwijeen Ahn , Willie Neiswanger , Pengtao Xie , Emma Strubell , Eric Xing

We propose MAE-SAM2, a novel foundation model for retinal vascular leakage segmentation on fluorescein angiography images. Due to the small size and dense distribution of the leakage areas, along with the limited availability of labeled…

Tissues and Organs · Quantitative Biology 2026-04-09 Xin Xing , Irmak Karaca , Amir Akhavanrezayat , Samira Badrloo , Quan Dong Nguyen , Mahadevan Subramaniam

Recently, Segment Anything Model (SAM) has become a research hotspot in the fields of multimedia and computer vision, which exhibits powerful yet versatile capabilities on various (un) conditional image segmentation tasks. Although SAM can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Xiaorui Huang , Gen Luo , Chaoyang Zhu , Bo Tong , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

In light of the diminishing returns of traditional methods for enhancing transmission rates, the domain of semantic communication presents promising new frontiers. Focusing on image transmission, this paper explores the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Shehbaz Tariq , Brian Estadimas Arfeto , Chaoning Zhang , Hyundong Shin

Foundation models are experiencing a surge in popularity. The Segment Anything model (SAM) asserts an ability to segment a wide spectrum of objects but required supervised training at unprecedented scale. We compared SAM's performance…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Danielle Ferreira , Rima Arnaout

The perception capability of robotic systems relies on the richness of the dataset. Although Segment Anything Model 2 (SAM2), trained on large datasets, demonstrates strong perception potential in perception tasks, its inherent training…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Jiayi Zhao , Fei Teng , Kai Luo , Guoqiang Zhao , Zhiyong Li , Xu Zheng , Kailun Yang

Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Xi Li , Huimin Ma , Hongbing Ma , Yidong Wang

Deep recognition models are widely vulnerable to adversarial examples, which change the model output by adding quasi-imperceptible perturbation to the image input. Recently, Segment Anything Model (SAM) has emerged to become a popular…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Sheng Zheng , Chaoning Zhang , Xinhong Hao

We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Kaidong Zhang , Dong Liu

Recently, foundation models have been introduced demonstrating various tasks in the field of computer vision. These models such as Segment Anything Model (SAM) are generalized models trained using huge datasets. Currently, ongoing research…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shurong Chai , Rahul Kumar Jain , Shiyu Teng , Jiaqing Liu , Yinhao Li , Tomoko Tateyama , Yen-wei Chen

Foundation models have excelled in various tasks but are often evaluated on general benchmarks. The adaptation of these models for specific domains, such as remote sensing imagery, remains an underexplored area. In remote sensing, precise…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Ali Mayladan , Hasan Nasrallah , Hasan Moughnieh , Mustafa Shukor , Ali J. Ghandour