English
Related papers

Related papers: Rethinking Memory Design in SAM-Based Visual Objec…

200 papers

Segment Anything Model 2 (SAM2) shows excellent performance in video object segmentation tasks; however, the heavy computational burden hinders its application in real-time video processing. Although there have been efforts to improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jing Zhang , Zhikai Li , Xuewen Liu , Qingyi Gu

We present Segment Anything Model (SAM) 3, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which we define as either short noun phrases (e.g., "yellow school bus"), image exemplars,…

Recent "segment anything" efforts show promise by learning from large-scale data, but adapting such models directly to medical images remains challenging due to the complexity of medical data, noisy annotations, and continual learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhiling Yan , Sifan Song , Dingjie Song , Yiwei Li , Rong Zhou , Weixiang Sun , Zhennong Chen , Sekeun Kim , Hui Ren , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

The Segment Anything Model (SAM) is a widely used vision foundation model with diverse applications, including image segmentation, detection, and tracking. Given SAM's wide applications, understanding its robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jiahuan Long , Zhengqin Xu , Tingsong Jiang , Wen Yao , Shuai Jia , Chao Ma , Xiaoqian Chen

In the domain of large foundation models, the Segment Anything Model (SAM) has gained notable recognition for its exceptional performance in image segmentation. However, tackling the video camouflage object detection (VCOD) task presents a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Muhammad Nawfal Meeran , Gokul Adethya T , Bhanu Pratyush Mantha

Segment Anything Model 2 (SAM 2) has emerged as a powerful tool for video object segmentation and tracking anything. Key components of SAM 2 that drive the impressive video object segmentation performance include a large multistage image…

Research has focused on Multi-Modal Semantic Segmentation (MMSS), where pixel-wise predictions are derived from multiple visual modalities captured by diverse sensors. Recently, the large vision model, Segment Anything Model 2 (SAM2), has…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Chenfei Liao , Xu Zheng , Yuanhuiyi Lyu , Haiwei Xue , Yihong Cao , Jiawen Wang , Kailun Yang , Xuming Hu

Segment Anything Models (SAMs) have gained increasing attention in medical image analysis due to their zero-shot generalization capability in segmenting objects of unseen classes and domains when provided with appropriate user prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Xinyuan Shao , Yiqing Shen , Mathias Unberath

Establishing object-level correspondence between egocentric and exocentric views is essential for intelligent assistants to deliver precise and intuitive visual guidance. However, this task faces numerous challenges, including extreme…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yijun Hu , Bing Fan , Xin Gu , Haiqing Ren , Dongfang Liu , Heng Fan , Libo Zhang

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

Accurate lesion segmentation is essential in medical image analysis, yet most existing methods are designed for specific anatomical sites or imaging modalities, limiting their generalizability. Recent vision-language foundation models…

Image and Video Processing · Electrical Eng. & Systems 2026-03-30 Guoping Xu , Jayaram K. Udupa , Yubing Tong , Xin Long , Ying Zhang , Jie Deng , Weiguo Lu , You Zhang

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Previous work has reported that vision foundation models show promising zero-shot performance in eye image segmentation. Here we examine whether the latest iteration of the Segment Anything Model, SAM3, offers better eye image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Diederick C. Niehorster , Marcus Nyström

Existing visual object tracking usually learns a bounding-box based template to match the targets across frames, which cannot accurately learn a pixel-wise representation, thereby being limited in handling severe appearance variations. To…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Fei Xie , Wankou Yang , Bo Liu , Kaihua Zhang , Wanli Xue , Wangmeng Zuo

Segment Anything Model 2 (SAM2), a vision foundation model has significantly advanced in prompt-driven video object segmentation, yet their practical deployment remains limited by the high computational and memory cost of processing dense…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Avilasha Mandal , Chaoning Zhang , Fachrina Dewi Puspitasari , Xudong Wang , Jiaquan Zhang , Caiyan Qin , Guoqing Wang , Yang Yang , Heng Tao Shen

Video segmentation is essential for advancing robotics and autonomous driving, particularly in open-world settings where continuous perception and object association across video frames are critical. While the Segment Anything Model (SAM)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Pinxue Guo , Zixu Zhao , Jianxiong Gao , Chongruo Wu , Tong He , Zheng Zhang , Tianjun Xiao , Wenqiang Zhang

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

The recent Segment Anything Model (SAM) has emerged as a new paradigmatic vision foundation model, showcasing potent zero-shot generalization and flexible prompting. Despite SAM finding applications and adaptations in various domains, its…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xumeng Han , Longhui Wei , Xuehui Yu , Zhiyang Dou , Xin He , Kuiran Wang , Yingfei Sun , Zhenjun Han , Qi Tian