English
Related papers

Related papers: OpenWorldSAM: Extending SAM2 for Universal Image S…

200 papers

In semantic segmentation, generalizing a visual system to both seen categories and novel categories at inference time has always been practically valuable yet challenging. To enable such functionality, existing methods mainly rely on either…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yuhuan Yang , Chaofan Ma , Chen Ju , Fei Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Weakly supervised semantic segmentation (WSSS) aims to bypass the need for laborious pixel-level annotation by using only image-level annotation. Most existing methods rely on Class Activation Maps (CAM) to derive pixel-level pseudo-labels…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Tianle Chen , Zheda Mai , Ruiwen Li , Wei-lun Chao

Few-shot semantic segmentation has recently attracted great attention. The goal is to develop a model capable of segmenting unseen classes using only a few annotated samples. Most existing approaches adapt a pre-trained model by training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Bernardo Forni , Gabriele Lombardi , Federico Pozzi , Mirco Planamente

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

Image segmentation beyond predefined categories is a key challenge in remote sensing, where novel and unseen classes often emerge during inference. Open-vocabulary image Segmentation addresses these generalization issues in traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Saikat Dutta , Akhil Vasim , Siddhant Gole , Hamid Rezatofighi , Biplab Banerjee

Traditional approaches to off-road autonomy rely on separate models for terrain classification, height estimation, and quantifying slip or slope conditions. Utilizing several models requires training each component separately, having task…

Robotics · Computer Science 2026-04-07 Abdelmoamen Nasser , Yousef Baba'a , Murad Mebrahtu , Nadya Abdel Madjid , Jorge Dias , Majid Khonji

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

The Segment Anything Model 2 (SAM 2) is the latest generation foundation model for image and video segmentation. Trained on the expansive Segment Anything Video (SA-V) dataset, which comprises 35.5 million masks across 50.9K videos, SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Ange Lou , Yamin Li , Yike Zhang , Robert F. Labadie , Jack Noble

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guoping Xu , Hua-Chieh Shao , You Zhang

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag

Open-vocabulary semantic segmentation aims to segment images into distinct semantic regions for both seen and unseen categories at the pixel level. Current methods utilize text embeddings from pre-trained vision-language models like CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Ziyu Zhao , Xiaoguang Li , Linjia Shi , Nasrin Imanpour , Song Wang

Grasp detection requires flexibility to handle objects of various shapes without relying on prior knowledge of the object, while also offering intuitive, user-guided control. This paper introduces GraspSAM, an innovative extension of the…

Robotics · Computer Science 2024-09-24 Sangjun Noh , Jongwon Kim , Dongwoo Nam , Seunghyeok Back , Raeyoung Kang , Kyoobin Lee

Segment Anything Model (SAM) has recently gained much attention for its outstanding generalization to unseen data and tasks. Despite its promising prospect, the vulnerabilities of SAM, especially to universal adversarial perturbation (UAP)…

Artificial Intelligence · Computer Science 2024-09-27 Ziqi Zhou , Yufei Song , Minghui Li , Shengshan Hu , Xianlong Wang , Leo Yu Zhang , Dezhong Yao , Hai Jin

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

The goal of Audio-Visual Segmentation (AVS) is to localize and segment the sounding source objects from video frames. Research on AVS suffers from data scarcity due to the high cost of fine-grained manual annotations. Recent works attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Kyungbok Lee , You Zhang , Zhiyao Duan

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu

Semi-supervised learning (SSL) has achieved notable progress in medical image segmentation. To achieve effective SSL, a model needs to be able to efficiently learn from limited labeled data and effectively exploiting knowledge from abundant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Juzheng Miao , Cheng Chen , Keli Zhang , Jie Chuai , Quanzheng Li , Pheng-Ann Heng

Although the Segment Anything Model (SAM) is highly effective in natural image segmentation, it requires dependencies on prompts, which limits its applicability to medical imaging where manual prompts are often unavailable. Existing efforts…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Mengmeng Zhang , Xingyuan Dai , Yicheng Sun , Jing Wang , Yueyang Yao , Xiaoyan Gong , Fuze Cong , Feiyue Wang , Yisheng Lv

The newly released Segment Anything Model (SAM) is a popular tool used in image processing due to its superior segmentation accuracy, variety of input prompts, training capabilities, and efficient model design. However, its current model is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Aimee Guo , Grace Fei , Hemanth Pasupuleti , Jing Wang