English
Related papers

Related papers: Repurposing SAM for User-Defined Semantics Aware S…

200 papers

The performance of deep learning based semantic segmentation models heavily depends on sufficient data with careful annotations. However, even the largest public datasets only provide samples with pixel-level annotations for rather limited…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Huaxin Xiao , Yunchao Wei , Yu Liu , Maojun Zhang , Jiashi Feng

In the evolving landscape of computer vision, foundation models have emerged as pivotal tools, exhibiting exceptional adaptability to a myriad of tasks. Among these, the Segment Anything Model (SAM) by Meta AI has distinguished itself in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Bo Li , Haoke Xiao , Lv Tang

This paper tackles a novel yet challenging problem: how to transfer knowledge from the emerging Segment Anything Model (SAM) -- which reveals impressive zero-shot instance segmentation capacity -- to learn a compact panoramic semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Weiming Zhang , Yexin Liu , Xu Zheng , Lin Wang

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

The current state-of-the-art methods for unsupervised video object segmentation (UVOS) require extensive training on video datasets with mask annotations, limiting their effectiveness in handling challenging scenarios. However, the Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Zhenghao Zhang , Shengfan Zhang , Zhichao Wei , Zuozhuo Dai , Siyu Zhu

The recent Segment Anything Models (SAMs) have emerged as foundational visual models for general interactive segmentation. Despite demonstrating robust generalization abilities, they still suffer performance degradations in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yuan Yao , Qiushi Yang , Miaomiao Cui , Liefeng Bo

Several recent works discussed application-driven image restoration neural networks, which are capable of not only removing noise in images but also preserving their semantic-aware details, making them suitable for various high-level…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Sicheng Wang , Bihan Wen , Junru Wu , Dacheng Tao , Zhangyang Wang

Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Wei Ji , Jingjing Li , Qi Bi , Tingwei Liu , Wenbo Li , Li Cheng

Pixel-level annotation demands expensive human efforts and limits the performance of deep networks that usually benefits from more such training data. In this work we aim to achieve high quality instance and semantic segmentation results…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Chuang Niu , Shenghan Ren , Jimin Liang

Background: The segment-anything model (SAM), introduced in April 2023, shows promise as a benchmark model and a universal solution to segment various natural images. It comes without previously-required re-training or fine-tuning specific…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Sheng He , Rina Bao , Jingpeng Li , Jeffrey Stout , Atle Bjornerud , P. Ellen Grant , Yangming Ou

Though quite challenging, leveraging large-scale unlabeled or partially labeled images in a cost-effective way has increasingly attracted interests for its great importance to computer vision. To tackle this problem, many Active Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Keze Wang , Xiaopeng Yan , Dongyu Zhang , Lei Zhang , Liang Lin

The goal of Audio-Visual Segmentation (AVS) is to localize and segment the sounding source objects from video frames. Research on AVS suffers from data scarcity due to the high cost of fine-grained manual annotations. Recent works attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Kyungbok Lee , You Zhang , Zhiyao Duan

In recent years, the need for semantic segmentation has arisen across several different applications and environments. However, the expense and redundancy of annotation often limits the quantity of labels available for training in any…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Tarun Kalluri , Girish Varma , Manmohan Chandraker , C V Jawahar

This paper proposes a new active learning method for semantic segmentation. The core of our method lies in a new annotation query design. It samples informative local image regions (e.g., superpixels), and for each of such regions, asks an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Sehyun Hwang , Sohyun Lee , Hoyoung Kim , Minhyeon Oh , Jungseul Ok , Suha Kwak

A central challenge for the task of semantic segmentation is the prohibitive cost of obtaining dense pixel-level annotations to supervise model training. In this work, we show that in order to achieve a good level of segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Gyungin Shin , Weidi Xie , Samuel Albanie

The Segment Anything Model (SAM) has revolutionized natural image segmentation, nevertheless, its performance on underwater images is still restricted. This work presents AquaSAM, the first attempt to extend the success of SAM on underwater…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Muduo Xu , Jianhao Su , Yutao Liu

Current weakly supervised object localization and segmentation rely on class-discriminative visualization techniques to generate pseudo-labels for pixel-level training. Such visualization methods, including class activation mapping (CAM)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Xiangwei Shi , Seyran Khademi , Yunqiang Li , Jan van Gemert

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

Purpose: The Segment Anything Model (SAM) promises to ease the annotation bottleneck in medical segmentation, but overlapping anatomy and blurred boundaries make its point prompts ambiguous, leading to cycles of manual refinement to achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Adrien Meyer , Lorenzo Arboit , Giuseppe Massimiani , Shih-Min Yin , Didier Mutter , Nicolas Padoy

In contrast to the human vision that mainly depends on the shape for recognizing the objects, deep image recognition models are widely known to be biased toward texture. Recently, Meta research team has released the first foundation model…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Chaoning Zhang , Yu Qiao , Shehbaz Tariq , Sheng Zheng , Chenshuang Zhang , Chenghao Li , Hyundong Shin , Choong Seon Hong