English
Related papers

Related papers: Improving Unsupervised Video Object Segmentation w…

200 papers

Video Object Segmentation (VOS) is crucial for several applications, from video editing to video data generation. Training a VOS model requires an abundance of manually labeled training videos. The de-facto traditional way of annotating…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Thanos Delatolas , Vicky Kalogeiton , Dim P. Papadopoulos

In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneously segment and track all objects in the video that are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Siyuan Zhou , Chunru Zhan , Biao Wang , Tiezheng Ge , Yuning Jiang , Li Niu

The performance of Video Instance Segmentation (VIS) methods has improved significantly with the advent of transformer networks. However, these networks often face challenges in training due to the high annotation cost. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Farnoosh Arefi , Amir M. Mansourian , Shohreh Kasaei

The Segmentation Anything Model (SAM) requires labor-intensive data labeling. We present Unsupervised SAM (UnSAM) for promptable and automatic whole-image segmentation that does not require human annotations. UnSAM utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 XuDong Wang , Jingfeng Yang , Trevor Darrell

Brain tumor segmentation is important for diagnosis of the tumor, and current deep-learning methods rely on a large set of annotated images for training, with high annotation costs. Unsupervised segmentation is promising to avoid human…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Xiaochuan Ma , Jia Fu , Wenjun Liao , Shichuan Zhang , Guotai Wang

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

Semi-supervised video object segmentation (VOS) aims to segment arbitrary target objects in video when the ground truth segmentation mask of the initial frame is provided. Due to this limitation of using prior knowledge about the target…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Suhwan Cho , Heansung Lee , Sungmin Woo , Sungjun Jang , Sangyoun Lee

Incompletely-Supervised Concealed Object Segmentation (ISCOS) involves segmenting objects that seamlessly blend into their surrounding environments, utilizing incompletely annotated data, such as weak and semi-annotations, for model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chunming He , Kai Li , Yachao Zhang , Ziyun Yang , Youwei Pang , Longxiang Tang , Chengyu Fang , Yulun Zhang , Linghe Kong , Xiu Li , Sina Farsiu

Video Object Segmentation (VOS) task aims to segment objects in videos. However, previous settings either require time-consuming manual masks of target objects at the first frame during inference or lack the flexibility to specify arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pinxue Guo , Lingyi Hong , Xinyu Zhou , Shuyong Gao , Wanyun Li , Jinglun Li , Zhaoyu Chen , Xiaoqiang Li , Wei Zhang , Wenqiang Zhang

Interactive segmentation enables users to segment as needed by providing cues of objects, which introduces human-computer interaction for many fields, such as image editing and medical image analysis. Typically, massive and expansive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Kehan Li , Yian Zhao , Zhennan Wang , Zesen Cheng , Peng Jin , Xiangyang Ji , Li Yuan , Chang Liu , Jie Chen

Moving object segmentation is a crucial task for achieving a high-level understanding of visual scenes and has numerous downstream applications. Humans can effortlessly segment moving objects in videos. Previous work has largely relied on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Nan Huang , Wenzhao Zheng , Chenfeng Xu , Kurt Keutzer , Shanghang Zhang , Angjoo Kanazawa , Qianqian Wang

The current popular methods for video object segmentation (VOS) implement feature matching through several hand-crafted modules that separately perform feature extraction and matching. However, the above hand-crafted designs empirically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiangqiang Wu , Tianyu Yang , Wei WU , Antoni Chan

Recent video foundation models such as SAM2 excel at prompted video segmentation by treating masks as a general-purpose primitive. However, many real-world settings require unprompted segmentation that aims to detect and track all objects…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Miran Heo , Sukjun Hwang , Min-Hung Chen , Yu-Chiang Frank Wang , Albert Gu , Seon Joo Kim , Ryo Hachiuma

To be effective in unstructured and changing environments, robots must learn to recognize new objects. Deep learning has enabled rapid progress for object detection and segmentation in computer vision; however, this progress comes at the…

Robotics · Computer Science 2020-03-05 Victoria Florence , Jason J. Corso , Brent Griffin

In this paper, we show that transferring knowledge from other domains of video understanding combined with large-scale learning can improve robustness of Video Object Segmentation (VOS) under complex circumstances. Namely, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Volodymyr Fedynyak , Yaroslav Romanus , Oles Dobosevych , Igor Babin , Roman Riazantsev

We propose an approach for Open-World Instance Segmentation (OWIS), a task that aims to segment arbitrary unknown objects in images by generalizing from a limited set of annotated object classes during training. Our Segment Object System…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Christian Wilms , Tim Rolff , Maris Hillemann , Robert Johanson , Simone Frintrop

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequence. In our work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Carles Ventura , Miriam Bellver , Andreu Girbau , Amaia Salvador , Ferran Marques , Xavier Giro-i-Nieto

Objective Semi-supervised video object segmentation refers to segmenting the object in subsequent frames given the object label in the first frame. Existing algorithms are mostly based on the objectives of matching and propagation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Zhang Xuerui , Yuan Xia

Camouflaged object segmentation presents unique challenges compared to traditional segmentation tasks, primarily due to the high similarity in patterns and colors between camouflaged objects and their backgrounds. Effective solutions to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenqi Guo , Mohamed Shehata , Shan Du

Surgical instrument segmentation (SIS) on endoscopic images stands as a long-standing and essential task in the context of computer-assisted interventions for boosting minimally invasive surgery. Given the recent surge of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Mingyu Sheng , Jianan Fan , Dongnan Liu , Ron Kikinis , Weidong Cai