English
Related papers

Related papers: Solve the Puzzle of Instance Segmentation in Video…

200 papers

We propose an end-to-end learning framework for segmenting generic objects in videos. Our method learns to combine appearance and motion information to produce pixel level segmentation masks for all prominent objects in videos. We formulate…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Suyog Dutt Jain , Bo Xiong , Kristen Grauman

In-context learning (ICL) enables generalization to new tasks with minimal labeled data. However, mainstream ICL approaches rely on a gridding strategy, which lacks the flexibility required for vision applications. We introduce Temporal, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Wahd , Jacob Jaremko , Abhilash Hareendranathan

We propose a novel algorithm for weakly supervised semantic segmentation based on image-level class labels only. In weakly supervised setting, it is commonly observed that trained model overly focuses on discriminative parts rather than the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Seunghoon Hong , Donghun Yeo , Suha Kwak , Honglak Lee , Bohyung Han

In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable deep neural network,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Ye Lyu , George Vosselman , Gui-Song Xia , Michael Ying Yang

Weakly-supervised semantic segmentation under image tags supervision is a challenging task as it directly associates high-level semantic to low-level appearance. To bridge this gap, in this paper, we propose an iterative bottom-up and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Xiang Wang , Shaodi You , Xi Li , Huimin Ma

Video instance segmentation (VIS) is a new and critical task in computer vision. To date, top-performing VIS methods extend the two-stage Mask R-CNN by adding a tracking branch, leaving plenty of room for improvement. In contrast, we…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dongfang Liu , Yiming Cui , Wenbo Tan , Yingjie Chen

Given a single labeled example, in-context segmentation aims to segment corresponding objects. This setting, known as one-shot segmentation in few-shot learning, explores the segmentation model's generalization ability and has been applied…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Mengshi Qi , Pengfei Zhu , Xiangtai Li , Xiaoyang Bi , Lu Qi , Huadong Ma , Ming-Hsuan Yang

Object state changes in video reveal critical cues about human and agent activity. However, existing methods are limited to temporal localization of when the object is in its initial state (e.g., cheese block) versus when it has completed a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Priyanka Mandikal , Tushar Nagarajan , Alex Stoken , Zihui Xue , Kristen Grauman

In the booming video era, video segmentation attracts increasing research attention in the multimedia community. Semi-supervised video object segmentation (VOS) aims at segmenting objects in all target frames of a video, given annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaohao Xu , Jinglu Wang , Xiang Ming , Yan Lu

Semi-supervised video object segmentation is a fundamental yet Challenging task in computer vision. Embedding matching based CFBI series networks have achieved promising results by foreground-background integration approach. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zhixing Huang , Junli Zha , Fei Xie , Yuwei Zheng , Yuandong Zhong , Jinpeng Tang

We address the weakly supervised video highlight detection problem for learning to detect segments that are more attractive in training videos given their video event label but without expensive supervision of manually annotating highlight…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Fa-Ting Hong , Xuanteng Huang , Wei-Hong Li , Wei-Shi Zheng

Learning descriptive spatio-temporal object models from data is paramount for the task of semi-supervised video object segmentation. Most existing approaches mainly rely on models that estimate the segmentation mask based on a reference…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Sergi Caelles , Albert Pumarola , Francesc Moreno-Noguer , Alberto Sanfeliu , Luc Van Gool

This paper presents a novel framework in which video/image segmentation and localization are cast into a single optimization problem that integrates information from low level appearance cues with that of high level localization cues in a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Abhishek Sharma

An instance with a bad mask might make a composite image that uses it look fake. This encourages us to learn segmentation by generating realistic composite images. To achieve this, we propose a novel framework that exploits a new proposed…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Songmin Dai , Xiaoqiang Li , Lu Wang , Pin Wu , Weiqin Tong , Yimin Chen

The task of assigning semantic classes and track identities to every pixel in a video is called video panoptic segmentation. Our work is the first that targets this task in a real-world setting requiring dense interpretation in both spatial…

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

Assigning consistent temporal identifiers to multiple moving objects in a video sequence is a challenging problem. A solution to that problem would have immediate ramifications in multiple object tracking and segmentation problems. We…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abubakar Siddique , Reza Jalil Mozhdehi , Henry Medeiros

In this paper, we propose an unsupervised video object co-segmentation framework based on the primary object proposals to extract the common foreground object(s) from a given video set. In addition to the objectness attributes and motion…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Michael Ying Yang , Matthias Reso , Jun Tang , Wentong Liao , Bodo Rosenhahn

We present a weakly supervised instance segmentation algorithm based on deep community learning with multiple tasks. This task is formulated as a combination of weakly supervised object detection and semantic segmentation, where individual…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Jaedong Hwang , Seohyun Kim , Jeany Son , Bohyung Han

Moving Object Segmentation is a challenging task for jittery/wobbly videos. For jittery videos, the non-smooth camera motion makes discrimination between foreground objects and background layers hard to solve. While most recent works for…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Geethu Miriam Jacob , Sukhendu Das