English
Related papers

Related papers: Learning What to Learn for Video Object Segmentati…

200 papers

Detecting rare objects from a few examples is an emerging problem. Prior works show meta-learning is a promising approach. But, fine-tuning techniques have drawn scant attention. We find that fine-tuning only the last layer of existing…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xin Wang , Thomas E. Huang , Trevor Darrell , Joseph E. Gonzalez , Fisher Yu

In the few-shot scenario, a learner must effectively generalize to unseen classes given a small support set of labeled examples. While a relatively large amount of research has gone into few-shot learning for image classification, little…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Chris Careaga , Brian Hutchinson , Nathan Hodas , Lawrence Phillips

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

Video Object Segmentation (VOS) aims to track and segment specific objects across entire video sequences, yet it remains highly challenging under complex real-world scenarios. The MOSEv1 and LVOS dataset, adopted in the MOSEv1 challenge on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Tingmin Li , Yixuan Li , Yang Yang

Video object segmentation (VOS) is a critical task in the development of video perception and understanding. The Segment-Anything Model 2 (SAM 2), released by Meta AI, is the current state-of-the-art architecture for end-to-end VOS. SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Clayton Bromley , Alexander Moore , Amar Saini , Doug Poland , Carmen Carrano

Current prevailing Video Object Segmentation methods follow the pipeline of extraction-then-matching, which first extracts features on current and reference frames independently, and then performs dense matching between them. This decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Jiaming Zhang , Yutao Cui , Gangshan Wu , Limin Wang

Multi-Object Tracking (MOT) remains a vital component of intelligent video analysis, which aims to locate targets and maintain a consistent identity for each target throughout a video sequence. Existing works usually learn a discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yizhe Li , Sanping Zhou , Zheng Qin , Le Wang , Jinjun Wang , Nanning Zheng

Most object-level mapping systems in use today make use of an upstream learned object instance segmentation model. If we want to teach them about a new object or segmentation class, we need to build a large dataset and retrain the system.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Nicolas Gorlo , Kenneth Blomqvist , Francesco Milano , Roland Siegwart

Video object segmentation can be understood as a sequence-to-sequence task that can benefit from the curriculum learning strategies for better and faster training of deep neural networks. This work explores different schedule sampling and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maria Gonzalez-i-Calabuig , Carles Ventura , Xavier Giró-i-Nieto

Video object segmentation is an essential task in robot manipulation to facilitate grasping and learning affordances. Incremental learning is important for robotics in unstructured environments, since the total number of objects and their…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Mennatullah Siam , Chen Jiang , Steven Lu , Laura Petrich , Mahmoud Gamal , Mohamed Elhoseiny , Martin Jagersand

In this paper, we show that transferring knowledge from other domains of video understanding combined with large-scale learning can improve robustness of Video Object Segmentation (VOS) under complex circumstances. Namely, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Volodymyr Fedynyak , Yaroslav Romanus , Oles Dobosevych , Igor Babin , Roman Riazantsev

Few-shot video object segmentation (FS-VOS) aims at segmenting video frames using a few labelled examples of classes not seen during initial training. In this paper, we present a simple but effective temporal transductive inference (TTI)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mennatullah Siam , Konstantinos G. Derpanis , Richard P. Wildes

This paper proposes a framework for the interactive video object segmentation (VOS) in the wild where users can choose some frames for annotations iteratively. Then, based on the user annotations, a segmentation algorithm refines the masks.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Zhaoyuan Yin , Jia Zheng , Weixin Luo , Shenhan Qian , Hanling Zhang , Shenghua Gao

In this paper, the main task we aim to tackle is the multi-instance semi-supervised video object segmentation across a sequence of frames where only the first-frame box-level ground-truth is provided. Detection-based algorithms are widely…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Mingjie Sun , Jimin Xiao , Eng Gee Lim , Bingfeng Zhang , Yao Zhao

Video instance segmentation (VIS) aims to segment and associate all instances of predefined classes for each frame in videos. Prior methods usually obtain segmentation for a frame or clip first, and merge the incomplete results by tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Huaijia Lin , Ruizheng Wu , Shu Liu , Jiangbo Lu , Jiaya Jia

Visual object tracking and segmentation in omnidirectional videos are challenging due to the wide field-of-view and large spherical distortion brought by 360{\deg} images. To alleviate these problems, we introduce a novel representation,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yinzhe Xu , Huajian Huang , Yingshu Chen , Sai-Kit Yeung

Significant progress has been made recently in developing few-shot object segmentation methods. Learning is shown to be successful in few-shot segmentation settings, using pixel-level, scribbles and bounding box supervision. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Mennatullah Siam , Naren Doraiswamy , Boris N. Oreshkin , Hengshuai Yao , Martin Jagersand

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

Online video object segmentation is a challenging task as it entails to process the image sequence timely and accurately. To segment a target object through the video, numerous CNN-based methods have been developed by heavily finetuning on…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jingchun Cheng , Yi-Hsuan Tsai , Wei-Chih Hung , Shengjin Wang , Ming-Hsuan Yang

We introduce a one-shot learning approach for video object tracking. The proposed algorithm requires seeing the object to be tracked only once, and employs an external memory to store and remember the evolving features of the foreground…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Boyu Liu , Yanzhao Wang , Yu-Wing Tai , Chi-Keung Tang