English
Related papers

Related papers: Learning to Track Instances without Video Annotati…

200 papers

High annotation costs are a major bottleneck for the training of semantic segmentation systems. Therefore, methods working with less annotation effort are of special interest. This paper studies the problem of semi-supervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Olga Zatsarynna , Johann Sawatzky , Juergen Gall

Recently, query based deep networks catch lots of attention owing to their end-to-end pipeline and competitive results on several fundamental computer vision tasks, such as object detection, semantic segmentation, and instance segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Shusheng Yang , Yuxin Fang , Xinggang Wang , Yu Li , Ying Shan , Bin Feng , Wenyu Liu

Video instance segmentation, also known as multi-object tracking and segmentation, is an emerging computer vision research area introduced in 2019, aiming at detecting, segmenting, and tracking instances in videos simultaneously. By…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Chenhao Xu , Chang-Tsun Li , Yongjian Hu , Chee Peng Lim , Douglas Creighton

Object tracking can be formulated as "finding the right object in a video". We observe that recent approaches for class-agnostic tracking tend to focus on the "finding" part, but largely overlook the "object" part of the task, essentially…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Achal Dave , Pavel Tokmakov , Cordelia Schmid , Deva Ramanan

Online Multi-Object Tracking (MOT) from videos is a challenging computer vision task which has been extensively studied for decades. Most of the existing MOT algorithms are based on the Tracking-by-Detection (TBD) paradigm combined with…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Zhen He , Jian Li , Daxue Liu , Hangen He , David Barber

Recently, semi-supervised semantic segmentation has achieved promising performance with a small fraction of labeled data. However, most existing studies treat all unlabeled data equally and barely consider the differences and training…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zhen Zhao , Sifan Long , Jimin Pi , Jingdong Wang , Luping Zhou

Neural networks for multi-domain learning empowers an effective combination of information from different domains by sharing and co-learning the parameters. In visual tracking, the emerging features in shared layers of a multi-domain…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Kourosh Meshgi , Maryam Sadat Mirzaei

An instance with a bad mask might make a composite image that uses it look fake. This encourages us to learn segmentation by generating realistic composite images. To achieve this, we propose a novel framework that exploits a new proposed…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Songmin Dai , Xiaoqiang Li , Lu Wang , Pin Wu , Weiqin Tong , Yimin Chen

Food instance segmentation is essential to estimate the serving size of dishes in a food image. The recent cutting-edge techniques for instance segmentation are deep learning networks with impressive segmentation quality and fast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Huu-Thanh Nguyen , Yu Cao , Chong-Wah Ngo , Wing-Kwong Chan

We introduce a method for simultaneously classifying, segmenting and tracking object instances in a video sequence. Our method, named MaskProp, adapts the popular Mask R-CNN to video by adding a mask propagation branch that propagates…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Gedas Bertasius , Lorenzo Torresani

While image segmentation is crucial in various computer vision applications, such as autonomous driving, grasping, and robot navigation, annotating all objects at the pixel-level for training is nearly impossible. Therefore, the study of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Cuong Manh Hoang , Byeongkeun Kang

We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. To address it, we…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Idoia Ruiz , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Joan Serrat

The ability to quickly annotate medical imaging data plays a critical role in training deep learning frameworks for segmentation. Doing so for image volumes or video sequences is even more pressing as annotating these is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Laurent Lejeune , Raphael Sznitman

Semi-supervised video object segmentation is a task of segmenting the target object in a video sequence given only a mask annotation in the first frame. The limited information available makes it an extremely challenging task. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yunyao Mao , Ning Wang , Wengang Zhou , Houqiang Li

We present a semi-supervised method for panoptic segmentation based on ConsInstancy regularisation, a novel strategy for semi-supervised learning. It leverages completely unlabelled data by enforcing consistency between predicted instance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Max Coenen , Tobias Schack , Dries Beyer , Christian Heipke , Michael Haist

Video Instance Segmentation (VIS) is a multi-task problem performing detection, segmentation, and tracking simultaneously. Extended from image set applications, video data additionally induces the temporal information, which, if handled…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Thuy C. Nguyen , Tuan N. Tang , Nam LH. Phan , Chuong H. Nguyen , Masayuki Yamazaki , Masao Yamanaka

Current multi-object tracking and segmentation (MOTS) methods follow the tracking-by-detection paradigm and adopt convolutions for feature extraction. However, as affected by the inherent receptive field, convolution based feature…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Zhenbo Xu , Wei Zhang , Xiao Tan , Wei Yang , Huan Huang , Shilei Wen , Errui Ding , Liusheng Huang

In order to learn object segmentation models in videos, conventional methods require a large amount of pixel-wise ground truth annotations. However, collecting such supervised data is time-consuming and labor-intensive. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yi-Wen Chen , Yi-Hsuan Tsai , Chu-Ya Yang , Yen-Yu Lin , Ming-Hsuan Yang

Several unsupervised and self-supervised approaches have been developed in recent years to learn visual features from large-scale unlabeled datasets. Their main drawback however is that these methods are hardly able to recognize visual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Alessandra Alfani , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

We propose an end-to-end learning framework for segmenting generic objects in both images and videos. Given a novel image or video, our approach produces a pixel-level mask for all "object-like" regions---even for object categories never…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Bo Xiong , Suyog Dutt Jain , Kristen Grauman