English
Related papers

Related papers: CML-MOTS: Collaborative Multi-task Learning for Mu…

200 papers

The problem of video object segmentation can become extremely challenging when multiple instances co-exist. While each instance may exhibit large scale and pose variations, the problem is compounded when instances occlude each other causing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Xiaoxiao Li , Chen Change Loy

This paper tackles the problem of video object segmentation. We are specifically concerned with the task of segmenting all pixels of a target object in all frames, given the annotation mask in the first frame. Even when such annotation is…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yu Liu , Lingqiao Liu , Haokui Zhang , Hamid Rezatofighi , Ian Reid

In this paper, we introduce the Context-Aware Video Instance Segmentation (CAVIS), a novel framework designed to enhance instance association by integrating contextual information adjacent to each object. To efficiently extract and leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Seunghun Lee , Jiwan Seo , Kiljoon Han , Minwoo Choi , Sunghoon Im

Video instance segmentation is a complex task in which we need to detect, segment, and track each object for any given video. Previous approaches only utilize single-frame features for the detection, segmentation, and tracking of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Yang Fu , Linjie Yang , Ding Liu , Thomas S. Huang , Humphrey Shi

Most existing Multi-Object Tracking (MOT) approaches follow the Tracking-by-Detection paradigm and the data association framework where objects are firstly detected and then associated. Although deep-learning based method can noticeably…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xingyu Wan , Jiakai Cao , Sanping Zhou , Jinjun Wang

Moving object segmentation plays a crucial role in understanding dynamic scenes involving multiple moving objects, while the difficulties lie in taking into account both spatial texture structures and temporal motion cues. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Zhexiong Wan , Bin Fan , Le Hui , Yuchao Dai , Gim Hee Lee

Multi-task learning based video anomaly detection methods combine multiple proxy tasks in different branches to detect video anomalies in different situations. Most existing methods either do not combine complementary tasks to effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Mohammad Baradaran , Robert Bergevin

Learning a data-driven spatio-temporal semantic representation of the objects is the key to coherent and consistent labelling in video. This paper proposes to achieve semantic video object segmentation by learning a data-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tinghuai Wang

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang

Tracking and segmenting multiple objects in complex scenes has always been a challenge in the field of video object segmentation, especially in scenarios where objects are occluded and split into parts. In such cases, the definition of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Deshui Miao , Xin Li , Zhenyu He , Yaowei Wang , Ming-Hsuan Yang

We introduce a method for simultaneously classifying, segmenting and tracking object instances in a video sequence. Our method, named MaskProp, adapts the popular Mask R-CNN to video by adding a mask propagation branch that propagates…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Gedas Bertasius , Lorenzo Torresani

Video Instance Segmentation (VIS) is a multi-task problem performing detection, segmentation, and tracking simultaneously. Extended from image set applications, video data additionally induces the temporal information, which, if handled…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Thuy C. Nguyen , Tuan N. Tang , Nam LH. Phan , Chuong H. Nguyen , Masayuki Yamazaki , Masao Yamanaka

With the advancement of video analysis technology, the multi-object tracking (MOT) problem in complex scenes involving pedestrians is gaining increasing importance. This challenge primarily involves two key tasks: pedestrian detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jiayi Chen , Chunhua Deng

Visual object tracking is a fundamental video task in computer vision. Recently, the notably increasing power of perception algorithms allows the unification of single/multiobject and box/mask-based tracking. Among them, the Segment…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Jiawen Zhu , Zhenyu Chen , Zeqi Hao , Shijie Chang , Lu Zhang , Dong Wang , Huchuan Lu , Bin Luo , Jun-Yan He , Jin-Peng Lan , Hanyuan Chen , Chenyang Li

Multiple object tracking (MOT) in urban traffic aims to produce the trajectories of the different road users that move across the field of view with different directions and speeds and that can have varying appearances and sizes. Occlusions…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Hui-Lee Ooi , Guillaume-Alexandre Bilodeau , Nicolas Saunier , David-Alexandre Beaupré

Recently, significant progress has been made in multi-modal continual learning, aiming to learn new tasks sequentially in multi-modal settings while preserving performance on previously learned ones. However, existing methods mainly focus…

Multimedia · Computer Science 2026-03-10 Yuyang Hong , Qi Yang , Tao Zhang , Zili Wang , Zhaojin Fu , Kun Ding , Bin Fan , Shiming Xiang

Video-based computer vision tasks can benefit from estimation of the salient regions and interactions between those regions. Traditionally, this has been done by identifying the object regions in the images by utilizing pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Arulkumar Subramaniam , Jayesh Vaidya , Muhammed Abdul Majeed Ameen , Athira Nambiar , Anurag Mittal

The task of assigning semantic classes and track identities to every pixel in a video is called video panoptic segmentation. Our work is the first that targets this task in a real-world setting requiring dense interpretation in both spatial…

We present joint learning of instance and semantic segmentation for visible and occluded region masks. Sharing the feature extractor with instance occlusion segmentation, we introduce semantic occlusion segmentation into the instance…

Robotics · Computer Science 2020-01-22 Kentaro Wada , Kei Okada , Masayuki Inaba

Multi-Camera Multi-Object Tracking (MC-MOT) utilizes information from multiple views to better handle problems with occlusion and crowded scenes. Recently, the use of graph-based approaches to solve tracking problems has become very…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Cheng-Che Cheng , Min-Xuan Qiu , Chen-Kuo Chiang , Shang-Hong Lai