English
Related papers

Related papers: Look Before You Match: Instance Understanding Matt…

200 papers

Conventional few-shot object segmentation methods learn object segmentation from a few labelled support images with strongly labelled segmentation masks. Recent work has shown to perform on par with weaker levels of supervision in terms of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Mennatullah Siam , Naren Doraiswamy , Boris N. Oreshkin , Hengshuai Yao , Martin Jagersand

Semi-supervised video object segmentation (semi-VOS) is widely used in many applications. This task is tracking class-agnostic objects from a given target mask. For doing this, various approaches have been developed based on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hyojin Park , Ganesh Venkatesh , Nojun Kwak

Recently, instance segmentation has made great progress with the rapid development of deep neural networks. However, there still exist two main challenges including discovering indistinguishable objects and modeling the relationship between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Jinming Su , Ruihong Yin , Xingyue Chen , Junfeng Luo

Semi-supervised video object segmentation (VOS) aims to segment a few moving objects in a video sequence, where these objects are specified by annotation of first frame. The optical flow has been considered in many existing semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Ziyang Liu , Jingmeng Liu , Weihai Chen , Xingming Wu , Zhengguo Li

The task of semi-supervised video object segmentation (VOS) has been greatly advanced and state-of-the-art performance has been made by dense matching-based methods. The recent methods leverage space-time memory (STM) networks and learn to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Jiadai Sun , Yuxin Mao , Yuchao Dai , Yiran Zhong , Jianyuan Wang

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Current prevailing Video Object Segmentation methods follow the pipeline of extraction-then-matching, which first extracts features on current and reference frames independently, and then performs dense matching between them. This decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Jiaming Zhang , Yutao Cui , Gangshan Wu , Limin Wang

Recently, query based object detection frameworks achieve comparable performance with previous state-of-the-art object detectors. However, how to fully leverage such frameworks to perform instance segmentation remains an open problem. In…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yuxin Fang , Shusheng Yang , Xinggang Wang , Yu Li , Chen Fang , Ying Shan , Bin Feng , Wenyu Liu

Enhancing the fine-grained instance spatiotemporal motion perception capabilities of Video Large Language Models is crucial for improving their temporal and general video understanding. However, current models struggle to perceive detailed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Jiaze Li , Yaya Shi , Zongyang Ma , Haoran Xu , Feng Cheng , Huihui Xiao , Ruiwen Kang , Fan Yang , Tingting Gao , Di Zhang

The appearance of an object can be fleeting when it transforms. As eggs are broken or paper is torn, their color, shape and texture can change dramatically, preserving virtually nothing of the original except for the identity itself. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Pavel Tokmakov , Jie Li , Adrien Gaidon

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequence. In our work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Carles Ventura , Miriam Bellver , Andreu Girbau , Amaia Salvador , Ferran Marques , Xavier Giro-i-Nieto

Tracking geographic entities from historical maps, such as buildings, offers valuable insights into cultural heritage, urbanization patterns, environmental changes, and various historical research endeavors. However, linking these entities…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Xue Xia , Randall Balestriero , Tao Zhang , Lorenz Hurni

This paper strives for motion expressions guided video segmentation, which focuses on segmenting objects in video content based on a sentence describing the motion of the objects. Existing referring video object datasets typically focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Chen Change Loy

This paper proposes key instance selection based on video saliency covering objectness and dynamics for unsupervised video object segmentation (UVOS). Our method takes frames sequentially and extracts object proposals with corresponding…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Donghyeon Cho , Sungeun Hong , Sungil Kang , Jiwon Kim

Semantic segmentation research has recently witnessed rapid progress, but many leading methods are unable to identify object instances. In this paper, we present Multi-task Network Cascades for instance-aware semantic segmentation. Our…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Jifeng Dai , Kaiming He , Jian Sun

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Instance segmentation aims to detect and segment individual objects in a scene. Most existing methods rely on precise mask annotations of every category. However, it is difficult and costly to segment objects in novel categories because a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Weicheng Kuo , Anelia Angelova , Jitendra Malik , Tsung-Yi Lin

Multiple existing benchmarks involve tracking and segmenting objects in video e.g., Video Object Segmentation (VOS) and Multi-Object Tracking and Segmentation (MOTS), but there is little interaction between them due to the use of disparate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Ali Athar , Jonathon Luiten , Paul Voigtlaender , Tarasha Khurana , Achal Dave , Bastian Leibe , Deva Ramanan

Previous works on video object segmentation (VOS) are trained on densely annotated videos. Nevertheless, acquiring annotations in pixel level is expensive and time-consuming. In this work, we demonstrate the feasibility of training a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Kun Yan , Xiao Li , Fangyun Wei , Jinglu Wang , Chenbin Zhang , Ping Wang , Yan Lu

It is expensive and labour-extensive to label the pixel-wise object masks in a video. As a result, the amount of pixel-wise annotations in existing video instance segmentation (VIS) datasets is small, limiting the generalization capability…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Minghan Li , Lei Zhang