English
Related papers

Related papers: Co-attention Propagation Network for Zero-Shot Vid…

200 papers

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Brendan Duke , Abdalla Ahmed , Christian Wolf , Parham Aarabi , Graham W. Taylor

This paper addresses the task of segmenting moving objects in unconstrained videos. We introduce a novel two-stream neural network with an explicit memory module to achieve this. The two streams of the network encode spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Pavel Tokmakov , Karteek Alahari , Cordelia Schmid

High-quality video inpainting that completes missing regions in video frames is a promising yet challenging task. State-of-the-art approaches adopt attention models to complete a frame by searching missing contents from reference frames,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yanhong Zeng , Jianlong Fu , Hongyang Chao

Transferring existing image-based detectors to the video is non-trivial since the quality of frames is always deteriorated by part occlusion, rare pose, and motion blur. Previous approaches exploit to propagate and aggregate features across…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Zhengkai Jiang , Yu Liu , Ceyuan Yang , Jihao Liu , Peng Gao , Qian Zhang , Shiming Xiang , Chunhong Pan

This paper presents a novel approach for segmenting moving objects in unconstrained environments using guided convolutional neural networks. This guiding process relies on foreground masks from independent algorithms (i.e. state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Diego Ortego , Kevin McGuinness , Juan C. SanMiguel , Eric Arazo , José M. Martínez , Noel E. O'Connor

In this paper, we introduce a variant of video object segmentation (VOS) that bridges interactive and semi-automatic approaches, termed Lazy Video Object Segmentation (ziVOS). In contrast, to both tasks, which handle video object…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Stéphane Vujasinović , Stefan Becker , Sebastian Bullinger , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot segmentation on virtually any image style and unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Junjiao Tian , Lavisha Aggarwal , Andrea Colaco , Zsolt Kira , Mar Gonzalez-Franco

This work proposes a novel method for object co-segmentation, i.e. pixel-level localization of a common object in a set of images, that uses no pixel-level supervision for training. Two pre-trained Vision Transformer (ViT) models are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Nikolaos-Antonios Ypsilantis , Ondřej Chum

Frame quality deterioration is one of the main challenges in the field of video understanding. To compensate for the information loss caused by deteriorated frames, recent approaches exploit transformer-based integration modules to obtain…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Guanxiong Sun , Chi Wang , Zhaoyu Zhang , Jiankang Deng , Stefanos Zafeiriou , Yang Hua

Video Object Segmentation (VOS) aims to track objects across frames in a video and segment them based on the initial annotated frame of the target objects. Previous VOS works typically rely on fully annotated videos for training. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Baiyu Chen , Sixian Chan , Xiaoqin Zhang

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang

This paper is about few-shot segmentation of foreground objects in images. We train a CNN on small subsets of training images, each mimicking the few-shot setting. In each subset, one image serves as the query and the other(s) as support…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Khoi Nguyen , Sinisa Todorovic

Identifying and segmenting moving objects from a moving monocular camera is difficult when there is unknown camera motion, different types of object motions and complex scene structures. To tackle these challenges, we take advantage of two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Yuxiang Huang , John Zelek

Cross-view geo-localization is to spot images of the same geographic target from different platforms, e.g., drone-view cameras and satellites. It is challenging in the large visual appearance changes caused by extreme viewpoint variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Tingyu Wang , Zhedong Zheng , Chenggang Yan , Jiyong Zhang , Yaoqi Sun , Bolun Zheng , Yi Yang

We present a general framework and method for simultaneous detection and segmentation of an object in a video that moves (or comes into view of the camera) at some unknown time in the video. The method is an online approach based on motion…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Dong Lao , Ganesh Sundaramoorthi

Object co-segmentation is the task of segmenting the same objects from multiple images. In this paper, we propose the Attention Based Object Co-Segmentation for object co-segmentation that utilize a novel attention mechanism in the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Hong Chen , Yifei Huang , Hideki Nakayama

In the realm of video object segmentation (VOS), the challenge of operating under low-light conditions persists, resulting in notably degraded image quality and compromised accuracy when comparing query and memory frames for similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Hebei Li , Jin Wang , Jiahui Yuan , Yue Li , Wenming Weng , Yansong Peng , Yueyi Zhang , Zhiwei Xiong , Xiaoyan Sun

Object detection is considered as one of the most challenging problems in computer vision, since it requires correct prediction of both classes and locations of objects in images. In this study, we define a more difficult scenario, namely…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Berkan Demirel , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Zero-Shot Object Goal Navigation (ZS-OGN) enables robots or agents to navigate toward objects of unseen categories without object-specific training. Traditional approaches often leverage categorical semantic information for navigation…

Robotics · Computer Science 2024-11-01 Shuaihang Yuan , Hao Huang , Yu Hao , Congcong Wen , Anthony Tzes , Yi Fang

Tracking and segmenting multiple similar objects with distinct or complex parts in long-term videos is particularly challenging due to the ambiguity in identifying target components and the confusion caused by occlusion, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xin Li , Deshui Miao , Zhenyu He , Yaowei Wang , Huchuan Lu , Ming-Hsuan Yang