English
Related papers

Related papers: Object Detection in Video with Spatial-temporal Co…

200 papers

Compared with object detection in static images, object detection in videos is more challenging due to degraded image qualities. An effective way to address this problem is to exploit temporal contexts by linking the same object across…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Peng Tang , Chunyu Wang , Xinggang Wang , Wenyu Liu , Wenjun Zeng , Jingdong Wang

Object proposals for detecting moving or static video objects need to address issues such as speed, memory complexity and temporal consistency. We propose an efficient Video Object Proposal (VOP) generation method and show its efficacy in…

Computer Vision and Pattern Recognition · Computer Science 2016-01-22 Subarna Tripathi , Serge Belongie , Youngbae Hwang , Truong Nguyen

We propose a supervised contrastive learning framework for video representation learning that leverages temporally global context. We introduce a video to image aggregation strategy that spatially arranges multiple frames from each video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shaif Chowdhury , Mushfika Rahman , Greg Hamerly

Video instance segmentation aims to detect, segment, and track objects in a video. Current approaches extend image-level segmentation algorithms to the temporal domain. However, this results in temporally inconsistent masks. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Anirudh S Chakravarthy , Won-Dong Jang , Zudi Lin , Donglai Wei , Song Bai , Hanspeter Pfister

Given the vast amounts of video available online, and recent breakthroughs in object detection with static images, object detection in video offers a promising new frontier. However, motion blur and compression artifacts cause substantial…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Subarna Tripathi , Zachary C. Lipton , Serge Belongie , Truong Nguyen

The primary challenge in Video Object Detection (VOD) is effectively exploiting temporal information to enhance object representations. Traditional strategies, such as aggregating region proposals, often suffer from feature variance due to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Khurram Azeem Hashmi , Talha Uddin Sheikh , Didier Stricker , Muhammad Zeshan Afzal

Recent approaches for high accuracy detection and tracking of object categories in video consist of complex multistage solutions that become more cumbersome each year. In this paper we propose a ConvNet architecture that jointly performs…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Christoph Feichtenhofer , Axel Pinz , Andrew Zisserman

Transferring existing image-based detectors to the video is non-trivial since the quality of frames is always deteriorated by part occlusion, rare pose, and motion blur. Previous approaches exploit to propagate and aggregate features across…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Zhengkai Jiang , Yu Liu , Ceyuan Yang , Jihao Liu , Peng Gao , Qian Zhang , Shiming Xiang , Chunhong Pan

This paper aims to learn a compact representation of a video for video face recognition task. We make the following contributions: first, we propose a meta attention-based aggregation scheme which adaptively and fine-grained weighs the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Zhaoxiang Liu , Huan Hu , Jinqiang Bai , Shaohua Li , Shiguo Lian

This paper introduces an online model for object detection in videos designed to run in real-time on low-powered mobile and embedded devices. Our approach combines fast single-image object detection with convolutional long short term memory…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Mason Liu , Menglong Zhu

Most action recognition methods base on a) a late aggregation of frame level CNN features using average pooling, max pooling, or RNN, among others, or b) spatio-temporal aggregation via 3D convolutions. The first assume independence among…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Swathikiran Sudhakaran , Sergio Escalera , Oswald Lanz

Object detection performance, as measured on the canonical PASCAL VOC dataset, has plateaued in the last few years. The best-performing methods are complex ensemble systems that typically combine multiple low-level image features with…

Computer Vision and Pattern Recognition · Computer Science 2014-10-23 Ross Girshick , Jeff Donahue , Trevor Darrell , Jitendra Malik

State-of-the-art video object detection methods maintain a memory structure, either a sliding window or a memory queue, to enhance the current frame using attention mechanisms. However, we argue that these memory structures are not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Guanxiong Sun , Yang Hua , Guosheng Hu , Neil Robertson

Object detection in videos is an important task in computer vision for various applications such as object tracking, video summarization and video search. Although great progress has been made in improving the accuracy of object detection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Athindran Ramesh Kumar , Balaraman Ravindran , Anand Raghunathan

Object detection in videos has drawn increasing attention recently with the introduction of the large-scale ImageNet VID dataset. Different from object detection in static images, temporal information in videos is vital for object…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Kai Kang , Hongsheng Li , Tong Xiao , Wanli Ouyang , Junjie Yan , Xihui Liu , Xiaogang Wang

Input aggregation is a simple technique used by state-of-the-art LiDAR 3D object detectors to improve detection. However, increasing aggregation is known to have diminishing returns and even performance degradation, due to objects…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Chengjie Huang , Vahdat Abdelzad , Sean Sedwards , Krzysztof Czarnecki

We propose a Spatiotemporal Sampling Network (STSN) that uses deformable convolutions across time for object detection in videos. Our STSN performs object detection in a video frame by learning to spatially sample features from the adjacent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Gedas Bertasius , Lorenzo Torresani , Jianbo Shi

There has been significant progresses for image object detection in recent years. Nevertheless, video object detection has received little attention, although it is more challenging and more important in practical scenarios. Built upon the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-01 Xizhou Zhu , Jifeng Dai , Lu Yuan , Yichen Wei

Jointly integrating aspect ratio and context has been extensively studied and shown performance improvement in traditional object detection systems such as the DPMs. It, however, has been largely ignored in deep neural network based…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Bo Li , Tianfu Wu , Shuai Shao , Lun Zhang , Rufeng Chu

Visual-based perception is the key module for autonomous driving. Among those visual perception tasks, video object detection is a primary yet challenging one because of feature degradation caused by fast motion or multiple poses. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yiming Cui , Cheng Han , Dongfang Liu