English
Related papers

Related papers: Capturing Temporal Information in a Single Frame: …

200 papers

Deep neural networks based methods have been proved to achieve outstanding performance on object detection and classification tasks. Despite significant performance improvement, due to the deep structures, they still require prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Mohammad Farhadi , Yezhou Yang

In this work we reduce undersampling artefacts in two-dimensional ($2D$) golden-angle radial cine cardiac MRI by applying a modified version of the U-net. We train the network on $2D$ spatio-temporal slices which are previously extracted…

Image and Video Processing · Electrical Eng. & Systems 2019-08-14 Andreas Kofler , Marc Dewey , Tobias Schaeffter , Christian Wald , Christoph Kolbitsch

Pixel space augmentation has grown in popularity in many Deep Learning areas, due to its effectiveness, simplicity, and low computational cost. Data augmentation for videos, however, still remains an under-explored research topic, as most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Artjoms Gorpincenko , Michal Mackiewicz

Sampling is classically performed by recording the amplitude of an input signal at given time instants; however, sampling and reconstructing a signal using multiple devices in parallel becomes a more difficult problem to solve when the…

Signal Processing · Electrical Eng. & Systems 2020-04-22 Karen Adam , Adam Scholefield , Martin Vetterli

We introduce a novel self-supervised learning approach to learn representations of videos that are responsive to changes in the motion dynamics. Our representations can be learned from data without human annotation and provide a substantial…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Simon Jenni , Givi Meishvili , Paolo Favaro

Existing methods for video interpolation heavily rely on deep convolution neural networks, and thus suffer from their intrinsic limitations, such as content-agnostic kernel weights and restricted receptive field. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhihao Shi , Xiangyu Xu , Xiaohong Liu , Jun Chen , Ming-Hsuan Yang

The event camera is a novel bio-inspired vision sensor. When the brightness change exceeds the preset threshold, the sensor generates events asynchronously. The number of valid events directly affects the performance of event-based tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Xijie Xiang , Lin Zhu , Jianing Li , Yonghong Tian , Tiejun Huang

With the explosive growth of video data in real-world applications, a comprehensive representation of videos becomes increasingly important. In this paper, we address the problem of video scene recognition, whose goal is to learn a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xuzheng Yu , Chen Jiang , Wei Zhang , Tian Gan , Linlin Chao , Jianan Zhao , Yuan Cheng , Qingpei Guo , Wei Chu

We introduce a framework for online learning from a single continuous video stream -- the way people and animals learn, without mini-batches, data augmentation or shuffling. This poses great challenges given the high correlation between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 João Carreira , Michael King , Viorica Pătrăucean , Dilara Gokay , Cătălin Ionescu , Yi Yang , Daniel Zoran , Joseph Heyward , Carl Doersch , Yusuf Aytar , Dima Damen , Andrew Zisserman

Temporal reasoning is an important aspect of video analysis. 3D CNN shows good performance by exploring spatial-temporal features jointly in an unconstrained way, but it also increases the computational cost a lot. Previous works try to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Chenxu Luo , Alan Yuille

An important aspect of video understanding is the ability to predict the evolution of its content in the future. This paper presents a future frame semantic segmentation technique for predicting semantic masks of the current and future…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Talha Siddiqui , Samarth Bharadwaj

In this paper, several variants of two-stream architectures for temporal action proposal generation in long, untrimmed videos are presented. Inspired by the recent advances in the field of human action recognition utilizing 3D convolutions…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Patrick Schlosser , David Münch , Michael Arens

Applying image processing algorithms independently to each frame of a video often leads to undesired inconsistent results over time. Developing temporally consistent video-based extensions, however, requires domain knowledge for individual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Wei-Sheng Lai , Jia-Bin Huang , Oliver Wang , Eli Shechtman , Ersin Yumer , Ming-Hsuan Yang

In the training process of the implicit 3D reconstruction network, the choice of spatial query points' sampling strategy affects the final performance of the model. Different works have differences in the selection of sampling strategies,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Q. Liu , X. Yang

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Matthew Korban , Peter Youngs , Scott T. Acton

Video data is with complex temporal dynamics due to various factors such as camera motion, speed variation, and different activities. To effectively capture this diverse motion pattern, this paper presents a new temporal adaptive module…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhaoyang Liu , Limin Wang , Wayne Wu , Chen Qian , Tong Lu

While most modern video understanding models operate on short-range clips, real-world videos are often several minutes long with semantically consistent segments of variable length. A common approach to process long videos is applying a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Mohamed Afham , Satya Narayan Shukla , Omid Poursaeed , Pengchuan Zhang , Ashish Shah , Sernam Lim

Crowd counting aims to count the number of instantaneous people in a crowded space, and many promising solutions have been proposed for single image crowd counting. With the ubiquitous video capture devices in public safety field, how to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Xingjiao Wu , Baohan Xu , Yingbin Zheng , Hao Ye , Jing Yang , Liang He

Real-time video analysis remains a challenging problem in computer vision, requiring efficient processing of both spatial and temporal information while maintaining computational efficiency. Existing approaches often struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shahla John

Despite the success of deep learning in video understanding tasks, processing every frame in a video is computationally expensive and often unnecessary in real-time applications. Frame selection aims to extract the most informative and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mingjun Zhao , Yakun Yu , Xiaoli Wang , Lei Yang , Di Niu