English
Related papers

Related papers: Flow Dynamics Correction for Action Recognition

200 papers

Capsule networks (CapsNets) have recently shown promise to excel in most computer vision tasks, especially pertaining to scene understanding. In this paper, we explore CapsNet's capabilities in optical flow estimation, a task at which…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Vinoj Jayasundara , Debaditya Roy , Basura Fernando

Event cameras rely on motion to obtain information about scene appearance. This means that appearance and motion are inherently linked: either both are present and recorded in the event data, or neither is captured. Previous works treat the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Guo , Friedhelm Hamann , Guillermo Gallego

Akin to many subareas of computer vision, the recent advances in deep learning have also significantly influenced the literature on optical flow. Previously, the literature had been dominated by classical energy-based models, which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Junhwa Hur , Stefan Roth

Action recognition has long been a fundamental and intriguing problem in artificial intelligence. The task is challenging due to the high dimensionality nature of an action, as well as the subtle motion details to be considered. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yuheng Yang , Haipeng Chen , Zhenguang Liu , Yingda Lyu , Beibei Zhang , Shuang Wu , Zhibo Wang , Kui Ren

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Flow, an optimal mental state merging action and awareness, significantly impacts our emotion, performance, and well-being. However, capturing its swift fluctuations on a fine timescale is challenging due to the sparsity of the existing…

Human-Computer Interaction · Computer Science 2023-12-29 Bohao Tian , Shijun Zhang , Sirui Chen , Yuru Zhang , Kaiping Peng , Hongxing Zhang , Dangxiao Wang

The video and action classification have extremely evolved by deep neural networks specially with two stream CNN using RGB and optical flow as inputs and they present outstanding performance in terms of video analysis. One of the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Ali Diba , Ali Mohammad Pazandeh , Luc Van Gool

Video facial expression recognition is useful for many applications and received much interest lately. Although some solutions give really good results in a controlled environment (no occlusion), recognition in the presence of partial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Delphine Poux , Benjamin Allaert , Nacim Ihaddadene , Ioan Marius Bilasco , Chaabane Djeraba , Mohammed Bennamoun

Video representation is a key challenge in many computer vision applications such as video classification, video captioning, and video surveillance. In this paper, we propose a novel approach for video representation that captures…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Mohammadreza Babaee , David Full , Gerhard Rigoll

In most of computer vision applications, motion blur is regarded as an undesirable artifact. However, it has been shown that motion blur in an image may have practical interests in fundamental computer vision problems. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dawit Mureja Argaw , Junsik Kim , Francois Rameau , Jae Won Cho , In So Kweon

Recent works on optical flow estimation use neural networks to predict the flow field that maps positions of one image to positions of the other. These networks consist of a feature extractor, a correlation volume, and finally several…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Leyla Mirvakhabova , Hong Cai , Jisoo Jeong , Hanno Ackermann , Farhad Zanjani , Fatih Porikli

Recent learning-based methods for event-based optical flow estimation utilize cost volumes for pixel matching but suffer from redundant computations and limited scalability to higher resolutions for flow refinement. In this work, we take…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Daikun Liu , Lei Cheng , Teng Wang , changyin Sun

Motion plays a crucial role in understanding videos and most state-of-the-art neural models for video classification incorporate motion information typically using optical flows extracted by a separate off-the-shelf method. As the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Heeseung Kwon , Manjin Kim , Suha Kwak , Minsu Cho

In moving camera videos, motion segmentation is commonly performed using the image plane motion of pixels, or optical flow. However, objects that are at different depths from the camera can exhibit different optical flows even if they share…

Computer Vision and Pattern Recognition · Computer Science 2015-11-06 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

Human action recognition involves the characterization of human actions through the automated analysis of video data and is integral in the development of smart computer vision systems. However, several challenges like dynamic backgrounds,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Jonti Talukdar , Bhavana Mehta

We propose to incorporate feature correlation and sequential processing into dense optical flow estimation from event cameras. Modern frame-based optical flow methods heavily rely on matching costs computed from feature correlation. In…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Mathias Gehrig , Mario Millhäusler , Daniel Gehrig , Davide Scaramuzza

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

As a bio-inspired sensor with high temporal resolution, the spiking camera has an enormous potential in real applications, especially for motion estimation in high-speed scenes. However, frame-based and event-based methods are not well…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Liwen Hu , Rui Zhao , Ziluo Ding , Lei Ma , Boxin Shi , Ruiqin Xiong , Tiejun Huang

The optical flow of natural scenes is a combination of the motion of the observer and the independent motion of objects. Existing algorithms typically focus on either recovering motion and structure under the assumption of a purely static…

Computer Vision and Pattern Recognition · Computer Science 2017-05-04 Jonas Wulff , Laura Sevilla-Lara , Michael J. Black