English
Related papers

Related papers: ActionFlowNet: Learning Motion Representation for …

200 papers

Human action recognition involves the characterization of human actions through the automated analysis of video data and is integral in the development of smart computer vision systems. However, several challenges like dynamic backgrounds,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Jonti Talukdar , Bhavana Mehta

Deep learning models have achieved state-of-the- art performance in recognizing human activities, but often rely on utilizing background cues present in typical computer vision datasets that predominantly have a stationary camera. If these…

Robotics · Computer Science 2017-09-20 Fahimeh Rezazadegan , Sareh Shirazi , Ben Upcroft , Michael Milford

Action recognition is an important yet challenging task in computer vision. In this paper, we propose a novel deep-based framework for action recognition, which improves the recognition accuracy by: 1) deriving more precise features for…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Weiyao Lin , Yang Mi , Jianxin Wu , Ke Lu , Hongkai Xiong

Learning with neural networks from a continuous stream of visual information presents several challenges due to the non-i.i.d. nature of the data. However, it also offers novel opportunities to develop representations that are consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci

Despite the notable progress made in action recognition tasks, not much work has been done in action recognition specifically for human-robot interaction. In this paper, we deeply explore the characteristics of the action recognition task…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Ziyang Song , Ziyi Yin , Zejian Yuan , Chong Zhang , Wanchao Chi , Yonggen Ling , Shenghao Zhang

Motion has shown to be useful for video understanding, where motion is typically represented by optical flow. However, computing flow from video frames is very time-consuming. Recent works directly leverage the motion vectors and residuals…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Zheng Shou , Xudong Lin , Yannis Kalantidis , Laura Sevilla-Lara , Marcus Rohrbach , Shih-Fu Chang , Zhicheng Yan

Typical human actions last several seconds and exhibit characteristic spatio-temporal structure. Recent methods attempt to capture this structure and learn action representations with convolutional neural networks. Such representations,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Gül Varol , Ivan Laptev , Cordelia Schmid

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chun-Fu Chen , Rameswar Panda , Kandan Ramakrishnan , Rogerio Feris , John Cohn , Aude Oliva , Quanfu Fan

CNN-based optical flow estimation has attracted attention recently, mainly due to its impressively high frame rates. These networks perform well on synthetic datasets, but they are still far behind the classical methods in real-world…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Nima Sedaghat , Mohammadreza Zolfaghari , Thomas Brox

It is difficult to recover the motion field from a real-world footage given a mixture of camera shake and other photometric effects. In this paper we propose a hybrid framework by interleaving a Convolutional Neural Network (CNN) and a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Wenbin Li , Da Chen , Zhihan Lv , Yan Yan , Darren Cosker

With the rapid advancements in deep learning, computer vision tasks have seen significant improvements, making two-stream neural networks a popular focus for video based action recognition. Traditional models using RGB and optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Song-Jiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Tian-Shan Liu , Kin-Man Lam

We address the problem of goal-directed cloth manipulation, a challenging task due to the deformability of cloth. Our insight is that optical flow, a technique normally used for motion estimation in video, can also provide an effective…

Robotics · Computer Science 2022-04-12 Thomas Weng , Sujay Bajracharya , Yufei Wang , Khush Agrawal , David Held

Existing methods to recognize actions in static images take the images at their face value, learning the appearances---objects, scenes, and body poses---that distinguish each action class. However, such models are deprived of the rich…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Ruohan Gao , Bo Xiong , Kristen Grauman

We propose a novel deep supervised neural network for the task of action recognition in videos, which implicitly takes advantage of visual tracking and shares the robustness of both deep Convolutional Neural Network (CNN) and Recurrent…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Jialin Wu , Gu Wang , Wukui Yang , Xiangyang Ji

Action recognition is a key technology in building interactive metaverses. With the rapid development of deep learning, methods in action recognition have also achieved great advancement. Researchers design and implement the backbones…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zixuan Tang , Youjun Zhao , Yuhang Wen , Mengyuan Liu

In this paper, we propose Two-Stream AMTnet, which leverages recent advances in video-based action representation[1] and incremental action tube generation[2]. Majority of the present action detectors follow a frame-based representation, a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Despite huge success in the image domain, modern detection models such as Faster R-CNN have not been used nearly as much for video analysis. This is arguably due to the fact that detection models are designed to operate on single frames and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Gedas Bertasius , Christoph Feichtenhofer , Du Tran , Jianbo Shi , Lorenzo Torresani

This paper proposes an end-to-end trainable network, SegFlow, for simultaneously predicting pixel-wise object segmentation and optical flow in videos. The proposed SegFlow has two branches where useful information of object segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-21 Jingchun Cheng , Yi-Hsuan Tsai , Shengjin Wang , Ming-Hsuan Yang

Akin to many subareas of computer vision, the recent advances in deep learning have also significantly influenced the literature on optical flow. Previously, the literature had been dominated by classical energy-based models, which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Junhwa Hur , Stefan Roth

When a person attempts to conceal an emotion, the genuine emotion is manifest as a micro-expression. Exploration of automatic facial micro-expression recognition systems is relatively new in the computer vision domain. This is due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Sze-Teng Liong , Y. S. Gan , Wei-Chuen Yau , Yen-Chang Huang , Tan Lit Ken