English
Related papers

Related papers: Multi-Modal Three-Stream Network for Action Recogn…

200 papers

Recently, deep learning approach has achieved promising results in various fields of computer vision. In this paper, a new framework called Hierarchical Depth Motion Maps (HDMM) + 3 Channel Deep Convolutional Neural Networks (3ConvNets) is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-21 Pichao Wang , Wanqing Li , Zhimin Gao , Jing Zhang , Chang Tang , Philip Ogunbona

Understanding human actions in wild videos is an important task with a broad range of applications. In this paper we propose a novel approach named Hierarchical Attention Network (HAN), which enables to incorporate static spatial…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Yilin Wang , Suhang Wang , Jiliang Tang , Neil O'Hare , Yi Chang , Baoxin Li

We propose a novel deep supervised neural network for the task of action recognition in videos, which implicitly takes advantage of visual tracking and shares the robustness of both deep Convolutional Neural Network (CNN) and Recurrent…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Jialin Wu , Gu Wang , Wukui Yang , Xiangyang Ji

Multimodal-based action recognition methods have achieved high success using pose and RGB modality. However, skeletons sequences lack appearance depiction and RGB images suffer irrelevant noise due to modality limitations. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jinfu Liu , Runwei Ding , Yuhang Wen , Nan Dai , Fanyang Meng , Shen Zhao , Mengyuan Liu

Understanding human actions in visual data is tied to advances in complementary research areas including object recognition, human dynamics, domain adaptation and semantic segmentation. Over the last decade, human action analysis evolved…

Computer Vision and Pattern Recognition · Computer Science 2017-02-02 Samitha Herath , Mehrtash Harandi , Fatih Porikli

One central question for video action recognition is how to model motion. In this paper, we present hierarchical contrastive motion learning, a new self-supervised learning framework to extract effective motion representations from raw…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Xitong Yang , Xiaodong Yang , Sifei Liu , Deqing Sun , Larry Davis , Jan Kautz

Recent research into human action recognition (HAR) has focused predominantly on skeletal action recognition and video-based methods. With the increasing availability of consumer-grade depth sensors and Lidar instruments, there is a growing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 James Dickens

This paper studies the joint learning of action recognition and temporal localization in long, untrimmed videos. We employ a multi-task learning framework that performs the three highly related steps of action proposal, action recognition,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Yi Zhu , Shawn Newsam

Multi-frame human pose estimation in complicated situations is challenging. Although state-of-the-art human joints detectors have demonstrated remarkable results for static images, their performances come short when we apply these models to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Zhenguang Liu , Haoming Chen , Runyang Feng , Shuang Wu , Shouling Ji , Bailin Yang , Xun Wang

Automated human action recognition is one of the most attractive and practical research fields in computer vision, in spite of its high computational costs. In such systems, the human action labelling is based on the appearance and patterns…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Fatemeh Serpush , Mahdi Rezaei

Detecting representative frames in videos based on human actions is quite challenging because of the combined factors of human pose in action and the background. This paper addresses this problem and formulates the key frame detection as…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Xiang Yan , Syed Zulqarnain Gilani , Hanlin Qin , Mingtao Feng , Liang Zhang , Ajmal Mian

Derived from rapid advances in computer vision and machine learning, video analysis tasks have been moving from inferring the present state to predicting the future state. Vision-based action recognition and prediction from videos are such…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Yu Kong , Yun Fu

In the modern context, hand gesture recognition has emerged as a focal point. This is due to its wide range of applications, which include comprehending sign language, factories, hands-free devices, and guiding robots. Many researchers have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Md Abdur Rahim , Abu Saleh Musa Miah , Hemel Sharker Akash , Jungpil Shin , Md. Imran Hossain , Md. Najmul Hossain

Human action recognition remains an important yet challenging task. This work proposes a novel action recognition system. It uses a novel Multiple View Region Adaptive Multi-resolution in time Depth Motion Map (MV-RAMDMM) formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Mahmoud Al-Faris , John P. Chiverton , Yanyan Yang , David L. Ndzi

We consider the task of training a neural network to anticipate human actions in video. This task is challenging given the complexity of video data, the stochastic nature of the future, and the limited amount of annotated training data. In…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Vinh Tran , Yang Wang , Minh Hoai

Recent advances in unsupervised video object segmentation have highlighted the potential of two-stream architectures that integrate appearance and motion cues. However, fully leveraging these complementary sources of information requires…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Inseok Jeon , Suhwan Cho , Minhyeok Lee , Seunghoon Lee , Minseok Kang , Jungho Lee , Chaewon Park , Donghyeong Kim , Sangyoun Lee

Image understanding using deep convolutional network has reached human-level performance, yet a closely related problem of video understanding especially, action recognition has not reached the requisite level of maturity. We combine…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Biswa Sengupta , Yu Qian

This paper proposes a new 3D Human Action Recognition system as a two-phase system: (1) Deep Metric Learning Module which learns a similarity metric between two 3D joint sequences using Siamese-LSTM networks; (2) A Multiclass Classification…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Seyma Yucer , Yusuf Sinan Akgul

Convolutional Neural Networks (ConvNets) have recently shown promising performance in many computer vision tasks, especially image-based recognition. How to effectively apply ConvNets to sequence-based data is still an open problem. This…

Computer Vision and Pattern Recognition · Computer Science 2017-01-02 Pichao Wang , Wanqing Li , Chuankun Li , Yonghong Hou

Advancements in deep neural networks have contributed to near perfect results for many computer vision problems such as object recognition, face recognition and pose estimation. However, human action recognition is still far from…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Asanka G. Perera , Yee Wei Law , Titilayo T. Ogunwa , Javaan Chahl