English
Related papers

Related papers: Two Stream LSTM: A Deep Fusion Framework for Human…

200 papers

This project aims to develop a robust video surveillance system, which can segment videos into smaller clips based on the detection of activities. It uses CCTV footage, for example, to record only major events-like the appearance of a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Shahran Rahman Alve

We propose a novel scheme for human action recognition in videos, using a 3-dimensional Convolutional Neural Network (3D CNN) based classifier. Traditionally in deep learning based human activity recognition approaches, either a few random…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 S. H. Shabbeer Basha , Viswanath Pulabaigari , Snehasis Mukherjee

The recognition of actions from video sequences has many applications in health monitoring, assisted living, surveillance, and smart homes. Despite advances in sensing, in particular related to 3D video, the methodologies to process the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Rui Zhao , Haider Ali , Patrick van der Smagt

We address human action recognition from multi-modal video data involving articulated pose and RGB frames and propose a two-stream approach. The pose stream is processed with a convolutional model taking as input a 3D tensor holding data…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Fabien Baradel , Christian Wolf , Julien Mille

Spatio-temporal contexts are crucial in understanding human actions in videos. Recent state-of-the-art Convolutional Neural Network (ConvNet) based action recognition systems frequently involve 3D spatio-temporal ConvNet filters, chunking…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Yunfeng Wang , Wengang Zhou , Qilin Zhang , Xiaotian Zhu , Houqiang Li

A major emerging challenge is how to protect people's privacy as cameras and computer vision are increasingly integrated into our daily lives, including in smart devices inside homes. A potential solution is to capture and record just the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-15 Mingze Xu , Aidean Sharghi , Xin Chen , David J Crandall

This paper attempts at improving the accuracy of Human Action Recognition (HAR) by fusion of depth and inertial sensor data. Firstly, we transform the depth data into Sequential Front view Images(SFI) and fine-tune the pre-trained AlexNet…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Zeeshan Ahmad , Naimul Khan

As a fundamental aspect of human life, two-person interactions contain meaningful information about people's activities, relationships, and social settings. Human action recognition serves as the foundation for many smart applications, with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Yao Liu , Gangfeng Cui , Jiahui Luo , Xiaojun Chang , Lina Yao

Action recognition is an important yet challenging task in computer vision. In this paper, we propose a novel deep-based framework for action recognition, which improves the recognition accuracy by: 1) deriving more precise features for…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Weiyao Lin , Yang Mi , Jianxin Wu , Ke Lu , Hongkai Xiong

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Boyuan Jiang , Mengmeng Wang , Weihao Gan , Wei Wu , Junjie Yan

Recent advances in AI and robotics have claimed many incredible results with deep learning, yet no work to date has applied deep learning to the problem of liquid perception and reasoning. In this paper, we apply fully-convolutional deep…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Connor Schenck , Dieter Fox

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

The life detection method based on a single type of information source cannot meet the requirement of post-earthquake rescue due to its limitations in different scenes and bad robustness in life detection. This paper proposes a method based…

Signal Processing · Electrical Eng. & Systems 2019-05-17 Li Yin , Y. M. Zhou

Human action Recognition for unknown views is a challenging task. We propose a view-invariant deep human action recognition framework, which is a novel integration of two important action cues: motion and shape temporal dynamics (STD). The…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Chhavi Dhiman , Dinesh Kumar Vishwakarma

Deep learning models have enjoyed great success for image related computer vision tasks like image classification and object detection. For video related tasks like human action recognition, however, the advancements are not as significant…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Xiaolin Song , Cuiling Lan , Wenjun Zeng , Junliang Xing , Jingyu Yang , Xiaoyan Sun

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang

Recently, deep learning approach has achieved promising results in various fields of computer vision. In this paper, a new framework called Hierarchical Depth Motion Maps (HDMM) + 3 Channel Deep Convolutional Neural Networks (3ConvNets) is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-21 Pichao Wang , Wanqing Li , Zhimin Gao , Jing Zhang , Chang Tang , Philip Ogunbona

In this paper, we propose Two-Stream AMTnet, which leverages recent advances in video-based action representation[1] and incremental action tube generation[2]. Majority of the present action detectors follow a frame-based representation, a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Currently, spatiotemporal features are embraced by most deep learning approaches for human action detection in videos, however, they neglect the important features in frequency domain. In this work, we propose an end-to-end network that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Changhai Li , Huawei Chen , Jingqing Lu , Yang Huang , Yingying Liu