English
Related papers

Related papers: Self-Attention Network for Skeleton-based Human Ac…

200 papers

Encoder-decoder based Sequence to Sequence learning (S2S) has made remarkable progress in recent years. Different network architectures have been used in the encoder/decoder. Among them, Convolutional Neural Networks (CNN) and Self…

Computation and Language · Computer Science 2018-07-05 Kaitao Song , Xu Tan , Di He , Jianfeng Lu , Tao Qin , Tie-Yan Liu

3D action recognition - analysis of human actions based on 3D skeleton data - becomes popular recently due to its succinctness, robustness, and view-invariant representation. Recent attempts on this problem suggested to develop RNN-based…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Jun Liu , Amir Shahroudy , Dong Xu , Gang Wang

Although self-attention networks (SANs) have advanced the state-of-the-art on various NLP tasks, one criticism of SANs is their ability of encoding positions of input words (Shaw et al., 2018). In this work, we propose to augment SANs with…

Computation and Language · Computer Science 2019-09-04 Xing Wang , Zhaopeng Tu , Longyue Wang , Shuming Shi

Graph-based reasoning over skeleton data has emerged as a promising approach for human action recognition. However, the application of prior graph-based methods, which predominantly employ whole temporal sequences as their input, to the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Lukas Hedegaard , Negar Heidari , Alexandros Iosifidis

Recognition of human actions and associated interactions with objects and the environment is an important problem in computer vision due to its potential applications in a variety of domains. The most versatile methods can generalize to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Behnoosh Parsa , Athma Narayanan , Behzad Dariush

Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from…

Machine Learning · Computer Science 2019-11-13 Babak Hosseini , Romain Montagne , Barbara Hammer

Human action recognition has become an important research focus in computer vision due to the wide range of applications where it is used. 3D Resnet-based CNN models, particularly MC3, R3D, and R(2+1)D, have different convolutional filters…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Mohammad Rasras , Iuliana Marin , Serban Radu , Irina Mocanu

Self-attention networks (SAN) have been introduced into automatic speech recognition (ASR) and achieved state-of-the-art performance owing to its superior ability in capturing long term dependency. One of the key ingredients is the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Zhao You , Dan Su , Jie Chen , Chao Weng , Dong Yu

Human skeleton, as a compact representation of human action, has received increasing attention in recent years. Many skeleton-based action recognition methods adopt graph convolutional networks (GCN) to extract features on top of human…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Haodong Duan , Yue Zhao , Kai Chen , Dahua Lin , Bo Dai

We present a novel architecture, residual attention net (RAN), which merges a sequence architecture, universal transformer, and a computer vision architecture, residual net, with a high-way architecture for cross-domain sequence modeling.…

Machine Learning · Computer Science 2020-01-14 Seth H. Huang , Xu Lingjie , Jiang Congwei

Human actions comprise of joint motion of articulated body parts or `gestures'. Human skeleton is intuitively represented as a sparse graph with joints as nodes and natural connections between them as edges. Graph convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Kalpit Thakkar , P J Narayanan

Self-attention networks (SAN) have attracted a lot of interests due to their high parallelization and strong performance on a variety of NLP tasks, e.g. machine translation. Due to the lack of recurrence structure such as recurrent neural…

Computation and Language · Computer Science 2019-06-04 Baosong Yang , Longyue Wang , Derek F. Wong , Lidia S. Chao , Zhaopeng Tu

The aim of this work is to introduce simplicial attention networks (SANs), i.e., novel neural architectures that operate on data defined on simplicial complexes leveraging masked self-attentional layers. Hinging on formal arguments from…

Machine Learning · Computer Science 2022-03-29 L. Giusti , C. Battiloro , P. Di Lorenzo , S. Sardellitti , S. Barbarossa

This paper explores the promising interplay between spiking neural networks (SNNs) and event-based cameras for privacy-preserving human action recognition (HAR). The unique feature of event cameras in capturing only the outlines of motion,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Siyuan Yang , Shilin Lu , Shizheng Wang , Meng Hwa Er , Zengwei Zheng , Alex C. Kot

Graph convolutional networks (GCNs), which can model the human body skeletons as spatial and temporal graphs, have shown remarkable potential in skeleton-based action recognition. However, in the existing GCN-based methods, graph-structured…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Han Chen , Yifan Jiang , Hanseok Ko

Self-attention networks (SAN) have shown promising performance in various Natural Language Processing (NLP) scenarios, especially in machine translation. One of the main points of SANs is the strength of capturing long-range and multi-scale…

Computation and Language · Computer Science 2020-06-30 Sevinj Yolchuyeva , Géza Németh , Bálint Gyires-Tóth

Graph convolutional networks (GCNs) have been very successful in skeleton-based human action recognition where the sequence of skeletons is modeled as a graph. However, most of the GCN-based methods in this area train a deep feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Negar Heidari , Alexandros Iosifidis

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Deep Convolutional Neural Networks (CNN) have drawn great attention in image super-resolution (SR). Recently, visual attention mechanism, which exploits both of the feature importance and contextual cues, has been introduced to image SR and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Huapeng Wu , Zhengxia Zou , Jie Gui , Wen-Jun Zeng , Jieping Ye , Jun Zhang , Hongyi Liu , Zhihui Wei

Sequential dynamics are a key feature of many modern recommender systems, which seek to capture the `context' of users' activities on the basis of actions they have performed recently. To capture such patterns, two approaches have…

Information Retrieval · Computer Science 2018-08-30 Wang-Cheng Kang , Julian McAuley