English
Related papers

Related papers: TNTC: two-stream network with transformer-based co…

200 papers

Human gait refers to a daily motion that represents not only mobility, but it can also be used to identify the walker by either human observers or computers. Recent studies reveal that gait even conveys information about the walker's…

Human-Computer Interaction · Computer Science 2022-07-19 Shihao Xu , Jing Fang , Xiping Hu , Edith Ngai , Wei Wang , Yi Guo , Victor C. M. Leung

Graph convolutional networks (GCNs) have been widely used and achieved remarkable results in skeleton-based action recognition. We think the key to skeleton-based action recognition is a skeleton hanging in frames, so we focus on how the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Nguyen Huu Bao Long

Gait recognition is a biometric technology that recognizes the identity of humans through their walking patterns. Existing appearance-based methods utilize CNN or Transformer to extract spatial and temporal features from silhouettes, while…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fanxu Min , Shaoxiang Guo , Fan Hao , Junyu Dong

In this paper, we study sentiment analysis task where the outcomes are mainly contributed by a few key elements of the inputs. Motivated by the two-streams hypothesis, we propose a neural architecture, named TraceNet, to address this type…

Computation and Language · Computer Science 2022-03-01 Qinghua Zhao , Shuai Ma

Skeleton-based action recognition has become popular in recent years due to its efficiency and robustness. Most current methods adopt graph convolutional network (GCN) for topology modeling, but GCN-based methods are limited in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Jinzhao Luo , Lu Zhou , Guibo Zhu , Guojing Ge , Beiying Yang , Jinqiao Wang

Skeleton-based human action recognition has attracted a lot of research attention during the past few years. Recent works attempted to utilize recurrent neural networks to model the temporal dependencies between the 3D positional…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Jun Liu , Amir Shahroudy , Dong Xu , Alex C. Kot , Gang Wang

Fusion is critical for a two-stream network. In this paper, we propose a novel temporal fusion (TF) module to fuse the two-stream joints' information to predict human motion, including a temporal concatenation and a reinforcement trajectory…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jin Tang , Jin Zhang , Jianqin Yin

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

Video-based gait analysis has become a promising approach for assessing motor impairment in children with cerebral palsy (CP). However, existing methods usually rely on either pose sequences or handcrafted gait features alone, making it…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Kaiyuan Yang , Xupeng Chen , Jiangpeng He

Skeleton-based action recognition has achieved remarkable performance with the development of graph convolutional networks (GCNs). However, most of these methods tend to construct complex topology learning mechanisms while neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zeyu Liang , Hailun Xia , Naichuan Zheng , Huan Xu

Tactile perception is crucial for embodied intelligent robots to recognize objects. Vision-based tactile sensors extract object physical attributes multidimensionally using high spatial resolution; however, this process generates abundant…

Robotics · Computer Science 2025-10-15 Muxing Huang , Zibin Chen , Weiliang Xu , Zilan Li , Yuanzhi Zhou , Guoyuan Zhou , Wenjing Chen , Xinming Li

Graph convolutional networks (GCNs), which can model the human body skeletons as spatial and temporal graphs, have shown remarkable potential in skeleton-based action recognition. However, in the existing GCN-based methods, graph-structured…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Han Chen , Yifan Jiang , Hanseok Ko

We present a novel classifier network called STEP, to classify perceived human emotion from gaits, based on a Spatial Temporal Graph Convolutional Network (ST-GCN) architecture. Given an RGB video of an individual walking, our formulation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Uttaran Bhattacharya , Trisha Mittal , Rohan Chandra , Tanmay Randhavane , Aniket Bera , Dinesh Manocha

It remains a challenge to efficiently extract spatialtemporal information from skeleton sequences for 3D human action recognition. Although most recent action recognition methods are based on Recurrent Neural Networks which present…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Hong Liu , Juanhui Tu , Mengyuan Liu

Skeleton-based human action recognition has attracted much attention with the prevalence of accessible depth sensors. Recently, graph convolutional networks (GCNs) have been widely used for this task due to their powerful capability to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zhen Huang , Xu Shen , Xinmei Tian , Houqiang Li , Jianqiang Huang , Xian-Sheng Hua

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue…

Computation and Language · Computer Science 2024-05-06 Tao Meng , Fuchen Zhang , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

The shared topology of human skeletons motivated the recent investigation of graph convolutional network (GCN) solutions for action recognition. However, most of the existing GCNs rely on the binary connection of two neighboring vertices…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Youwei Zhou , Tianyang Xu , Cong Wu , Xiaojun Wu , Josef Kittler

Combining skeleton structure with graph convolutional networks has achieved remarkable performance in human action recognition. Since current research focuses on designing basic graph for representing skeleton data, these embedding features…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dong Yang , Monica Mengqi Li , Hong Fu , Jicong Fan , Zhao Zhang , Howard Leung

In this paper we address the problem of human action recognition from video sequences. Inspired by the exemplary results obtained via automatic feature learning and deep learning approaches in computer vision, we focus our attention towards…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Integrating prior knowledge of neurophysiology into neural network architecture enhances the performance of emotion decoding. While numerous techniques emphasize learning spatial and short-term temporal patterns, there has been limited…

Machine Learning · Computer Science 2025-03-18 Yi Ding , Chengxuan Tong , Shuailei Zhang , Muyun Jiang , Yong Li , Kevin Lim Jun Liang , Cuntai Guan