English
Related papers

Related papers: EV-Action: Electromyography-Vision Multi-Modal Act…

200 papers

Surface electromyography (sEMG) records muscle activity during hand movement and can be decoded to recover detailed hand articulation. EMG and egocentric vision are complementary for hand sensing: EMG captures fine-grained finger…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Ziheng Xi , Jiayi Yu , Yitao Wang , Yanbo Duan , Jianjiang Feng , Jie Zhou

With the development of robotics, skeleton-based action recognition has become increasingly important, as human-robot interaction requires understanding the actions of humans and humanoid robots. Due to different sources of human skeletons…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jidong Kuang , Hongsong Wang , Jie Gui

The fine-grained action analysis of the existing action datasets is challenged by insufficient action categories, low fine granularities, limited modalities, and tasks. In this paper, we propose a Multi-modality and Multi-task dataset of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Sheng-Lan Liu , Yu-Ning Ding , Gang Yan , Si-Fan Zhang , Jin-Rong Zhang , Wen-Yue Chen , Xue-Hai Xu

This project investigates the human multi-modal behavior identification algorithm utilizing deep neural networks. According to the characteristics of different modal information, different deep neural networks are used to adapt to different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinyin Wang , Xingchen Li , Yixuan Jin , Yihao Zhong , Keke Zhang , Chang Zhou

Human Action Recognition (HAR) aims to understand human behavior and assign a label to each action. It has a wide range of applications, and therefore has been attracting increasing attention in the field of computer vision. Human actions…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zehua Sun , Qiuhong Ke , Hossein Rahmani , Mohammed Bennamoun , Gang Wang , Jun Liu

In this paper, we present electromyography analysis of human activity - database 1 (EMAHA-DB1), a novel dataset of multi-channel surface electromyography (sEMG) signals to evaluate the activities of daily living (ADL). The dataset is…

Signal Processing · Electrical Eng. & Systems 2023-01-10 Naveen Kumar Karnam , Anish Chand Turlapaty , Shiv Ram Dubey , Balakrishna Gokaraju

Human skeleton information is important in skeleton-based action recognition, which provides a simple and efficient way to describe human pose. However, existing skeleton-based methods focus more on the skeleton, ignoring the objects…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Hao Wen , Ziqian Lu , Fengli Shen , Zhe-Ming Lu , Jialin Cui

Identification using biometrics is an important yet challenging task. Abundant research has been conducted on identifying personal identity or gender using given signals. Various types of biometrics such as electrocardiogram (ECG),…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Hyoung-Kyu Song , Ebrahim AlAlkeem , Jaewoong Yun , Tae-Ho Kim , Tae-Ho Kim , Hyerin Yoo , Dasom Heo , Chan Yeob Yeun , Myungsu Chae

3D multi-person motion prediction is a challenging task that involves modeling individual behaviors and interactions between people. Despite the emergence of approaches for this task, comparing them is difficult due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xiaogang Peng , Xiao Zhou , Yikai Luo , Hao Wen , Yu Ding , Zizhao Wu

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Advances in markerless motion capture are expanding access to biomechanical movement analysis, making it feasible to obtain high-quality movement data from outpatient clinics, inpatient hospitals, therapy, and even home. Expanding access to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ruize Yang , Ann Kennedy , R. James Cotton

Emotion is an experience associated with a particular pattern of physiological activity along with different physiological, behavioral and cognitive changes. One behavioral change is facial expression, which has been studied extensively…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xiaotian Li , Xiang Zhang , Huiyuan Yang , Wenna Duan , Weiying Dai , Lijun Yin

Daily life of thousands of individuals around the globe suffers due to physical or mental disability related to limb movement. The quality of life for such individuals can be made better by use of assistive applications and systems. In such…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Asad Mansoor Khan , Ayesha Sadiq , Sajid Gul Khawaja , Norah Saleh Alghamdi , Muhammad Usman Akram , Ali Saeed

Action recognition has been a heated topic in computer vision for its wide application in vision systems. Previous approaches achieve improvement by fusing the modalities of the skeleton sequence and RGB video. However, such methods have a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Xiaoguang Zhu , Ye Zhu , Haoyu Wang , Honglin Wen , Yan Yan , Peilin Liu

In real-world scenarios, human actions often fall outside the distribution of training data, making it crucial for models to recognize known actions and reject unknown ones. However, using pure skeleton data in such open-set conditions…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Kunyu Peng , Cheng Yin , Junwei Zheng , Ruiping Liu , David Schneider , Jiaming Zhang , Kailun Yang , M. Saquib Sarfraz , Rainer Stiefelhagen , Alina Roitberg

Electromyography (EMG) signals are obtained from muscle cell activity. The recording and analysis of EMG signals has several applications. The EMG is of diagnostic importance for treating patients suffering from neurological and…

Systems and Control · Electrical Eng. & Systems 2025-09-18 Vinay C K , Vikas Vazhayil , Madhav rao

The application of psychophysiology in human-computer interaction is a growing field with significant potential for future smart personalised systems. Working in this emerging field requires comprehension of an array of physiological…

Human-Computer Interaction · Computer Science 2016-09-05 Niklas Ravaja , Benjamin Cowley , Jari Torniainen

Research on depth-based human activity analysis achieved outstanding performance and demonstrated the effectiveness of 3D representation for action recognition. The existing depth-based and RGB+D-based action recognition benchmarks have a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Jun Liu , Amir Shahroudy , Mauricio Perez , Gang Wang , Ling-Yu Duan , Alex C. Kot

Recent approaches in depth-based human activity analysis achieved outstanding performance and proved the effectiveness of 3D representation for classification of action classes. Currently available depth-based and RGB+D-based action…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Amir Shahroudy , Jun Liu , Tian-Tsong Ng , Gang Wang

Automatic surgical gesture recognition is fundamentally important to enable intelligent cognitive assistance in robotic surgery. With recent advancement in robot-assisted minimally invasive surgery, rich information including surgical…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Yonghao Long , Jie Ying Wu , Bo Lu , Yueming Jin , Mathias Unberath , Yun-Hui Liu , Pheng Ann Heng , Qi Dou