English
Related papers

Related papers: EV-Action: Electromyography-Vision Multi-Modal Act…

200 papers

Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms largely depends on the…

Machine Learning · Computer Science 2026-05-12 Runhe Zhou , Shanglin Li , Guanxiang Huang , Xinliang Zhou , Qibin Zhao , Motoaki Kawanabe , Yi Ding , Cuntai Guan

Electromyography (EMG) has been explored as an HCI input modality following a long history of success for prosthesis control. While EMG has the potential to address a range of hands-free interaction needs, it has yet to be widely accepted…

Human-Computer Interaction · Computer Science 2023-04-04 Ethan Eddy , Erik Scheme , Scott Bateman

Eye movement biometrics (EMB) use subject-specific gaze dynamics for user authentication and identification. Recent deep learning-based EMB systems achieve strong performance by modeling temporal eye movement behavior. However, these…

Human-Computer Interaction · Computer Science 2026-05-11 Hashim Aziz , Mehedi Hasan Raju , Oleg V. Komogortsev

Gait disabilities are among the most frequent worldwide. Their treatment relies on rehabilitation therapies, in which smart walkers are being introduced to empower the user's recovery and autonomy, while reducing the clinicians effort. For…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Carolina Gonçalves , João M. Lopes , Sara Moccia , Daniele Berardini , Lucia Migliorelli , Cristina P. Santos

Surface electromyography provides a practical way to infer human movement intention from wearable muscle recordings, but models trained under a single acquisition setting often lose reliability when the user, session, electrode layout, or…

Machine Learning · Computer Science 2026-05-26 Zhenghao Huang , Huilin Yao , Kaikai Wang

Surface electromyography (sEMG) has gained significant importance during recent advancements in consumer electronics for healthcare systems, gesture analysis and recognition and sign language communication. For such a system, it is…

Signal Processing · Electrical Eng. & Systems 2020-05-04 Rinki Gupta , Karush Suri

Electrocardiogram (ECG) signal exhibits inherent uniqueness, making it a promising biometric modality for identity authentication. As a result, ECG authentication has gained increasing attention in recent years. However, most existing…

Cryptography and Security · Computer Science 2025-04-29 Mingyu Dong , Zhidong Zhao , Hao Wang , Yefei Zhang , Yanjun Deng

Eye movement biometrics (EMB) is a relatively recent behavioral biometric modality that may have the potential to become the primary authentication method in virtual- and augmented-reality devices due to their emerging use of eye-tracking…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Dillon Lohr , Oleg V Komogortsev

The aim of this work was to identify six basic movements of the hand using two systems. Being an interdisciplinary topic, there has been conducted studying in the anatomy of forearm muscles, biosignals, the method of electromyography (EMG)…

Signal Processing · Electrical Eng. & Systems 2019-06-20 Christos Sapsanis

In recent years, action recognition has received much attention and wide application due to its important role in video understanding. Most of the researches on action recognition methods focused on improving the performance via various…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Pengcheng Dong , Wenbo Wan , Huaxiang Zhang , Shuai Li , Sujuan Hou , Jiande Sun

Human-robot collaboration (HRC) is a key focus of Industry 5.0, aiming to enhance worker productivity while ensuring well-being. The ability to perceive human psycho-physical states, such as stress and cognitive load, is crucial for…

This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action recognition methods.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Xikun Zhang , Chang Xu , Xinmei Tian , Dacheng Tao

While human action recognition has witnessed notable achievements, multimodal methods fusing RGB and skeleton modalities still suffer from their inherent heterogeneity and fail to fully exploit the complementary potential between them. In…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zeyu Liang , Hailun Xia , Naichuan Zheng

Patients with mental disorders often exhibit risky abnormal actions, such as climbing walls or hitting windows, necessitating intelligent video behavior monitoring for smart healthcare with the rising Internet of Things (IoT) technology.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Zengyuan Lai , Jiarui Yang , Songpengcheng Xia , Qi Wu , Zhen Sun , Wenxian Yu , Ling Pei

Integrating physiological signals such as electroencephalogram (EEG), with other data such as interview audio, may offer valuable multimodal insights into psychological states or neurological disorders. Recent advancements with Large…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Shuning Zhang , Ting Dang , Hong Jia , Flora D. Salim , Wen Hu , Aaron J. Quigley

Previous studies have shown that eye movement data recorded at 1000 Hz can be used to authenticate individuals. This study explores the effectiveness of eye movement-based biometrics (EMB) by utilizing data from an eye-tracking (ET)-enabled…

Human-Computer Interaction · Computer Science 2025-11-18 Mehedi Hasan Raju , Dillon J Lohr , Oleg V Komogortsev

In manufacturing sectors such as textiles and electronics, manual processes are a fundamental part of production. The analysis and monitoring of the processes is necessary for efficient production design. Traditional methods for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Marlin Berger , Frederik Cloppenburg , Jens Eufinger , Thomas Gries

Cybersickness poses a serious challenge for users of virtual reality (VR) technology. Consequently, there has been significant effort to track its occurrence during VR use with passive measures like brain activity recorded through…

Human-Computer Interaction · Computer Science 2026-03-30 Jacqueline Yau , Katherine J. Mimnaugh , Evan G. Center , Timo Ojala , Steven M. LaValle , Wenzhen Yuan , Nancy Amato , Minje Kim , Kara D. Federmeier

Emotion recognition through body movements has emerged as a compelling and privacy-preserving alternative to traditional methods that rely on facial expressions or physiological signals. Recent advancements in 3D skeleton acquisition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Haifeng Lu , Jiuyi Chen , Zhen Zhang , Ruida Liu , Runhao Zeng , Xiping Hu

Artificially intelligent perception is increasingly present in the lives of every one of us. Vehicles are no exception, (...) In the near future, pattern recognition will have an even stronger role in vehicles, as self-driving cars will…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 João Ribeiro Pinto