English
Related papers

Related papers: EV-Action: Electromyography-Vision Multi-Modal Act…

200 papers

Reconstructing human dynamic visual perception from electroencephalography (EEG) signals is of great research significance since EEG's non-invasiveness and high temporal resolution. However, EEG-to-video reconstruction remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Tian-Yi Zhou , Xuan-Hao Liu , Bao-Liang Lu , Wei-Long Zheng

Video-based gait analysis has become a promising approach for assessing motor impairment in children with cerebral palsy (CP). However, existing methods usually rely on either pose sequences or handcrafted gait features alone, making it…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Kaiyuan Yang , Xupeng Chen , Jiangpeng He

Video-based Clinical Gait Analysis often suffers from poor generalization as models overfit environmental biases instead of capturing pathological motion. To address this, we propose BioGait-VLM, a tri-modal Vision-Language-Biomechanics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Erdong Chen , Yuyang Ji , Jacob K. Greenberg , Benjamin Steel , Faraz Arkam , Abigail Lewis , Pranay Singh , Feng Liu

This paper presents Ev-Layout, a novel large-scale event-based multi-modal dataset designed for indoor layout estimation and tracking. Ev-Layout makes key contributions to the community by: Utilizing a hybrid data collection platform (with…

Graphics · Computer Science 2025-03-12 Xucheng Guo , Yiran Shen , Xiaofang Xiao , Yuanfeng Zhou , Lin Wang

We present a new dataset and benchmark with the goal of advancing research in the intersection of brain activities and eye movements. Our dataset, EEGEyeNet, consists of simultaneous Electroencephalography (EEG) and Eye-tracking (ET)…

Signal Processing · Electrical Eng. & Systems 2021-11-11 Ard Kastrati , Martyna Beata Płomecka , Damián Pascual , Lukas Wolf , Victor Gillioz , Roger Wattenhofer , Nicolas Langer

Recently, action recognition has been dominated by transformer-based methods, thanks to their spatiotemporal contextual aggregation capacities. However, despite the significant progress achieved on scene-related datasets, they do not…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Peiqin Zhuang , Lei Bai , Yichao Wu , Ding Liang , Luping Zhou , Yali Wang , Wanli Ouyang

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

Human-Computer Interaction · Computer Science 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

In recent years, short video platforms have gained widespread popularity, making the quality of video recommendations crucial for retaining users. Existing recommendation systems primarily rely on behavioral data, which faces limitations…

Information Retrieval · Computer Science 2024-04-02 Shaorun Zhang , Zhiyu He , Ziyi Ye , Peijie Sun , Qingyao Ai , Min Zhang , Yiqun Liu

Surface Electromyography (sEMG/EMG) is to record muscles' electrical activity from a restricted area of the skin by using electrodes. The sEMG-based gesture recognition is extremely sensitive of inter-session and inter-subject variances. We…

Machine Learning · Computer Science 2019-12-02 István Ketykó , Ferenc Kovács , Krisztián Zsolt Varga

Driver emotion recognition plays a crucial role in driver monitoring systems, enhancing human-autonomy interactions and the trustworthiness of Autonomous Driving (AD). Various physiological and behavioural modalities have been explored for…

Machine Learning · Computer Science 2025-03-04 Nastaran Mansourian , Arash Mohammadi , M. Omair Ahmad , M. N. S. Swamy

We present DogMo, a large-scale multi-view RGB-D video dataset capturing diverse canine movements for the task of motion recovery from images. DogMo comprises 1.2k motion sequences collected from 10 unique dogs, offering rich variation in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Zan Wang , Siyu Chen , Luya Mo , Xinfeng Gao , Yuxin Shen , Lebin Ding , Wei Liang

The introduction of low-cost RGB-D sensors has promoted the research in skeleton-based human action recognition. Devising a representation suitable for characterising actions on the basis of noisy skeleton sequences remains a challenge,…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Ruizhi Qiao , Lingqiao Liu , Chunhua Shen , Anton von den Hengel

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis, biomedical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Doan Duy Vo , Russell Butler

Electromyography (EMG) signals have been successfully employed for driving prosthetic limbs of a single or double degree of freedom. This principle works by using the amplitude of the EMG signals to decide between one or two simpler…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Asad Ullah , Sarwan Ali , Imdadullah Khan , Muhammad Asad Khan , Safiullah Faizullah

The human neuromuscular system consisting of skeletal muscles and neural circuits is a complex system that is not yet fully understood. Surface electromyography (EMG) can be used to study muscle behavior from the outside. Computer…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-16 Benjamin Maier

Recently, multimodal tasks have strongly advanced the field of action recognition with their rich multimodal information. However, due to the scarcity of tri-modal data, research on tri-modal action recognition tasks faces many challenges.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Songping Wang , Xiantao Hu , Yueming Lyu , Caifeng Shan

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

The discrimination of human gestures using wearable solutions is extremely important as a supporting technique for assisted living, healthcare of the elderly and neurorehabilitation. This paper presents a mobile electromyography (EMG)…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Enea Ceolini , Gemma Taverni , Lyes Khacef , Melika Payvand , Elisa Donati

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Combining skeleton structure with graph convolutional networks has achieved remarkable performance in human action recognition. Since current research focuses on designing basic graph for representing skeleton data, these embedding features…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dong Yang , Monica Mengqi Li , Hong Fu , Jicong Fan , Zhao Zhang , Howard Leung