中文
相关论文

相关论文: EV-Action: Electromyography-Vision Multi-Modal Act…

200 篇论文

Reconstructing human dynamic visual perception from electroencephalography (EEG) signals is of great research significance since EEG's non-invasiveness and high temporal resolution. However, EEG-to-video reconstruction remains challenging…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Tian-Yi Zhou , Xuan-Hao Liu , Bao-Liang Lu , Wei-Long Zheng

Video-based gait analysis has become a promising approach for assessing motor impairment in children with cerebral palsy (CP). However, existing methods usually rely on either pose sequences or handcrafted gait features alone, making it…

图像与视频处理 · 电气工程与系统科学 2026-03-25 Kaiyuan Yang , Xupeng Chen , Jiangpeng He

Video-based Clinical Gait Analysis often suffers from poor generalization as models overfit environmental biases instead of capturing pathological motion. To address this, we propose BioGait-VLM, a tri-modal Vision-Language-Biomechanics…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Erdong Chen , Yuyang Ji , Jacob K. Greenberg , Benjamin Steel , Faraz Arkam , Abigail Lewis , Pranay Singh , Feng Liu

This paper presents Ev-Layout, a novel large-scale event-based multi-modal dataset designed for indoor layout estimation and tracking. Ev-Layout makes key contributions to the community by: Utilizing a hybrid data collection platform (with…

图形学 · 计算机科学 2025-03-12 Xucheng Guo , Yiran Shen , Xiaofang Xiao , Yuanfeng Zhou , Lin Wang

We present a new dataset and benchmark with the goal of advancing research in the intersection of brain activities and eye movements. Our dataset, EEGEyeNet, consists of simultaneous Electroencephalography (EEG) and Eye-tracking (ET)…

信号处理 · 电气工程与系统科学 2021-11-11 Ard Kastrati , Martyna Beata Płomecka , Damián Pascual , Lukas Wolf , Victor Gillioz , Roger Wattenhofer , Nicolas Langer

Recently, action recognition has been dominated by transformer-based methods, thanks to their spatiotemporal contextual aggregation capacities. However, despite the significant progress achieved on scene-related datasets, they do not…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Peiqin Zhuang , Lei Bai , Yichao Wu , Ding Liang , Luping Zhou , Yali Wang , Wanli Ouyang

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

人机交互 · 计算机科学 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

In recent years, short video platforms have gained widespread popularity, making the quality of video recommendations crucial for retaining users. Existing recommendation systems primarily rely on behavioral data, which faces limitations…

信息检索 · 计算机科学 2024-04-02 Shaorun Zhang , Zhiyu He , Ziyi Ye , Peijie Sun , Qingyao Ai , Min Zhang , Yiqun Liu

Surface Electromyography (sEMG/EMG) is to record muscles' electrical activity from a restricted area of the skin by using electrodes. The sEMG-based gesture recognition is extremely sensitive of inter-session and inter-subject variances. We…

机器学习 · 计算机科学 2019-12-02 István Ketykó , Ferenc Kovács , Krisztián Zsolt Varga

Driver emotion recognition plays a crucial role in driver monitoring systems, enhancing human-autonomy interactions and the trustworthiness of Autonomous Driving (AD). Various physiological and behavioural modalities have been explored for…

机器学习 · 计算机科学 2025-03-04 Nastaran Mansourian , Arash Mohammadi , M. Omair Ahmad , M. N. S. Swamy

We present DogMo, a large-scale multi-view RGB-D video dataset capturing diverse canine movements for the task of motion recovery from images. DogMo comprises 1.2k motion sequences collected from 10 unique dogs, offering rich variation in…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Zan Wang , Siyu Chen , Luya Mo , Xinfeng Gao , Yuxin Shen , Lebin Ding , Wei Liang

The introduction of low-cost RGB-D sensors has promoted the research in skeleton-based human action recognition. Devising a representation suitable for characterising actions on the basis of noisy skeleton sequences remains a challenge,…

计算机视觉与模式识别 · 计算机科学 2015-04-21 Ruizhi Qiao , Lingqiao Liu , Chunhua Shen , Anton von den Hengel

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis, biomedical…

计算机视觉与模式识别 · 计算机科学 2022-01-10 Doan Duy Vo , Russell Butler

Electromyography (EMG) signals have been successfully employed for driving prosthetic limbs of a single or double degree of freedom. This principle works by using the amplitude of the EMG signals to decide between one or two simpler…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Asad Ullah , Sarwan Ali , Imdadullah Khan , Muhammad Asad Khan , Safiullah Faizullah

The human neuromuscular system consisting of skeletal muscles and neural circuits is a complex system that is not yet fully understood. Surface electromyography (EMG) can be used to study muscle behavior from the outside. Computer…

分布式、并行与集群计算 · 计算机科学 2021-07-16 Benjamin Maier

Recently, multimodal tasks have strongly advanced the field of action recognition with their rich multimodal information. However, due to the scarcity of tri-modal data, research on tri-modal action recognition tasks faces many challenges.…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Songping Wang , Xiantao Hu , Yueming Lyu , Caifeng Shan

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

The discrimination of human gestures using wearable solutions is extremely important as a supporting technique for assisted living, healthcare of the elderly and neurorehabilitation. This paper presents a mobile electromyography (EMG)…

计算机视觉与模式识别 · 计算机科学 2019-10-25 Enea Ceolini , Gemma Taverni , Lyes Khacef , Melika Payvand , Elisa Donati

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

机器学习 · 计算机科学 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Combining skeleton structure with graph convolutional networks has achieved remarkable performance in human action recognition. Since current research focuses on designing basic graph for representing skeleton data, these embedding features…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Dong Yang , Monica Mengqi Li , Hong Fu , Jicong Fan , Zhao Zhang , Howard Leung