English
Related papers

Related papers: RF-Behavior: A Multimodal Radio-Frequency Dataset …

200 papers

Radio-Frequency (RF) based device-free Human Activity Recognition (HAR) rises as a promising solution for many applications. However, device-free (or contactless) sensing is often more sensitive to environment changes than device-based (or…

Signal Processing · Electrical Eng. & Systems 2021-11-09 Shuya Ding , Zhe Chen , Tianyue Zheng , Jun Luo

To properly assist humans in their needs, human activity recognition (HAR) systems need the ability to fuse information from multiple modalities. Our hypothesis is that multimodal sensors, visual and non-visual tend to provide complementary…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Hyeongju Choi , Apoorva Beedu , Harish Haresamudram , Irfan Essa

This study uses multisensory data (i.e., color and depth) to recognize human actions in the context of multimodal human-robot interaction. Here we employed the iCub robot to observe the predefined actions of the human partners by using four…

Robotics · Computer Science 2022-12-20 Kas Kniesmeijer , Murat Kirtay

Human Activity Recognition has gained significant attention due to its diverse applications, including ambient assisted living and remote sensing. Wearable sensor-based solutions often suffer from user discomfort and reliability issues,…

Analysis of human interaction is one important research topic of human motion analysis. It has been studied either using first person vision (FPV) or third person vision (TPV). However, the joint learning of both types of vision has so far…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Zihui Guo , Yonghong Hou , Pichao Wang , Zhimin Gao , Mingliang Xu , Wanqing Li

Modelling interactions between humans and objects in natural environments is central to many applications including gaming, virtual and mixed reality, as well as human behavior analysis and human-robot collaboration. This challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Bharat Lal Bhatnagar , Xianghui Xie , Ilya A. Petrov , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

Human Activity Recognition (HAR) primarily relied on traditional RGB cameras to achieve high-performance activity recognition. However, the challenging factors in real-world scenarios, such as insufficient lighting and rapid movements,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Shiao Wang , Xiao Wang , Bo Jiang , Lin Zhu , Guoqi Li , Yaowei Wang , Yonghong Tian , Jin Tang

In a human-centered intelligent manufacturing system, sensing and understanding of the worker's activity are the primary tasks. In this paper, we propose a novel multi-modal approach for worker activity recognition by leveraging information…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Wenjin Tao , Ming C. Leu , Zhaozheng Yin

Radio Frequency (RF) sensing is attracting interest in research, standardization, and industry, especially for its potential in Internet of Things (IoT) applications. By leveraging the properties of the ElectroMagnetic (EM) waves used in…

Signal Processing · Electrical Eng. & Systems 2026-01-13 Federica Fieramosca , Vittorio Rampa , Michele D'Amico , Stefano Savazzi

The ever increasing intensity and number of disasters make even more difficult the work of First Responders (FRs). Artificial intelligence and robotics solutions could facilitate their operations, compensating these difficulties. To this…

We present a dataset with models of 14 articulated objects commonly found in human environments and with RGB-D video sequences and wrenches recorded of human interactions with them. The 358 interaction sequences total 67 minutes of human…

Robotics · Computer Science 2018-06-19 Roberto Martín-Martín , Clemens Eppner , Oliver Brock

Cutting-edge robot learning techniques including foundation models and imitation learning from humans all pose huge demands on large-scale and high-quality datasets which constitute one of the bottleneck in the general intelligent robot…

Robotics · Computer Science 2026-04-27 Shuo Jiang , Haonan Li , Ruochen Ren , Yanmin Zhou , Zhipeng Wang , Bin He

We present a platform for student monitoring in remote education consisting of a collection of sensors and software that capture biometric and behavioral data. We define a collection of tasks to acquire behavioral data that can be useful…

Human-Computer Interaction · Computer Science 2019-12-11 Javier Hernandez-Ortega , Roberto Daza , Aythami Morales , Julian Fierrez , Javier Ortega-Garcia

Comprehensive capturing of human motions requires both accurate captures of complex poses and precise localization of the human within scenes. Most of the HPE datasets and methods primarily rely on RGB, LiDAR, or IMU data. However, solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ming Yan , Yan Zhang , Shuqiang Cai , Shuqi Fan , Xincheng Lin , Yudi Dai , Siqi Shen , Chenglu Wen , Lan Xu , Yuexin Ma , Cheng Wang

This study investigates the use of movement sensor data from a smart watch to infer an individual's emotional state. We present our findings on a user study with 50 participants. The experimental design is a mixed-design study;…

Human-Computer Interaction · Computer Science 2020-11-09 Juan C. Quiroz , Elena Geangu , Min Hooi Yong

This paper considers human activity classification for an indoor radar system. Human motions generate nonstationary radar returns which represent Doppler and micro-Doppler signals. The time-frequency (TF) analysis of micro-Doppler signals…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Patrick A. Schooley , Syed A. Hamza

This project investigates the human multi-modal behavior identification algorithm utilizing deep neural networks. According to the characteristics of different modal information, different deep neural networks are used to adapt to different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinyin Wang , Xingchen Li , Yixuan Jin , Yihao Zhong , Keke Zhang , Chang Zhou

Research has shown the complementarity of camera- and inertial-based data for modeling human activities, yet datasets with both egocentric video and inertial-based sensor data remain scarce. In this paper, we introduce WEAR, an outdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Marius Bock , Hilde Kuehne , Kristof Van Laerhoven , Michael Moeller

MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal dataset, implemented to benchmark Human Activity Recognition(HAR) and Multi-modal Fusion algorithms. Collection of this dataset was inspired by the need for recognising and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Anjana Wijekoon , Nirmalie Wiratunga , Kay Cooper

Deep learning-based RF fingerprinting has recently been recognized as a potential solution for enabling newly emerging wireless network applications, such as spectrum access policy enforcement, automated network device authentication, and…

Signal Processing · Electrical Eng. & Systems 2022-01-10 Abdurrahman Elmaghbub , Bechir Hamdaoui