English
Related papers

Related papers: Hierarchical and Multimodal Data for Daily Activit…

200 papers

Transformer-based models have achieved state-of-the-art performance in various computer vision tasks, including image and video analysis. However, Transformer's complex architecture and black-box nature pose challenges for explainability, a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Zerui Wang , Yan Liu

In the many years since the inception of wearable sensor-based Human Activity Recognition (HAR), a wide variety of methods have been introduced and evaluated for their ability to recognize activities. Substantial gains have been made since…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Harish Haresamudram , Chi Ian Tang , Sungho Suh , Paul Lukowicz , Thomas Ploetz

Multimodal human action recognition (HAR) leverages complementary sensors for activity classification. Beyond recognition, recent advances in large language models (LLMs) enable detailed descriptions and causal reasoning, motivating new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siyang Jiang , Mu Yuan , Xiang Ji , Bufang Yang , Zeyu Liu , Lilin Xu , Yang Li , Yuting He , Liran Dong , Wenrui Lu , Zhenyu Yan , Xiaofan Jiang , Wei Gao , Hongkai Chen , Guoliang Xing

Research has shown the complementarity of camera- and inertial-based data for modeling human activities, yet datasets with both egocentric video and inertial-based sensor data remain scarce. In this paper, we introduce WEAR, an outdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Marius Bock , Hilde Kuehne , Kristof Van Laerhoven , Michael Moeller

The growth in the elderly population and the shift in the age pyramid have increased the demand for healthcare and well-being services. To address this concern, alongside the rising cost of medical care, the concept of ageing at home has…

Supervised Deep Learning (DL) models are currently the leading approach for sensor-based Human Activity Recognition (HAR) on wearable and mobile devices. However, training them requires large amounts of labeled data whose collection is…

Machine Learning · Computer Science 2023-04-20 Luca Arrotta , Gabriele Civitarese , Samuele Valente , Claudio Bettini

In the last years, several machine learning-based techniques have been proposed to monitor human movements from Wi-Fi channel readings. However, the development of domain-adaptive algorithms that robustly work across different environments…

Signal Processing · Electrical Eng. & Systems 2024-08-27 Francesca Meneghello , Nicolò Dal Fabbro , Domenico Garlisi , Ilenia Tinnirello , Michele Rossi

The current gold standard for human activity recognition (HAR) is based on the use of cameras. However, the poor scalability of camera systems renders them impractical in pursuit of the goal of wider adoption of HAR in mobile computing…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Eoin Brophy , José Juan Dominguez Veiga , Zhengwei Wang , Alan F. Smeaton , Tomas E. Ward

Human activity recognition (HAR) is essential in healthcare, elder care, security, and human-computer interaction. The use of precise sensor data to identify activities passively and continuously makes HAR accessible and ubiquitous.…

Human-Computer Interaction · Computer Science 2024-08-01 Argha Sen , Anirban Das , Swadhin Pradhan , Sandip Chakraborty

Autonomous driving is a popular research area within the computer vision research community. Since autonomous vehicles are highly safety-critical, ensuring robustness is essential for real-world deployment. While several public multimodal…

Human activity recognition (HAR) is often limited by the scarcity of labeled datasets due to the high cost and complexity of real-world data collection. To mitigate this, recent work has explored generating virtual inertial measurement unit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zikang Leng , Archith Iyer , Thomas Plötz

This paper presents a human gait data collection for analysis and activity recognition consisting of continues recordings of combined activities, such as walking, running, taking stairs up and down, sitting down, and so on; and the data…

Computers and Society · Computer Science 2017-07-12 Roman Chereshnev , Attila Kertesz-Farkas

Complex activities in real-world audio unfold over extended durations and exhibit hierarchical structure, yet most prior work focuses on short clips and isolated events. To bridge this gap, we introduce MultiAct, a new dataset and benchmark…

Sound · Computer Science 2026-02-09 Peng Zhang , Qingyu Luo , Philip J. B. Jackson , Wenwu Wang

In the human activity recognition research area, prior studies predominantly concentrate on leveraging advanced algorithms on public datasets to enhance recognition performance, little attention has been paid to executing real-time kitchen…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Mengxi Liu , Sungho Suh , Juan Felipe Vargas , Bo Zhou , Agnes Grünerbl , Paul Lukowicz

In the field of robotic manipulation, deep imitation learning is recognized as a promising approach for acquiring manipulation skills. Additionally, learning from diverse robot datasets is considered a viable method to achieve versatility…

Robotics · Computer Science 2024-03-20 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Lifelogging involves continuously capturing personal data through wearable cameras, providing an egocentric view of daily activities. Lifelog retrieval aims to search and retrieve relevant moments from this data, yet existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Minh-Quan Ho-Le , Duy-Khang Ho , Van-Tu Ninh , Cathal Gurrin , Minh-Triet Tran

Wearable HAR has improved steadily, but most progress still relies on closed-set classification, which limits real-world use. In practice, human activity is open-ended, unscripted, personalized, and often compositional, unfolding as…

Machine Learning · Computer Science 2026-04-02 Lala Shakti Swarup Ray , Mengxi Liu , Alcina Pinto , Deepika Gurung , Daniel Geissler , Paul Lukowoicz , Bo Zhou

We explore new aspects of assistive living on smart human-robot interaction (HRI) that involve automatic recognition and online validation of speech and gestures in a natural interface, providing social features for HRI. We introduce a…

Multimedia · Computer Science 2017-11-07 A. Zlatintsi , I. Rodomagoulakis , P. Koutras , A. C. Dometios , V. Pitsikalis , C. S. Tzafestas , P. Maragos

MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal dataset, implemented to benchmark Human Activity Recognition(HAR) and Multi-modal Fusion algorithms. Collection of this dataset was inspired by the need for recognising and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Anjana Wijekoon , Nirmalie Wiratunga , Kay Cooper

Assistive robot arms try to help their users perform everyday tasks. One way robots can provide this assistance is shared autonomy. Within shared autonomy, both the human and robot maintain control over the robot's motion: as the robot…

Robotics · Computer Science 2024-02-19 Ananth Jonnavittula , Shaunak A. Mehta , Dylan P. Losey