中文
相关论文

相关论文: EmbraceNet for Activity: A Deep Multimodal Fusion …

200 篇论文

Recent years have witnessed the rapid development of human activity recognition (HAR) based on wearable sensor data. One can find many practical applications in this area, especially in the field of health care. Many machine learning…

机器学习 · 计算机科学 2019-05-16 H. D. Nguyen , K. P. Tran , X. Zeng , L. Koehl , G. Tartare

The field of sensor-based human activity recognition (HAR) mainly uses posture, motion and context data of Inertial Measurement Units (IMUs) to identify daily activities. Despite the advancements in learning-based methods, it is challenging…

人工智能 · 计算机科学 2026-05-12 Ye Zhang , Longguang Wang , Qing Gao , Chaocan Xiang , Mohammed Bennamoun , Yulan Guo

Human action recognition is used in many applications such as video surveillance, human computer interaction, assistive living, and gaming. Many papers have appeared in the literature showing that the fusion of vision and inertial sensing…

人机交互 · 计算机科学 2020-08-04 Sharmin Majumder , Nasser Kehtarnavaz

Fusion-based place recognition is an emerging technique jointly utilizing multi-modal perception data, to recognize previously visited places in GPS-denied scenarios for robots and autonomous vehicles. Recent fusion-based place recognition…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Jingyi Xu , Junyi Ma , Qi Wu , Zijie Zhou , Yue Wang , Xieyuanli Chen , Ling Pei

In this paper, we report a hierarchical deep learning model for classification of complex human activities using motion sensors. In contrast to traditional Human Activity Recognition (HAR) models used for event-based activity recognition,…

机器学习 · 计算机科学 2022-07-19 Eric Rosen , Doruk Senkal

The extensive ubiquitous availability of sensors in smart devices and the Internet of Things (IoT) has opened up the possibilities for implementing sensor-based activity recognition. As opposed to traditional sensor time-series processing…

信号处理 · 电气工程与系统科学 2023-10-09 Danial Ahangarani , Mohammad Shirazi , Navid Ashraf

In the human activity recognition research area, prior studies predominantly concentrate on leveraging advanced algorithms on public datasets to enhance recognition performance, little attention has been paid to executing real-time kitchen…

信号处理 · 电气工程与系统科学 2024-09-11 Mengxi Liu , Sungho Suh , Juan Felipe Vargas , Bo Zhou , Agnes Grünerbl , Paul Lukowicz

Sensor-based human activity recognition (HAR) is now a research hotspot in multiple application areas. With the rise of smart wearable devices equipped with inertial measurement units (IMUs), researchers begin to utilize IMU data for HAR.…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Fanyi Xiao , Ling Pei , Lei Chu , Danping Zou , Wenxian Yu , Yifan Zhu , Tao Li

Human activity recognition using deep learning techniques has become increasing popular because of its high effectivity with recognizing complex tasks, as well as being relatively low in costs compared to more traditional machine learning…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Wei Zhong Tee , Rushit Dave , Naeem Seliya , Mounika Vanamala

Human activity recognition (HAR) is fundamental in human-robot collaboration (HRC), enabling robots to respond to and dynamically adapt to human intentions. This paper introduces a HAR system combining a modular data glove equipped with…

Human activity recognition (HAR) is essential for effective Human-Robot Collaboration (HRC), enabling robots to interpret and respond to human actions. This study evaluates the ability of a vision-based tactile sensor to classify 15…

Utilizing the sensor characteristics of the audio, visible camera, and thermal camera, the robustness of person recognition can be enhanced. Existing multimodal person recognition frameworks are primarily formulated assuming that multimodal…

多媒体 · 计算机科学 2022-10-25 Vijay John , Yasutomo Kawanishi

The popularity and diffusion of wearable devices provides new opportunities for sensor-based human activity recognition that leverages deep learning-based algorithms. Although impressive advances have been made, two major challenges remain.…

信号处理 · 电气工程与系统科学 2024-02-16 Mengna Liu , Dong Xiang , Xu Cheng , Xiufeng Liu , Dalin Zhang , Shengyong Chen , Christian S. Jensen

Action recognition is an important yet challenging task in computer vision. In this paper, we propose a novel deep-based framework for action recognition, which improves the recognition accuracy by: 1) deriving more precise features for…

计算机视觉与模式识别 · 计算机科学 2017-11-21 Weiyao Lin , Yang Mi , Jianxin Wu , Ke Lu , Hongkai Xiong

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

计算与语言 · 计算机科学 2025-05-09 Nischal Mandal , Yang Li

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

In this paper, we propose regular vine copula based fusion of multiple deep neural network classifiers for the problem of multi-sensor based human activity recognition. We take the cross-modal dependence into account by employing regular…

信号处理 · 电气工程与系统科学 2019-11-22 Shan Zhang , Baocheng Geng , Pramod K. Varshney , Muralidhar Rangaswamy

Characterizing the dynamic interactive patterns of complex systems helps gain in-depth understanding of how components interrelate with each other while performing certain functions as a whole. In this study, we present a novel multimodal…

机器学习 · 计算机科学 2019-01-07 Miaolin Fan , Chun-An Chou , Sheng-Che Yen , Yingzi Lin

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

机器学习 · 计算机科学 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

We introduce a system that recognizes concurrent activities from real-world data captured by multiple sensors of different types. The recognition is achieved in two steps. First, we extract spatial and temporal features from the multimodal…

计算机视觉与模式识别 · 计算机科学 2017-02-07 Xinyu Li , Yanyi Zhang , Jianyu Zhang , Shuhong Chen , Ivan Marsic , Richard A. Farneth , Randall S. Burd