English
Related papers

Related papers: EmbraceNet for Activity: A Deep Multimodal Fusion …

200 papers

Following the rapidly growing digital image usage, automatic image categorization has become preeminent research area. It has broaden and adopted many algorithms from time to time, whereby multi-feature (generally, hand-engineered features)…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Thangarajah Akilan , Q. M. Jonathan Wu , Wei Jiang

Mobile and wearable devices have enabled numerous applications, including activity tracking, wellness monitoring, and human--computer interaction, that measure and improve our daily lives. Many of these applications are made possible by…

Human-Computer Interaction · Computer Science 2022-03-04 Shibo Zhang , Yaxuan Li , Shen Zhang , Farzad Shahabi , Stephen Xia , Yu Deng , Nabil Alshurafa

Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data. Traditional approaches for Multiple Kernel Learning (MKL) attempt to learn the parameters for combining the…

Human-robot interaction (HRI) research is progressively addressing multi-party scenarios, where a robot interacts with more than one human user at the same time. Conversely, research is still at an early stage for human-robot collaboration.…

Machine Learning · Computer Science 2023-11-16 Francesco Semeraro , Jon Carberry , Angelo Cangelosi

This paper investigates the MM dynamics approach proposed by Han et al. (2022) for multi-modal fusion in biomedical classification tasks. The MM dynamics algorithm integrates feature-level and modality-level informativeness to dynamically…

Machine Learning · Computer Science 2024-11-04 Laura Wenderoth

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

This paper proposes a new 3D Human Action Recognition system as a two-phase system: (1) Deep Metric Learning Module which learns a similarity metric between two 3D joint sequences using Siamese-LSTM networks; (2) A Multiclass Classification…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Seyma Yucer , Yusuf Sinan Akgul

The combination of increased life expectancy and falling birth rates is resulting in an aging population. Wearable Sensor-based Human Activity Recognition (WSHAR) emerges as a promising assistive technology to support the daily lives of…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Jianyuan Ni , Hao Tang , Syed Tousiful Haque , Yan Yan , Anne H. H. Ngu

While traditional feature engineering for Human Activity Recognition (HAR) involves a trial-anderror process, deep learning has emerged as a preferred method for high-level representations of sensor-based human activities. However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Haoran Duan , Shidong Wang , Varun Ojha , Shizheng Wang , Yawen Huang , Yang Long , Rajiv Ranjan , Yefeng Zheng

Human activity recognition (HAR) in Internet of Things (IoT) environments must cope with heterogeneous sensor settings that vary across datasets, devices, body locations, sensing modalities, and channel compositions. This heterogeneity…

Machine Learning · Computer Science 2026-04-24 Tatsuhito Hasegawa

The human visual perception system has strong robustness in image fusion. This robustness is based on human visual perception system's characteristics of feature selection and non-linear fusion of different features. In order to simulate…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

Wearable sensor based human activity recognition is a challenging problem due to difficulty in modeling spatial and temporal dependencies of sensor signals. Recognition models in closed-set assumption are forced to yield members of known…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 M Tanjid Hasan Tonmoy , Saif Mahmud , A K M Mahbubur Rahman , M Ashraful Amin , Amin Ahsan Ali

Biometrics based personal identification is regarded as an effective method for automatically recognizing, with a high confidence a person's identity. A multimodal biometric systems consolidate the evidence presented by multiple biometric…

Computer Vision and Pattern Recognition · Computer Science 2009-09-15 M. Nageshkumar , P. K. Mahesh , M. N. S. Swamy

Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them,…

Materials Science · Physics 2025-03-04 Onur Boyar , Indra Priyadarsini , Seiji Takeda , Lisa Hamada

The proliferation of deep learning has significantly advanced various fields, yet Human Activity Recognition (HAR) has not fully capitalized on these developments, primarily due to the scarcity of labeled datasets. Despite the integration…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Parham Zolfaghari , Vitor Fortes Rey , Lala Ray , Hyun Kim , Sungho Suh , Paul Lukowicz

Several types of sensors have been available in off-the-shelf mobile devices, including motion, magnetic, vision, acoustic, and location sensors. This paper focuses on the fusion of the data acquired from motion and magnetic sensors, i.e.,…

Computers and Society · Computer Science 2017-11-21 Ivan Miguel Pires , Nuno M. Garcia , Nuno Pombo , Francisco Flórez-Revuelta , Susanna Spinsante

This research presents a novel multimodal data fusion methodology for pain behavior recognition, integrating statistical correlation analysis with human-centered insights. Our approach introduces two key innovations: 1) integrating…

Artificial Intelligence · Computer Science 2025-01-22 Xingrui Gu , Zhixuan Wang , Irisa Jin , Zekun Wu

Real-time human activity recognition plays an essential role in real-world human-centered robotics applications, such as assisted living and human-robot collaboration. Although previous methods based on skeletal data to encode human poses…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Brian Reily , Qingzhao Zhu , Christopher Reardon , Hao Zhang

Emotion recognition is essential across numerous fields, including medical applications and brain-computer interface (BCI). Emotional responses include behavioral reactions, such as tone of voice and body movement, and changes in…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Eleonora Lopez , Aurelio Uncini , Danilo Comminiello

As the world population gets older, the healthcare system must be adapted, among others by providing continuous health monitoring at home and in the city. The social activities have a significant role in everyone health status. Hence, this…

Computers and Society · Computer Science 2016-12-01 Loïc Sevrin , Bertrand Massot , Norbert Noury , Nacer Abouchi , Fabrice Jumel , Jacques Saraydaryan