English
Related papers

Related papers: A Machine Learning-Based Multimodal Framework for …

200 papers

This study introduces a novel method that transforms multimodal physiological signalsphotoplethysmography (PPG), galvanic skin response (GSR), and acceleration (ACC) into 2D image matrices to enhance stress detection using convolutional…

Machine Learning · Computer Science 2025-09-18 Yasin Hasanpoor , Bahram Tarvirdizadeh , Khalil Alipour , Mohammad Ghamari

In the recent past, psychological stress has been increasingly observed in humans, and early detection is crucial to prevent health risks. Stress detection using on-device deep learning algorithms has been on the rise owing to advancements…

Machine Learning · Computer Science 2020-12-07 Abhijith Ragav , Gautham Krishna Gudur

Objective- Heart rate monitoring using wrist type Photoplethysmographic (PPG) signals is getting popularity because of construction simplicity and low cost of wearable devices. The task becomes very difficult due to the presence of various…

The predictive functions that permit humans to infer their body state by sensorimotor integration are critical to perform safe interaction in complex environments. These functions are adaptive and robust to non-linear actuators and noisy…

Robotics · Computer Science 2019-10-24 Pablo Lanillos , Gordon Cheng

Commercial wearables from Fitbit, Garmin, and Whoop have recently introduced real-time notifications based on detecting changes in physiological responses indicating potential stress. In this paper, we investigate how these new capabilities…

Human-Computer Interaction · Computer Science 2024-01-30 Sameer Neupane , Mithun Saha , Nasir Ali , Timothy Hnat , Shahin Alan Samiei , Anandatirtha Nandugudi , David M. Almeida , Santosh Kumar

The capability to automatically detect human stress can benefit artificial intelligent agents involved in affective computing and human-computer interaction. Stress and emotion are both human affective states, and stress has proven to have…

Computation and Language · Computer Science 2021-05-19 Yiqun Yao , Michalis Papakostas , Mihai Burzo , Mohamed Abouelenien , Rada Mihalcea

Performance measures such as stride length in athletics and the pace of runners can be estimated using different tricks such as measuring the number of steps divided by the running length or helping with markers printed on the track.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Patryk Skorupski , Cosimo Distante , Pier Luigi Mazzeo

This paper presents a novel multimodal human activity recognition system. It uses a two-stream decision level fusion of vision and inertial sensors. In the first stream, raw RGB frames are passed to a part affinity field-based pose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Santosh Kumar Yadav , Muhtashim Rafiqi , Egna Praneeth Gummana , Kamlesh Tiwari , Hari Mohan Pandey , Shaik Ali Akbara

Event-based vision sensors, inspired by biological neural systems, asynchronously capture local pixel-level intensity changes as a sparse event stream containing position, polarity, and timestamp information. These neuromorphic sensors…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Tiantian Xie , Pengpai Wang , Rosa H. M. Chan

Construction workers are highly vulnerable to heat stress, yet tools that translate real-time physiological data into actionable safety intelligence remain scarce. This study addresses this gap by developing and evaluating deep learning…

Artificial Intelligence · Computer Science 2026-04-22 Syed Sajid Ullah , Amir Khan

Existing multimodal stress/pain recognition approaches generally extract features from different modalities independently and thus ignore cross-modality correlations. This paper proposes a novel geometric framework for multimodal…

Machine Learning · Computer Science 2022-07-20 Yujin WU , Mohamed Daoudi , Ali Amad , Laurent Sparrow , Fabien D'Hondt

Wearable sensor-based Human Action Recognition (HAR) has made significant strides in recent times. However, the accuracy performance of wearable sensor-based HAR is currently still lagging behind that of visual modalities-based systems,…

Multimedia · Computer Science 2024-05-21 Jianyuan Ni , Hao Tang , Anne H. H. Ngu , Gaowen Liu , Yan Yan

In manufacturing sectors such as textiles and electronics, manual processes are a fundamental part of production. The analysis and monitoring of the processes is necessary for efficient production design. Traditional methods for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Marlin Berger , Frederik Cloppenburg , Jens Eufinger , Thomas Gries

In this study, we propose a method for single sensor-based activity recognition, trained with data from multiple sensors. There is no doubt that the performance of complex activity recognition systems increases when we use enough sensors…

Human-Computer Interaction · Computer Science 2020-02-27 Paula Lago , Moe Matsuki , Sozo Inoue

Physiological and behavioral data collected from wearable or mobile sensors have been used to estimate self-reported stress levels. Since the stress annotation usually relies on self-reports during the study, a limited amount of labeled…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Han Yu , Akane Sano

We describe a novel metric-based learning approach that introduces a multimodal framework and uses deep audio and geophone encoders in siamese configuration to design an adaptable and lightweight supervised model. This framework eliminates…

Sound · Computer Science 2021-11-16 Muhammad Shakeel , Katsutoshi Itoyama , Kenji Nishida , Kazuhiro Nakadai

Is there a way for a designer to evaluate the performance of a given hood frame geometry without spending significant time on simulation setup? This paper seeks to address this challenge by developing a multimodal machine-learning (MMML)…

Machine Learning · Computer Science 2025-09-16 Abhishek Indupally , Satchit Ramnath

Over the last decade, there has been significant progress in the field of interactive virtual rehabilitation. Physical therapy (PT) stands as a highly effective approach for enhancing physical impairments. However, patient motivation and…

Human-Computer Interaction · Computer Science 2024-05-24 Pavan Uttej Ravva , Pinar Kullu , Mohammad Fahim Abrar , Roghayeh Leila Barmaki

To date, machine learning for human action recognition in video has been widely implemented in sports activities. Although some studies have been successful in the past, precision is still the most significant concern. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Cheng Yan , Xin Li , Guoqiang Li

Stress detection and monitoring is an active area of research with important implications for the personal, professional, and social health of an individual. Current approaches for affective state classification use traditional machine…

Machine Learning · Computer Science 2021-07-14 Ramesh Kumar Sah , Hassan Ghasemzadeh