English
Related papers

Related papers: Coupling the Heart to Musical Machines

200 papers

Digitally presenting physiological signals as biofeedback to users raises awareness of both body and mind. This paper describes the effectiveness of conveying a physiological signal often overlooked for communication: breathing. We present…

Human-Computer Interaction · Computer Science 2018-06-25 Jérémy Frey , May Grabli , Ronit Slyper , Jessica Cauchard

Objective- Heart rate monitoring using wrist type Photoplethysmographic (PPG) signals is getting popularity because of construction simplicity and low cost of wearable devices. The task becomes very difficult due to the presence of various…

In this demo paper, we design and prototype RhythmEdge, a low-cost, deep-learning-based contact-less system for regular HR monitoring applications. RhythmEdge benefits over existing approaches by facilitating contact-less nature,…

Machine Learning · Computer Science 2022-08-16 Zahid Hasan , Emon Dey , Sreenivasan Ramasamy Ramamurthy , Nirmalya Roy , Archan Misra

Photoplethysmography (PPG) is a method of detecting variation in blood volume commonly through contact with the skin and involving the usage of one or multiple sensors. PPG is typically used in health-related fields and one of its most…

Medical Physics · Physics 2021-08-24 Jiesheng He , Wei Wu

Biometric authentication using physiological signals offers a promising path toward secure and user-friendly access control in wearable devices. While electrocardiogram (ECG) signals have shown high discriminability, their intrusive sensing…

Cryptography and Security · Computer Science 2025-08-20 Wei Shao , Zequan Liang , Ruoyu Zhang , Ruijie Fang , Ning Miao , Ehsan Kourkchi , Setareh Rafatirad , Houman Homayoun , Chongzhou Fang

New trends on brain-computer interface (BCI) design are aiming to combine this technology with immersive virtual reality in order to provide a sense of realism to its users. In this study, we propose an experimental BCI to control an…

Signal Processing · Electrical Eng. & Systems 2019-12-09 Myriam Alanis-Espinosa , David Gutiérrez

With the increasing demands of emotion comprehension and regulation in our daily life, a customized music-based emotion regulation system is introduced by employing current EEG information and song features, which predicts users' emotion…

Human-Computer Interaction · Computer Science 2022-11-29 Jiyang Li , Wei Wang , Kratika Bhagtani , Yincheng Jin , Zhanpeng Jin

The use of photoplethysmogram signal (PPG) for heart and sleep monitoring is commonly found nowadays in smartphones and wrist wearables. Besides common usages, it has been proposed and reported that person information can be extracted from…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-13 Guillermo Cámbara , Jordi Luque , Mireia Farrús

Heart rate measuring based on remote photoplethysmography (rPPG) plays an important role in health caring, which estimates heart rate from facial video in a non-contact, less-constrained way. End-to-end neural network is a main branch of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Weiyu Sun , Xinyu Zhang , Ying Chen , Yun Ge , Chunyu Ji , Xiaolin Huang

This paper presents the soma design process of creating Body Electric: a novel interface for the capture and use of biofeedback signals and physiological changes generated in the body by breathing, during singing. This NIME design is…

Human-Computer Interaction · Computer Science 2023-11-15 Kelsey Cotton , Pedro Sanches , Vasiliki Tsaknaki , Pavel Karpashevich

Human computer interaction has become integral to modern life, driven by advancements in machine learning technologies. Affective computing, in particular, has focused on systems that recognize, interpret, and respond to human emotions,…

Signal Processing · Electrical Eng. & Systems 2025-07-23 Karim Alghoul , Hussein Al Osman , Abdulmotaleb El Saddik

Non-contact facial video-based heart rate estimation using remote photoplethysmography (rPPG) has shown great potential in many applications (e.g., remote health care) and achieved creditable results in constrained scenarios. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Jiaqi Kang , Su Yang , Weishan Zhang

The NIME conference traditionally focuses on interfaces for music and musical expression. In this paper we reverse this tradition to ask, can interfaces developed for music be successfully appropriated to non-musical applications? To help…

Human-Computer Interaction · Computer Science 2025-04-22 Tace McNamara , Jon McCormack , Maria Teresa Llano

Photoplethysmography (PPG) devices are widely used for monitoring cardiovascular function. However, these devices require skin contact, which restrict their use to at-rest short-term monitoring using single-point measurements.…

Continuous cardiovascular monitoring can play a key role in precision health. However, some fundamental cardiac biomarkers of interest, including stroke volume and cardiac output, require invasive measurements, e.g., arterial pressure…

Vital sign measurement using cameras presents opportunities for comfortable, ubiquitous health monitoring. Remote photoplethysmography (rPPG), a foundational technology, enables cardiac measurement through minute changes in light reflected…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kegang Wang , Jiankai Tang , Yuntao Wang , Xin Liu , Yuxuan Fan , Jiatong Ji , Yuanchun Shi , Daniel McDuff

We present a multimodal system for personalized music generation that integrates physiological sensing, LLM-based reasoning, and controllable audio synthesis. A millimeter-wave radar sensor non-invasively captures heart rate and respiration…

Human-Computer Interaction · Computer Science 2025-10-21 Yunzhe Wang , Xinyu Tang , Zhixun Huang , Xiaolong Yue , Yuxin Zeng

This paper presents a study on the use of a real-time music-to-image system as a mechanism to support and inspire musicians during their creative process. The system takes MIDI messages from a keyboard as input which are then interpreted…

Human-Computer Interaction · Computer Science 2024-07-09 Meng Yang , Maria Teresa Llano , Jon McCormack

In recent years, there has been a shift of interest towards the field of biometric authentication, which proves the identity of the user using their biological characteristics. We explore a novel biometric based on the electrical activity…

Cryptography and Security · Computer Science 2019-06-24 Nikita Samarin , Donald Sannella

Egocentric vision systems aim to understand the spatial surroundings and the wearer's behavior inside it, including motions, activities, and interactions. We argue that egocentric systems must additionally detect physiological states to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Björn Braun , Rayan Armani , Manuel Meier , Max Moebus , Christian Holz