English
Related papers

Related papers: Hearables: Multimodal physiological in-ear sensing

200 papers

While traditional earphones primarily offer private audio spaces, so-called "earables" emerged to offer a variety of sensing capabilities. Pioneering platforms like OpenEarable have introduced novel sensing platforms targeted at the ears,…

Hardware Architecture · Computer Science 2024-10-10 Philipp Lepold , Tobias Röddiger , Tobias King , Kai Kunze , Christoph Maurer , Michael Beigl

Quality of health is greatly impacted by the quality of measurement, hence active monitoring of patient's vitals status greatly affects recovery and improves prognosis. In this paper, we proposed an IoT health based monitoring system which…

Signal Processing · Electrical Eng. & Systems 2024-07-16 Micky Nnamdi , Peter Joboson , Charles Bala , Charles Dyaji Bala

While on-body device-based human motion estimation is crucial for applications such as XR interaction, existing methods often suffer from poor wearability, expensive hardware, and cumbersome calibration, which hinder their adoption in daily…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Siqi Zhu , Yixuan Li , Junfu Li , Qi Wu , Zan Wang , Haozhe Ma , Wei Liang

This paper presents a comprehensive review of methods covering significant subjective and objective human stress detection techniques available in the literature. The methods for measuring human stress responses could include subjective…

Human-Computer Interaction · Computer Science 2023-06-08 Aamir Arsalan , Muhammad Majid , Imran Fareed Nizami , Waleed Manzoor , Syed Muhammad Anwar , Jihyoung Ryu

Wearable sensors have become ubiquitous thanks to a variety of health tracking features. The resulting continuous and longitudinal measurements from everyday life generate large volumes of data; however, making sense of these observations…

The correlation between children's personal and family characteristics (e.g., demographics and socioeconomic status) and their physical and mental health status has been extensively studied across various research domains, such as public…

Human-Computer Interaction · Computer Science 2024-04-11 Zhihan Jiang , Handi Chen , Rui Zhou , Jing Deng , Xinchen Zhang , Running Zhao , Cong Xie , Yifang Wang , Edith C. H. Ngai

We describe a novel metric-based learning approach that introduces a multimodal framework and uses deep audio and geophone encoders in siamese configuration to design an adaptable and lightweight supervised model. This framework eliminates…

Sound · Computer Science 2021-11-16 Muhammad Shakeel , Katsutoshi Itoyama , Kenji Nishida , Kazuhiro Nakadai

Machine learning models built on training data with multiple modalities can reveal new insights that are not accessible through unimodal datasets. For example, cardiac magnetic resonance images (MRIs) and electrocardiograms (ECGs) are both…

Machine Learning · Computer Science 2023-12-05 Bum Chul Kwon , Samuel Friedman , Kai Xu , Steven A Lubitz , Anthony Philippakis , Puneet Batra , Patrick T Ellinor , Kenney Ng

Earables, such as True Wireless Stereo earphones and VR/AR headsets, are increasingly popular, yet their compact design poses challenges for robust voice-related applications like telecommunication and voice assistant interactions in noisy…

Sound · Computer Science 2025-12-03 Lixing He , Yunqi Guo , Haozheng Hou , Zhenyu Yan

Wearables equipped with pervasive sensors enable us to monitor physiological and behavioral signals in our everyday life. We propose the WellAff system able to recognize affective states for wellbeing support. It also includes health care…

As chatbots continue to evolve toward human-like, real-world, interactions, multimodality remains an active area of research and exploration. So far, efforts to integrate multimodality into chatbots have primarily focused on image-centric…

Computation and Language · Computer Science 2025-06-03 Jihyoung Jang , Minwook Bae , Minji Kim , Dilek Hakkani-Tur , Hyounghun Kim

Respiratory rate (RR) monitoring is integral to understanding physical and mental health and tracking fitness. Existing studies have demonstrated the feasibility of RR monitoring under specific user conditions (e.g., while remaining still,…

Human-Computer Interaction · Computer Science 2024-07-10 Yang Liu , Kayla-Jade Butkow , Jake Stuchbury-Wass , Adam Pullin , Dong Ma , Cecilia Mascolo

Maintaining thermal comfort in shared indoor environments remains challenging, as centralized HVAC systems are slow to adapt and standardized to group norms. Cold exposure not only reduces subjective comfort but can impair cognitive…

Human-Computer Interaction · Computer Science 2025-06-04 Valeria Zitz , Michael Küttner , Jonas Hummel , Michael T. Knierim , Michael Beigl , Tobias Röddiger

The use of cloud services that process privacy-sensitive information such as digital banking, pervasive healthcare, smart home applications requires an implicit continuous authentication solution which will make these systems less…

Human-Computer Interaction · Computer Science 2020-03-25 Deniz Ekiz , Yekta Said Can , Yagmur Ceren Dardagan , Cem Ersoy

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiological signals but lack…

Machine Learning · Computer Science 2026-01-21 Yuanyun Zhang , Han Zhou , Li Feng , Yilin Hong , Shi Li

We experience the world through multiple senses that work together to create a cohesive perception, whether in daily life or immersive technologies. Understanding this multisensory integration (MSI) requires examining the interactions…

Human-Computer Interaction · Computer Science 2025-07-25 Andrew Jeyathasan , Swati Banerjee

The combination of increased life expectancy and falling birth rates is resulting in an aging population. Wearable Sensor-based Human Activity Recognition (WSHAR) emerges as a promising assistive technology to support the daily lives of…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Jianyuan Ni , Hao Tang , Syed Tousiful Haque , Yan Yan , Anne H. H. Ngu

Continuous health monitoring using wireless body area networks (WBANs) of wearable, epidermal and implantable medical devices is envisioned as a transformative approach to healthcare. Rapid advances in biomedical sensors, low-power…

Signal Processing · Electrical Eng. & Systems 2018-10-02 Nadeen Rishani , Hadeel Elayan , Raed Shubair , Asimina Kiourti

Self-supervised learning is crucial for clinical imaging applications, given the lack of explicit labels in healthcare. However, conventional approaches that rely on precise vision-language alignment are not always feasible in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jielin Qiu , Peide Huang , Makiya Nakashima , Jaehyun Lee , Jiacheng Zhu , Wilson Tang , Pohao Chen , Christopher Nguyen , Byung-Hak Kim , Debbie Kwon , Douglas Weber , Ding Zhao , David Chen

Human-robot collaboration (HRC) is a key focus of Industry 5.0, aiming to enhance worker productivity while ensuring well-being. The ability to perceive human psycho-physical states, such as stress and cognitive load, is crucial for…