English
Related papers

Related papers: Foundation Model Hidden Representations for Heart …

200 papers

Architectural improvements are studied for convolutional network performing estimation of heart rate (HR) values on color signal patches. Color signals are time series of color components averaged over facial regions recorded by webcams in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Mikhail Kopeliovich , Yuriy Mironenko , Mikhail Petrushan

The goal of our research is to automatically retrieve the satisfaction and the frustration in real-life call-center conversations. This study focuses an industrial application in which the customer satisfaction is continuously tracked down…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Manon Macary , Marie Tahon , Yannick Estève , Daniel Luzzati

Approximately 10\% of newborns require assistance to initiate breathing at birth, and around 5\% need ventilation support. Fetal heart rate (FHR) monitoring plays a crucial role in assessing fetal well-being during prenatal care, enabling…

Machine Learning · Computer Science 2025-09-26 Kjersti Engan , Neel Kanwal , Anita Yeconia , Ladislaus Blacy , Yuda Munyaw , Estomih Mduma , Hege Ersdal

Speech foundation models (SFMs) have achieved state-of-the-art results for various speech tasks in supervised (e.g. Whisper) or self-supervised systems (e.g. WavLM). However, the performance of SFMs for child ASR has not been systematically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Ruchao Fan , Natarajan Balaji Shankar , Abeer Alwan

Heart rate estimation from electrocardiogram signals is very important for the early detection of cardiovascular diseases. However, due to large individual differences and varying electrocardiogram signal quality, there does not exist a…

Machine Learning · Computer Science 2019-03-27 Dongrui Wu , Feifei Liu , Chengyu Liu

Drawing inspiration from the hierarchical processing of the human auditory system, which transforms sound from low-level acoustic features to high-level semantic understanding, we introduce a novel coarse-to-fine audio reconstruction…

Sound · Computer Science 2024-05-30 Che Liu , Changde Du , Xiaoyu Chen , Huiguang He

Phonocardiogram (PCG) analysis is vital for cardiovascular disease diagnosis, yet the scarcity of labeled pathological data hinders the capability of AI systems. To bridge this, we introduce H-LDM, a Hierarchical Latent Diffusion Model for…

Machine Learning · Computer Science 2026-02-13 Chenyang Xu , Siming Li , Hao Wang

Articulatory acoustic inversion aims to reconstruct the complete geometry of the vocal tract from the speech signal. In this paper, we present a comparative study of several levels of phonetic segmentation accuracy, together with a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-13 Sofiane Azzouz , Pierre-André Vuissoz , Yves Laprie

Respiratory sound analysis is a crucial tool for screening asthma and other pulmonary pathologies, yet traditional auscultation remains subjective and experience-dependent. Our prior research established a CNN baseline using DenseNet201,…

Sound · Computer Science 2026-01-21 Theodore Aptekarev , Vladimir Sokolovsky , Gregory Furman

The automated classification of phonocardiogram (PCG) recordings represents a substantial advancement in cardiovascular diagnostics. This paper presents a systematic comparison of four distinct models for heart murmur detection: two…

While speech foundation models (SFMs) have demonstrated remarkable performance in audio-only tasks, their adaptation to multimodal scenarios remains underexplored. This work presents UASR-LLM, a novel framework that adapts frozen SFMs to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Jing-Xuan Zhang , Genshun Wan , Jin Li , Jianqing Gao , Duo Zhao , Zhen-Hua Ling

Cardiac Magnetic Resonance (CMR) imaging serves as the gold-standard for evaluating cardiac morphology and function. Typically, a multi-view CMR stack, covering short-axis (SA) and 2/3/4-chamber long-axis (LA) views, is acquired for a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Yundi Zhang , Chen Chen , Suprosanna Shit , Sophie Starck , Daniel Rueckert , Jiazhen Pan

The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Purvi Agrawal , Sriram Ganapathy

Introduction: Deep learning models for detecting episodes of atrial fibrillation (AF) using rhythm information in long-term, ambulatory ECG recordings have shown high performance. However, the rhythm-based approach does not take advantage…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Noam Ben-Moshe , Kenta Tsutsui , Shany Biton , Leif Sörnmo , Joachim A. Behar

The Spoken Language Understanding Evaluation (SLUE) suite of benchmark tasks was recently introduced to address the need for open resources and benchmarking of complex spoken language understanding (SLU) tasks, including both classification…

Audio-based classification techniques on body sounds have long been studied to aid in the diagnosis of respiratory diseases. While most research is centered on the use of cough as the main biomarker, other body sounds also have the…

Sound · Computer Science 2023-11-27 Tuan Truong , Matthias Lenga , Antoine Serrurier , Sadegh Mohammadi

Marmoset monkeys encode vital information in their calls and serve as a surrogate model for neuro-biologists to understand the evolutionary origins of human vocal communication. Traditionally analyzed with signal processing-based features,…

Sound · Computer Science 2024-07-25 Eklavya Sarkar , Mathew Magimai. -Doss

Electrocardiogram (ECG) analysis is crucial for diagnosing heart disease, but most self-supervised learning methods treat ECG as a generic time series, overlooking physiologic semantics and rhythm-level structure. Existing contrastive…

Machine Learning · Computer Science 2026-02-27 Xin Wang , Burcu Ozek , Aruna Mohan , Amirhossein Ravari , Or Zilbershot , Fatemeh Afghah

[This paper was initially published in PHME conference in 2016, selected for further publication in International Journal of Prognostics and Health Management.] This paper describes an Autoregressive Partially-hidden Markov model (ARPHMM)…

Machine Learning · Statistics 2021-05-04 Pablo Juesas , Emmanuel Ramasso , Sébastien Drujont , Vincent Placet

Malignant ventricular arrhythmias (VT/VF) following acute myocardial infarction (AMI) are a major cause of in-hospital death, yet early identification remains a clinical challenge. While traditional risk scores have limited performance,…

Artificial Intelligence · Computer Science 2025-10-21 Shun Huang , Wenlu Xing , Shijia Geng , Hailong Wang , Guangkun Nie , Gongzheng Tang , Chenyang He , Shenda Hong