English
Related papers

Related papers: Foundation Model Hidden Representations for Heart …

200 papers

Heart murmurs are a common manifestation of cardiovascular diseases and can provide crucial clues to early cardiac abnormalities. While most current research methods primarily focus on the accuracy of models, they often overlook other…

Sound · Computer Science 2024-05-08 Zixing Zhang , Tao Pang , Jing Han , Björn W. Schuller

Effectively steering hearable devices requires understanding the acoustic environment around the user. In the computational analysis of sound scenes, foundation models have emerged as the state of the art to produce high-performance,…

Cardiac auscultation is an essential point-of-care method used for the early diagnosis of heart diseases. Automatic analysis of heart sounds for abnormality detection is faced with the challenges of additive noise and sensor-dependent…

Sound · Computer Science 2021-06-04 Farhat Binte Azam , Md. Istiaq Ansari , Ian Mclane , Taufiq Hasan

Accurately interpreting cardiac auscultation signals plays a crucial role in diagnosing and managing cardiovascular diseases. However, the paucity of labelled data inhibits classification models' training. Researchers have turned to…

Sound · Computer Science 2025-06-18 Leigh Abbott , Milan Marocchi , Matthew Fynn , Yue Rong , Sven Nordholm

Heart rate (HR) is an important physiological signal that reflects the physical and emotional status of a person. Traditional HR measurements usually rely on contact monitors, which may cause inconvenience and discomfort. Recently, some…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Xuesong Niu , Shiguang Shan , Hu Han , Xilin Chen

Today, data collection has improved in various areas, and the medical domain is no exception. Auscultation, as an important diagnostic technique for physicians, due to the progress and availability of digital stethoscopes, lends itself well…

Vision-Language Foundation Models (VLFMs) exhibit remarkable generalization, yet their direct application to medical ultrasound is severely hindered by a profound modality gap. The unique acoustic physics of ultrasound, characterized by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingguo Qu , Xinyang Han , Jia Ai , Juan Wu , Tong Zhao , Tonghuan Xiao , Sheng Ning , Yuqi Yang , Jing Qin , Ann Dorothy King , Winnie Chiu-Wing Chu , Jing Cai , Michael Tin-Cheung Ying

Cardiovascular diseases (CVDs) represent significant global health challenges today, necessitating regular and reliable monitoring to enable early intervention. Phonocardiogram (PCG) signals present a promising non-invasive method for…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Abdul Ahad Mamun , Utsab Saha , Md Hasibul Hasan , Shahed Ahmed , MD Jahin Alam

Fundamental frequency is one of the most important characteristics of speech and audio signals. Harmonic model-based fundamental frequency estimators offer a higher estimation accuracy and robustness against noise than the widely used…

Heart sound auscultation holds significant importance in the diagnosis of congenital heart disease. However, existing methods for Heart Sound Diagnosis (HSD) tasks are predominantly limited to a few fixed categories, framing the HSD task as…

Sound · Computer Science 2024-08-19 Zihan Zhao , Pingjie Wang , Liudan Zhao , Yuchen Yang , Ya Zhang , Kun Sun , Xin Sun , Xin Zhou , Yu Wang , Yanfeng Wang

Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Leya Barrientos , Yuexi Du , Nicha C. Dvornek

Traditionally, abnormal heart sound classification is framed as a three-stage process. The first stage involves segmenting the phonocardiogram to detect fundamental heart sounds; after which features are extracted and classification is…

Foundation models have recently gained significant attention because of their generalizability and adaptability across multiple tasks and data distributions. Although medical foundation models have emerged, solutions for cardiac imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sekeun Kim , Pengfei Jin , Sifan Song , Cheng Chen , Yiwei Li , Hui Ren , Xiang Li , Tianming Liu , Quanzheng Li

Large language models (LLMs) for audio have excelled in recognizing and analyzing human speech, music, and environmental sounds. However, their potential for understanding other types of sounds, particularly biomedical sounds, remains…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-24 Adrian Florea , Xilin Jiang , Nima Mesgarani , Xiaofan Jiang

Accurate forward modelling is essential for non-invasive cardiac electrophysiology, particularly in atrial fibrillation, where electrical activation is highly disorganised. Conventional physics-based forward models require explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Shaheim Ogbomo-Harmitt , Cesare Magnetti , Jakub Grzelak , Oleg Aslanidi

Deriving multimodal representations of audio and lexical inputs is a central problem in Natural Language Understanding (NLU). In this paper, we present Contrastive Aligned Audio-Language Multirate and Multimodal Representations (CALM), an…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-09 Vin Sachidananda , Shao-Yen Tseng , Erik Marchi , Sachin Kajarekar , Panayiotis Georgiou

Electrocardiogram (ECG) is widely used in healthcare applications, such as arrhythmia detection and sleep monitoring, making accurate ECG analysis critically essential. Traditional deep learning models for ECG are task-specific, with…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Yu Han , Vittorio Murino , Xiaofeng Liu , Xiang Zhang , Cheng Ding

This paper presents a robust method to monitor heart rate (HR) from BCG (Ballistocardiography) signal, which is acquired from the sensor embedded in a chair or a mattress. The proposed algorithm addresses the shortfalls in traditional Fast…

Signal Processing · Electrical Eng. & Systems 2018-09-11 Qingsong Xie , Guoxing Wang , Yong Lian

Heart auscultations are a low-cost and effective way of detecting valvular heart diseases early, which can save lives. Nevertheless, it has been difficult to scale this screening method since the effectiveness of auscultations is dependent…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Ansh Mishra , Jia Qi Yip , Eng Siong Chng

Foundation models for echocardiography often struggle to disentangle anatomical signal from the stochastic speckle and acquisition artifacts inherent to ultrasound. We present EchoJEPA, a foundation model trained on 18 million…