English
Related papers

Related papers: Patient Domain Supervised Contrastive Learning for…

200 papers

The increasing prevalence of microphones in everyday devices and the growing reliance on online services have amplified the risk of acoustic side-channel attacks (ASCAs) targeting keyboards. This study explores deep learning techniques,…

Machine Learning · Computer Science 2025-02-20 Jin Hyun Park , Seyyed Ali Ayati , Yichen Cai

Speech Sound Disorders (SSD) affect roughly five percent of children, yet speech-language pathologists face severe staffing shortages and unmanageable caseloads. We test a hierarchical approach to SSD classification on the granular…

Computation and Language · Computer Science 2026-04-30 Darren Fürst , Sebastian Steindl , Ulrich Schäfer

In this work, a novel deep neural network, designed to enhance the efficiency and effectiveness of unsupervised sound anomaly detection, is presented. The proposed model exploits an attention module and separable convolutions to identify…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Michael Neri , Marco Carli

Recent advancements in audio-aware large language models (ALLMs) enable them to process and understand audio inputs. However, these models often hallucinate non-existent sound events, reducing their reliability in real-world applications.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-02 Chun-Yi Kuan , Hung-yi Lee

Anomalous sound detection for machine condition monitoring has great potential in the development of Industry 4.0. However, these anomalous sounds of machines are usually unavailable in normal conditions. Therefore, the models employed have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-17 Jisheng Bai , Jianfeng Chen , Mou Wang , Muhammad Saad Ayub , Qingli Yan

Contrastive learning has been proved to be a promising technique for image-level representation learning from unlabeled data. Many existing works have demonstrated improved results by applying contrastive learning in classification and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-20 Dewen Zeng , John N. Kheir , Peng Zeng , Yiyu Shi

Cardiac auscultation is the most practiced non-invasive and cost-effective procedure for the early diagnosis of heart diseases. While machine learning based systems can aid in automatically screening patients, the robustness of these…

Signal Processing · Electrical Eng. & Systems 2020-10-05 Ahmed Imtiaz Humayun , Shabnam Ghaffarzadegan , Md. Istiaq Ansari , Zhe Feng , Taufiq Hasan

Large Audio-Language Models (LALMs) have demonstrated remarkable performance in end-to-end speaker diarization and recognition. However, their speaker discriminability remains limited due to the scarcity of large-scale conversational data…

Dilated convolution with learnable spacings (DCLS) is a recent convolution method in which the positions of the kernel elements are learned throughout training by backpropagation. Its interest has recently been demonstrated in computer…

Sound · Computer Science 2023-11-23 Ismail Khalfaoui-Hassani , Timothée Masquelier , Thomas Pellegrini

Auscultation for neonates is a simple and non-invasive method of providing diagnosis for cardiovascular and respiratory disease. Such diagnosis often requires high-quality heart and lung sounds to be captured during auscultation. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-27 Yang Yi Poh , Ethan Grooby , Kenneth Tan , Lindsay Zhou , Arrabella King , Ashwin Ramanathan , Atul Malhotra , Mehrtash Harandi , Faezeh Marzbanrad

Audio DNNs have demonstrated impressive performance on various machine listening tasks; however, most of their representations are computationally costly and uninterpretable, leaving room for optimization. Here, we propose a novel approach…

Sound · Computer Science 2025-08-20 Andrew Chang , Yike Li , Iran R. Roman , David Poeppel

Contrastive Language-Audio Pretraining (CLAP) models have demonstrated unprecedented performance in various acoustic signal recognition tasks. Fiber-optic-based acoustic recognition is one of the most important downstream tasks and plays a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-20 Jingchen Sun , Shaobo Han , Wataru Kohno , Changyou Chen

This paper presents a systematic literature review of published studies on AI-based automated speech therapy tools for persons with speech sound disorders (SSD). The COVID-19 pandemic has initiated the requirement for automated speech…

Human-Computer Interaction · Computer Science 2024-04-22 Chinmoy Deka , Abhishek Shrivastava , Ajish K. Abraham , Saurabh Nautiyal , Praveen Chauhan

The use of spatial information with multiple microphones can improve far-field automatic speech recognition (ASR) accuracy. However, conventional microphone array techniques degrade speech enhancement performance when there is an array…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-23 Kenichi Kumatani , Minhua Wu , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

Phonocardiogram (PCG) analysis is vital for cardiovascular disease diagnosis, yet the scarcity of labeled pathological data hinders the capability of AI systems. To bridge this, we introduce H-LDM, a Hierarchical Latent Diffusion Model for…

Machine Learning · Computer Science 2026-02-13 Chenyang Xu , Siming Li , Hao Wang

Researchers have been battling with the question of how we can identify Coronavirus disease (COVID-19) cases efficiently, affordably and at scale. Recent work has shown how audio based approaches, which collect respiratory audio data…

Lung cancer remains among the deadliest types of cancer in recent decades, and early lung nodule detection is crucial for improving patient outcomes. The limited availability of annotated medical imaging data remains a bottleneck in…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Muniba Noreen , Furqan Shaukat

Multimodal respiratory sound classification offers promise for early pulmonary disease detection by integrating bioacoustic signals with patient metadata. Nevertheless, current approaches remain vulnerable to spurious correlations from…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-28 Heejoon Koo , Miika Toikkanen , Yoon Tae Kim , Soo Yong Kim , June-Woo Kim

Deep learning techniques have shown promising results in the automatic classification of respiratory sounds. However, accurately distinguishing these sounds in real-world noisy conditions remains challenging for clinical deployment. In…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Jing-Tong Tzeng , Jeng-Lin Li , Huan-Yu Chen , Chun-Hsiang Huang , Chi-Hsin Chen , Cheng-Yi Fan , Edward Pei-Chuan Huang , Chi-Chun Lee

Reasoning about spatial audio with large language models requires a spatial audio encoder as an acoustic front-end to obtain audio embeddings for further processing. Such an encoder needs to capture all information required to detect the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Kevin Wilkinghoff , Zheng-Hua Tan