English
Related papers

Related papers: A Multi-modal Approach to Dysarthria Detection and…

200 papers

Osteoarthritis (OA) poses a global health challenge, demanding precise diagnostic methods. Current radiographic assessments are time consuming and prone to variability, prompting the need for automated solutions. The existing deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Banafshe Felfeliyan , Yuyue Zhou , Shrimanti Ghosh , Jessica Kupper , Shaobo Liu , Abhilash Hareendranathan , Jacob L. Jaremko

Autism Spectrum Disorder (ASD) is one neuro developmental disorder that is now widespread in the world. ASD persists throughout the life of an individual, impacting the way they behave and communicate, resulting to notable deficits…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Godfrin Ismail , Kenneth Chesoli , Golda Moni , Kinyua Gikunda

Previous data-driven work investigating the types and distributions of discourse relation signals, including discourse markers such as 'however' or phrases such as 'as a result' has focused on the relative frequencies of signal words within…

Computation and Language · Computer Science 2020-10-23 Amir Zeldes , Yang Liu

Dysarthric speech reconstruction (DSR) typically employs a cascaded system that combines automatic speech recognition (ASR) and sentence-level text-to-speech (TTS) to convert dysarthric speech into normally-prosodied speech. However,…

Sound · Computer Science 2026-03-03 Minghui Wu , Haitao Tang , Jiahuan Fan , Ruizhi Liao , Yanyong Zhang

Dyslexia, affecting an estimated 10% to 20% of the global population, significantly impairs learning capabilities, highlighting the need for innovative and accessible diagnostic methods. This paper investigates the effectiveness of…

Machine Learning · Computer Science 2025-06-16 Kevin Cogan , Vuong M. Ngo , Mark Roantree

Active speaker detection requires a solid integration of multi-modal cues. While individual modalities can approximate a solution, accurate predictions can only be achieved by explicitly fusing the audio and visual features and modeling…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Juan León-Alcázar , Fabian Caba Heilbron , Ali Thabet , Bernard Ghanem

The presence of abusive content on social media platforms is undesirable as it severely impedes healthy and safe social media interactions. While automatic abuse detection has been widely explored in textual domain, audio abuse detection…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Rini Sharon , Heet Shah , Debdoot Mukherjee , Vikram Gupta

Millions of people suffer from mental health conditions, yet many remain undiagnosed or receive delayed care due to limited clinical resources and labor-intensive assessment methods. While most machine-assisted approaches focus on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-06 Gowtham Premananth , Philip Resnik , Sonia Bansal , Deanna L. Kelly , Carol Espy-Wilson

Compared with automatic speech recognition (ASR), the human auditory system is more adept at handling noise-adverse situations, including environmental noise and channel distortion. To mimic this adeptness, auditory models have been widely…

Computation and Language · Computer Science 2016-09-16 Peng Dai , Xue Teng , Frank Rudzicz , Ing Yann Soon

State-of-the-art Active Speaker Detection (ASD) approaches heavily rely on audio and facial features to perform, which is not a sustainable approach in wild scenarios. Although these methods achieve good results in the standard…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Tiago Roxo , Joana C. Costa , Pedro R. M. Inácio , Hugo Proença

Recent progress has been made in detecting early stage dementia entirely through recordings of patient speech. Multimodal speech analysis methods were applied to the PROCESS challenge, which requires participants to use audio recordings of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-14 Lei Chi , Arav Sharma , Ari Gebhardt , Joseph T. Colonel

Depression commonly co-occurs with neurodegenerative disorders like Multiple Sclerosis (MS), yet the potential of speech-based Artificial Intelligence for detecting depression in such contexts remains unexplored. This study examines the…

Computation and Language · Computer Science 2025-08-26 Monica Gonzalez-Machorro , Uwe Reichel , Pascal Hecker , Helly Hammer , Hesam Sagha , Florian Eyben , Robert Hoepner , Björn W. Schuller

Dementia is a growing problem as our society ages, and detection methods are often invasive and expensive. Recent deep-learning techniques can offer a faster diagnosis and have shown promising results. However, they require large amounts of…

Computation and Language · Computer Science 2022-07-19 Anna Hlédiková , Dominika Woszczyk , Alican Akman , Soteris Demetriou , Björn Schuller

Understanding the relationship between tongue motion patterns during speech and their resulting speech acoustic outcomes -- i.e., articulatory-acoustic relation -- is of great importance in assessing speech quality and developing innovative…

Deep learning-based techniques for automatic dysarthric speech detection have recently attracted interest in the research community. State-of-the-art techniques typically learn neurotypical and dysarthric discriminative representations by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-04 Ina Kodrasi

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate…

This paper presents a novel evaluation approach to text-based speaker diarization (SD), tackling the limitations of traditional metrics that do not account for any contextual information in text. Two new metrics are proposed, Text-based…

Computation and Language · Computer Science 2023-09-15 Chen Gong , Peilin Wu , Jinho D. Choi

Speech pause is an effective biomarker in dementia detection. Recent deep learning models have exploited speech pauses to achieve highly accurate dementia detection, but have not exploited the interpretability of speech pauses, i.e., what…

Computation and Language · Computer Science 2021-11-16 Youxiang Zhu , Bang Tran , Xiaohui Liang , John A. Batsis , Robert M. Roth

This paper introduces a new dysarthric speech command dataset in Italian, called EasyCall corpus. The dataset consists of 21386 audio recordings from 24 healthy and 31 dysarthric speakers, whose individual degree of speech impairment was…