English
Related papers

Related papers: FluentNet: End-to-End Detection of Speech Disfluen…

200 papers

Specially adapted speech recognition models are necessary to handle stuttered speech. For these to be used in a targeted manner, stuttered speech must be reliably detected. Recent works have treated stuttering as a multi-class…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Sebastian P. Bayerl , Dominik Wagner , Florian Hönig , Tobias Bocklet , Elmar Nöth , Korbinian Riedhammer

Stuttering affects approximately 1% of the global population, impacting communication and quality of life. While recent advances in deep learning have pushed the boundaries of automatic speech dysfluency detection, rule-based approaches…

Artificial Intelligence · Computer Science 2025-08-26 Eric Zhang

Dysfluencies and variations in speech pronunciation can severely degrade speech recognition performance, and for many individuals with moderate-to-severe speech disorders, voice operated systems do not work. Current speech recognition…

Stuttering is a neuro-developmental speech impairment characterized by uncontrolled utterances (interjections) and core behaviors (blocks, repetitions, and prolongations), and is caused by the failure of speech sensorimotors. Due to its…

Sound · Computer Science 2023-02-23 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Spoken language translation applications for speech suffer due to conversational speech phenomena, particularly the presence of disfluencies. With the rise of end-to-end speech translation models, processing steps such as disfluency removal…

Computation and Language · Computer Science 2019-06-04 Elizabeth Salesky , Matthias Sperber , Alex Waibel

Automatic transcription of stuttered speech remains a challenge, even for modern end-to-end (E2E) automatic speech recognition (ASR) frameworks. Dysfluencies and fluency-shaping artifacts are often overlooked, resulting in non-verbatim…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-03 Kashaf Gulzar , Dominik Wagner , Sebastian P. Bayerl , Florian Hönig , Tobias Bocklet , Korbinian Riedhammer

In modern interactive speech-based systems, speech is consumed and transcribed incrementally prior to having disfluencies removed. This post-processing step is crucial for producing clean transcripts and high performance on downstream tasks…

Computation and Language · Computer Science 2022-05-03 Angelica Chen , Vicky Zayats , Daniel D. Walker , Dirk Padfield

Disfluency detection has mainly been solved in a pipeline approach, as post-processing of speech recognition. In this study, we propose Transformer-based encoder-decoder models that jointly solve speech recognition and disfluency detection,…

Computation and Language · Computer Science 2023-05-12 Hayato Futami , Emiru Tsunoo , Kentaro Shibata , Yosuke Kashiwagi , Takao Okuda , Siddhant Arora , Shinji Watanabe

Automatic detection of speech dysfluency aids speech-language pathologists in efficient transcription of disordered speech, enhancing diagnostics and treatment planning. Traditional methods, often limited to classification, provide…

While Speech Large Language Models (Speech-LLMs) show strong performance in many applications, their robustness is critically under-tested, especially to speech disfluency. Existing evaluations often rely on idealized inputs, overlooking…

Computation and Language · Computer Science 2025-10-20 Hongcheng Liu , Yixuan Hou , Heyang Liu , Yuhao Wang , Yanfeng Wang , Yu Wang

The ability to automatically detect stuttering events in speech could help speech pathologists track an individual's fluency over time or help improve speech recognition systems for people with atypical speech patterns. Despite increasing…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-25 Colin Lea , Vikramjit Mitra , Aparna Joshi , Sachin Kajarekar , Jeffrey P. Bigham

We introduce a new approach for disfluency detection using a Bidirectional Long-Short Term Memory neural network (BLSTM). In addition to the word sequence, the model takes as input pattern match features that were developed to reduce…

Computation and Language · Computer Science 2016-04-13 Vicky Zayats , Mari Ostendorf , Hannaneh Hajishirzi

Stuttered and dysfluent speech detection systems have traditionally suffered from the trade-off between accuracy and clinical interpretability. While end-to-end deep learning models achieve high performance, their black-box nature limits…

Sound · Computer Science 2025-09-19 Eric Zhang , Li Wei , Sarah Chen , Michael Wang

Speech dysfluency modeling is a task to detect dysfluencies in speech, such as repetition, block, insertion, replacement, and deletion. Most recent advancements treat this problem as a time-based object detection problem. In this work, we…

This paper presents a new approach for classification of dysfluent and fluent speech using Mel-Frequency Cepstral Coefficient (MFCC). The speech is fluent when person's speech flows easily and smoothly. Sounds combine into syllable,…

Sound · Computer Science 2013-01-10 P. Mahesha , D. S. Vinod

Dysfluent speech modeling requires time-accurate and silence-aware transcription at both the word-level and phonetic-level. However, current research in dysfluency modeling primarily focuses on either transcription or detection, and the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-21 Jiachen Lian , Carly Feng , Naasir Farooqi , Steve Li , Anshul Kashyap , Cheol Jun Cho , Peter Wu , Robbie Netzorg , Tingle Li , Gopala Krishna Anumanchipalli

Automatic Speech Recognition (ASR) transcripts often contain disfluencies, such as fillers, repetitions, and false starts, which reduce readability and hinder downstream applications like chatbots and voice assistants. If left unaddressed,…

Computation and Language · Computer Science 2026-05-13 Deepak Kumar , Baban Gain , Asif Ekbal

Speech disfluency modeling is the bottleneck for both speech therapy and language learning. However, there is no effective AI solution to systematically tackle this problem. We solidify the concept of disfluent speech and disfluent speech…

Computation and Language · Computer Science 2024-01-23 Jiachen Lian , Gopala Anumanchipalli

Recent advances in dysfluency detection have introduced a variety of modeling paradigms, ranging from lightweight object-detection inspired networks (YOLOStutter) to modular interpretable frameworks (UDM). While performance on benchmark…

Artificial Intelligence · Computer Science 2025-09-03 Eric Zhang , Li Wei , Sarah Chen , Michael Wang

Speech dysfluency detection is crucial for clinical diagnosis and language assessment, but existing methods are limited by the scarcity of high-quality annotated data. Although recent advances in TTS model have enabled synthetic dysfluency…