English
Related papers

Related papers: FluentNet: End-to-End Detection of Speech Disfluen…

200 papers

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

Most stuttering detection and classification research has viewed stuttering as a multi-class classification problem or a binary detection task for each dysfluency type; however, this does not match the nature of stuttering, in which one…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Sebastian P. Bayerl , Dominik Wagner , Ilja Baumann , Florian Hönig , Tobias Bocklet , Elmar Nöth , Korbinian Riedhammer

Speech disfluency commonly occurs in conversational and spontaneous speech. However, standard Automatic Speech Recognition (ASR) models struggle to accurately recognize these disfluencies because they are typically trained on fluent…

Computation and Language · Computer Science 2024-09-18 Robin Amann , Zhaolin Li , Barbara Bruno , Jan Niehues

Lipreading is the task of decoding text from the movement of a speaker's mouth. Traditional approaches separated the problem into two stages: designing or learning visual features, and prediction. More recent deep lipreading approaches are…

Machine Learning · Computer Science 2016-12-19 Yannis M. Assael , Brendan Shillingford , Shimon Whiteson , Nando de Freitas

Current disfluency detection models focus on individual utterances each from a single speaker. However, numerous discontinuity phenomena in spoken conversational transcripts occur across multiple turns, hampering human readability and the…

Computation and Language · Computer Science 2023-10-30 Hua Shen , Vicky Zayats , Johann C. Rocholl , Daniel D. Walker , Dirk Padfield

Disfluent speech has been previously addressed from two main perspectives: the clinical perspective focusing on diagnostic, and the Natural Language Processing (NLP) perspective aiming at modeling these events and detect them for downstream…

Computation and Language · Computer Science 2020-03-03 Rachid Riad , Anne-Catherine Bachoud-Lévi , Frank Rudzicz , Emmanuel Dupoux

Stuttering is a complex speech disorder that negatively affects an individual's ability to communicate effectively. Persons who stutter (PWS) often suffer considerably under the condition and seek help through therapy. Fluency shaping is a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Sebastian P. Bayerl , Alexander Wolff von Gudenberg , Florian Hönig , Elmar Nöth , Korbinian Riedhammer

Accurate detection of disfluencies in spoken language is crucial for enhancing the performance of automatic speech and language processing systems, as well as fostering the development of more inclusive speech and language technologies.…

Sound · Computer Science 2025-06-24 Duygu Altinok

The SOTA in transcription of disfluent and conversational speech has in recent years favored two-stage models, with separate transcription and cleaning stages. We believe that previous attempts at end-to-end disfluency removal have fallen…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-12 Saksham Bassi , Giulio Duregon , Siddhartha Jalagam , David Roth

Disfluency detection is a critical task in real-time dialogue systems. However, despite its importance, it remains a relatively unexplored field, mainly due to the lack of appropriate datasets. At the same time, existing datasets suffer…

Computation and Language · Computer Science 2022-05-04 T. Passali , T. Mavropoulos , G. Tsoumakas , G. Meditskos , S. Vrochidis

Speech fluency/disfluency can be evaluated by analyzing a range of phonetic and prosodic features. Deep neural networks are commonly trained to map fluency-related features into the human scores. However, the effectiveness of deep…

Computation and Language · Computer Science 2023-05-22 Kaiqi Fu , Shaojun Gao , Shuju Shi , Xiaohai Tian , Wei Li , Zejun Ma

Clinical diagnosis of stuttering requires an assessment by a licensed speech-language pathologist. However, this process is time-consuming and requires clinicians with training and experience in stuttering and fluency disorders.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Yi-Jen Shih , Zoi Gkalitsiou , Alexandros G. Dimakis , David Harwath

Eye movements have been widely investigated to study the atypical visual attention in Autism Spectrum Disorder (ASD). The majority of these studies have been focused on limited eye movement features by statistical comparisons between ASD…

Image and Video Processing · Electrical Eng. & Systems 2019-11-27 Jin Xie , Longfei Wang , Paula Webster , Yang Yao , Jiayao Sun , Shuo Wang , Huihui Zhou

The detection of perceived prominence in speech has attracted approaches ranging from the design of linguistic knowledge-based acoustic features to the automatic feature learning from suprasegmental attributes such as pitch and intensity…

Computation and Language · Computer Science 2021-10-28 Mithilesh Vaidya , Kamini Sabu , Preeti Rao

Current disfluency detection methods heavily rely on costly and scarce human-annotated data. To tackle this issue, some approaches employ heuristic or statistical features to generate disfluent sentences, partially improving detection…

Computation and Language · Computer Science 2024-08-07 Zhenrong Cheng , Jiayan Guo , Hao Sun , Yan Zhang

Stuttering is a complex disorder that requires specialized expertise for effective assessment and treatment. This paper presents an effort to enhance the FluencyBank dataset with a new stuttering annotation scheme based on established…

In recent years, there has been a great deal of research in developing end-to-end speech recognition models, which enable simplifying the traditional pipeline and achieving promising results. Despite their remarkable performance…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-20 Ji Won Yoon , Hyeonseung Lee , Hyung Yong Kim , Won Ik Cho , Nam Soo Kim

Speech dysfluency modeling is the core module for spoken language learning, and speech therapy. However, there are three challenges. First, current state-of-the-art solutions\cite{lian2023unconstrained-udm,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-07 Jiachen Lian , Xuanru Zhou , Zoe Ezzes , Jet Vonk , Brittany Morin , David Baquirin , Zachary Mille , Maria Luisa Gorno Tempini , Gopala Krishna Anumanchipalli

People who stutter (PWS) face systemic exclusion in today's voice-driven society, where access to voice assistants, authentication systems, and remote work tools increasingly depends on fluent speech. Current automatic speech recognition…

Computers and Society · Computer Science 2026-01-16 Ziqi Xu , Yi Liu , Yuekang Li , Ling Shi , Kailong Wang , Yongxin Zhao

The so-called Mild Cognitive Impairment (MCI) or cognitive loss appears in a previous stage before Alzheimer's Disease (AD), but it does not seem sufficiently severe to interfere in independent abilities of daily life, so it usually does…