English
Related papers

Related papers: Disability-First AI Dataset Annotation: Co-designi…

200 papers

Audio-visual learning seeks to enhance the computer's multi-modal perception leveraging the correlation between the auditory and visual modalities. Despite their many useful downstream tasks, such as video retrieval, AR/VR, and…

Human-Computer Interaction · Computer Science 2023-07-31 Zheng Zhang , Zheng Ning , Chenliang Xu , Yapeng Tian , Toby Jia-Jun Li

Research into the detection of human activities from wearable sensors is a highly active field, benefiting numerous applications, from ambulatory monitoring of healthcare patients via fitness coaching to streamlining manual work processes.…

Human-Computer Interaction · Computer Science 2024-07-12 Alexander Hoelzemann , Kristof Van Laerhoven

To ensure that AI-infused systems work for disabled people, we need to bring accessibility datasets sourced from this community in the development lifecycle. However, there are many ethical and privacy concerns limiting greater data…

Computers and Society · Computer Science 2023-03-10 Rie Kamikubo , Kyungjun Lee , Hernisa Kacorri

Suicidal ideation detection is critical for real-time suicide prevention, yet its progress faces two under-explored challenges: limited language coverage and unreliable annotation practices. Most available datasets are in English, but even…

Computation and Language · Computer Science 2025-07-22 Amina Dzafic , Merve Kavut , Ulya Bayram

Datasets sourced from people with disabilities and older adults play an important role in innovation, benchmarking, and mitigating bias for both assistive and inclusive AI-infused applications. However, they are scarce. We conduct a…

Human-Computer Interaction · Computer Science 2021-08-25 Rie Kamikubo , Utkarsh Dwivedi , Hernisa Kacorri

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

Incorporating every annotator's perspective is crucial for unbiased data modeling. Annotator fatigue and changing opinions over time can distort dataset annotations. To combat this, we propose to learn a more accurate representation of…

Machine Learning · Computer Science 2024-06-05 Uthman Jinadu , Yi Ding

Annotating speaker attributes from text is inherently ambiguous, particularly in multilingual settings where demographic and social cues are implicit and culturally variable. We propose a human-large language model (LLM) collaborative…

Computation and Language · Computer Science 2026-05-26 Lingyu Gao , Will Monroe , David Smith , Meghan Jemison , Jackie Lee

While supervised learning has achieved significant success in computer vision tasks, acquiring high-quality annotated data remains a bottleneck. This paper explores both scholarly and non-scholarly works in AI-assistive deep learning image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Moseli Mots'oehli

Stuttering is a speech disorder influencing over 70 million people worldwide, including 13 million in China. It causes low self-esteem among other detrimental effects on people who stutter (PwS). Although prior work has explored approaches…

Human-Computer Interaction · Computer Science 2023-02-22 Feng Li , Zeyu Xiong , Xinyi Li , Mingming Fan

Current research in machine learning and artificial intelligence is largely centered on modeling and performance evaluation, less so on data collection. However, recent research demonstrated that limitations and biases in data may…

Artificial Intelligence · Computer Science 2025-02-18 Eleonora Mancini , Ana Tanevska , Andrea Galassi , Alessio Galatolo , Federico Ruggeri , Paolo Torroni

Alzheimer's Disease (AD) is the world's leading neurodegenerative disease, which often results in communication difficulties. Analysing speech can serve as a diagnostic tool for identifying the condition. The recent ADReSS challenge…

Computation and Language · Computer Science 2024-07-24 Lucía Gómez-Zaragozá , Simone Wills , Cristian Tejedor-Garcia , Javier Marín-Morales , Mariano Alcañiz , Helmer Strik

Atypical speech is receiving greater attention in speech technology research, but much of this work unfolds with limited interdisciplinary dialogue. For stuttered speech in particular, it is widely recognised that current speech recognition…

Stuttering is a speech impediment affecting tens of millions of people on an everyday basis. Even with its commonality, there is minimal data and research on the identification and classification of stuttered speech. This paper tackles the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-29 Tedd Kourkounakis , Amirhossein Hajavi , Ali Etemad

Learning from crowds describes that the annotations of training data are obtained with crowd-sourcing services. Multiple annotators each complete their own small part of the annotations, where labeling mistakes that depend on annotators…

Human-Computer Interaction · Computer Science 2024-04-16 Shikun Li , Xiaobo Xia , Jiankang Deng , Shiming Ge , Tongliang Liu

Existing dialogue datasets contain lots of noise in their state annotations. Such noise can hurt model training and ultimately lead to poor generalization performance. A general framework named ASSIST has recently been proposed to train…

Computation and Language · Computer Science 2022-10-25 Fanghua Ye , Xi Wang , Jie Huang , Shenghui Li , Samuel Stern , Emine Yilmaz

Speech impairments caused by conditions such as cerebral palsy or genetic disorders pose significant challenges for automatic speech recognition (ASR) systems. Despite recent advances, ASR models like Whisper struggle with non-normative…

Computation and Language · Computer Science 2025-06-30 Niclas Pokel , Pehuén Moure , Roman Boehringer , Yingqiang Gao

Whisper fails to correctly transcribe dementia speech because persons with dementia (PwDs) often exhibit irregular speech patterns and disfluencies such as pauses, repetitions, and fragmented sentences. It was trained on standard speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-29 Emmanuel Akinrintoyo , Nadine Abdelhalim , Nicole Salomons

Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreement among raters. Annotations have commonly been aggregated…

Computation and Language · Computer Science 2024-05-17 Negar Mokhberian , Myrl G. Marmarelis , Frederic R. Hopp , Valerio Basile , Fred Morstatter , Kristina Lerman

Stuttering affects approximately 1% of the global population, impacting communication and quality of life. While recent advances in deep learning have pushed the boundaries of automatic speech dysfluency detection, rule-based approaches…

Artificial Intelligence · Computer Science 2025-08-26 Eric Zhang