Multimedia · Computer Science
Impact of the Number of Votes on the Reliability and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach
Babak Naderi, Tobias Hossfeld, Matthias Hirth, Florian Metzger +2
2020-10-01
Computer Vision and Pattern Recognition · Computer Science
Beyond Top Activations: Efficient and Reliable Crowdsourced Evaluation of Automated Interpretability
Tuomas Oikarinen, Ge Yan, Akshay Kulkarni, Tsui-Wei Weng
2025-12-04
Audio and Speech Processing · Electrical Eng. & Systems
Crowdsourcing MUSHRA Tests in the Age of Generative Speech Technologies: A Comparative Analysis of Subjective and Objective Testing Methods
Laura Lechler, Chamran Moradi, Ivana Balic
2025-06-03
Audio and Speech Processing · Electrical Eng. & Systems
P.808 Multilingual Speech Enhancement Testing: Approach and Results of URGENT 2025 Challenge
Marvin Sach, Yihui Fu, Kohei Saijo, Wangyou Zhang +8
2025-07-28
Audio and Speech Processing · Electrical Eng. & Systems
Comparison of remote experiments using crowdsourcing and laboratory experiments on speech intelligibility
Ayako Yamamoto, Toshio Irino, Kenichi Arai, Shoko Araki +3
2022-03-30
Human-Computer Interaction · Computer Science
Factors in Crowdsourcing for Evaluation of Complex Dialogue Systems
Annalena Aicher, Stefan Hillmann, Isabel Feustel, Thilo Michael +2
2024-11-19
Audio and Speech Processing · Electrical Eng. & Systems
Crowdsourcing approach for subjective evaluation of echo impairment
Ross Cutler, Babak Naderi, Markus Loide, Sten Sootla +1
2022-03-01
Computation and Language · Computer Science
Common Voice: A Massively-Multilingual Speech Corpus
Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty +6
2020-03-09
Audio and Speech Processing · Electrical Eng. & Systems
Multilingual Source Tracing of Speech Deepfakes: A First Benchmark
Xi Xuan, Yang Xiao, Rohan Kumar Das, Tomi Kinnunen
2025-08-07
Computation and Language · Computer Science
Google Crowdsourced Speech Corpora and Related Open-Source Resources for Low-Resource Languages and Dialects: An Overview
Alena Butryna, Shan-Hui Cathy Chu, Isin Demirsahin, Alexander Gutkin +17
2020-10-15
Audio and Speech Processing · Electrical Eng. & Systems
Crowdsourced and Automatic Speech Prominence Estimation
Max Morrison, Pranav Pawar, Nathan Pruyne, Jennifer Cole +1
2023-12-27
Computation and Language · Computer Science
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
Nikita Nangia, Saku Sugawara, Harsh Trivedi, Alex Warstadt +2
2021-06-03
Computation and Language · Computer Science
MUSCAT: MUltilingual, SCientific ConversATion Benchmark
Supriti Sinhamahapatra, Thai-Binh Nguyen, Yiğit Oğuz, Enes Ugan +2
2026-05-19
Audio and Speech Processing · Electrical Eng. & Systems
MAD Speech: Measures of Acoustic Diversity of Speech
Matthieu Futeral, Andrea Agostinelli, Marco Tagliasacchi, Neil Zeghidour +1
2025-03-12