English
Related papers

Related papers: A Pyramid Recurrent Network for Predicting Crowdso…

200 papers

Objective evaluation of audio processed with Time-Scale Modification (TSM) is seeing a resurgence of interest. Recently, a labelled time-scaled audio dataset was used to train an objective measure for TSM evaluation. This DE measure was an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-09 Timothy Roberts , Aaron Nicolson , Kuldip K. Paliwal

Software qualities such as usability or reliability are among the strongest determinants of mobile app user satisfaction and constitute a significant portion of online user feedback on software products, making it a valuable source of…

Software Engineering · Computer Science 2025-06-16 Eduard C. Groen , Fabiano Dalpiaz , Martijn van Vliet , Boris Winter , Joerg Doerr , Sjaak Brinkkemper

This paper introduces BWSNet, a model that can be trained from raw human judgements obtained through a Best-Worst scaling (BWS) experiment. It maps sound samples into an embedded space that represents the perception of a studied attribute.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-23 Clément Le Moine Veillon , Victor Rosi , Pablo Arias Sarah , Léane Salais , Nicolas Obin

Time Scale Modification (TSM) is a well-researched field; however, no effective objective measure of quality exists. This paper details the creation, subjective evaluation, and analysis of a dataset for use in the development of an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-17 Timothy Roberts , Kuldip K. Paliwal

Objective evaluation of audio processed with Time-Scale Modification (TSM) remains an open problem. Recently, a dataset of time-scaled audio with subjective quality labels was published and used to create an initial objective measure of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-07 Timothy Roberts , Kuldip K. Paliwal

The perceptual task of speech quality assessment (SQA) is a challenging task for machines to do. Objective SQA methods that rely on the availability of the corresponding clean reference have been the primary go-to approaches for SQA.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Pranay Manocha , Buye Xu , Anurag Kumar

The prominence of a spoken word is the degree to which an average native listener perceives the word as salient or emphasized relative to its context. Speech prominence estimation is the process of assigning a numeric value to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-27 Max Morrison , Pranav Pawar , Nathan Pruyne , Jennifer Cole , Bryan Pardo

Scientist learn early on how to cite scientific sources to support their claims. Sometimes, however, scientists have challenges determining where a citation should be situated -- or, even worse, fail to cite a source altogether.…

Computation and Language · Computer Science 2024-05-21 Tong Zeng , Daniel E. Acuna

Long short-term memory (LSTM) based acoustic modeling methods have recently been shown to give state-of-the-art performance on some speech recognition tasks. To achieve a further performance improvement, in this research, deep extensions on…

Computation and Language · Computer Science 2015-05-12 Xiangang Li , Xihong Wu

Crowdsourcing is a relatively economic and efficient solution to collect annotations from the crowd through online platforms. Answers collected from workers with different expertise may be noisy and unreliable, and the quality of annotated…

Machine Learning · Computer Science 2020-01-08 Jingzheng Tu , Guoxian Yu , Jun Wang , Carlotta Domeniconi , Xiangliang Zhang

Subjective evaluations are critical for assessing the perceptual realism of sounds in audio-synthesis driven technologies like augmented and virtual reality. However, they are challenging to set up, fatiguing for users, and expensive. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Pranay Manocha , Anurag Kumar , Buye Xu , Anjali Menon , Israel D. Gebru , Vamsi K. Ithapu , Paul Calamia

While human evaluation is the most reliable metric for evaluating speech generation systems, it is generally costly and time-consuming. Previous studies on automatic speech quality assessment address the problem by predicting human…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-12 Soumi Maiti , Yifan Peng , Takaaki Saeki , Shinji Watanabe

The growing prevalence of counterfeit stories on the internet has fostered significant interest towards fast and scalable detection of fake news in the machine learning community. While several machine learning techniques for this purpose…

Computation and Language · Computer Science 2022-05-19 Aftab Hussain , Sai Durga Prasad Nanduri , Sneha Seenuvasavarathan

This paper studies the quality of multimedia content focusing on 360 video and ambisonic spatial audio reproduced using a head-mounted display and a multichannel loudspeaker setup. Encoding parameters following basic video quality test…

Multimedia · Computer Science 2020-05-20 Randy Frans Fela , Nick Zacharov , Søren Forchhammer

The quality of human voice plays an important role across various fields like music, speech therapy, and communication, yet it lacks a universally accepted, objective definition. Instead, voice quality is referred to using subjective…

Sound · Computer Science 2024-10-15 Hira Dhamyal , Rita Singh

We propose an end-to-end deep learning architecture for word-level visual speech recognition. The system is a combination of spatiotemporal convolutional, residual and bidirectional Long Short-Term Memory networks. We train and evaluate it…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Themos Stafylakis , Georgios Tzimiropoulos

An effective approach to automatically predict the subjective rating for synthetic speech is to train on a listening test dataset with human-annotated scores. Although each speech sample in the dataset is rated by several listeners, most…

Sound · Computer Science 2021-10-19 Wen-Chin Huang , Erica Cooper , Junichi Yamagishi , Tomoki Toda

This paper explores a novel perspective to speech quality assessment by leveraging natural language descriptions, offering richer, more nuanced insights than traditional numerical scoring methods. Natural language feedback provides…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Siyin Wang , Wenyi Yu , Xianzhao Chen , Xiaohai Tian , Jun Zhang , Lu Lu , Yu Tsao , Junichi Yamagishi , Yuxuan Wang , Chao Zhang

Large Language Models (LLMs) can generate text by transferring style attributes like formality resulting in formal or informal text. However, instructing LLMs to generate text that when spoken, is more intelligible in an acoustically…

Computation and Language · Computer Science 2024-08-09 Anupama Chingacham , Miaoran Zhang , Vera Demberg , Dietrich Klakow

We present the third edition of the VoiceMOS Challenge, a scientific initiative designed to advance research into automatic prediction of human speech ratings. There were three tracks. The first track was on predicting the quality of…