English
Related papers

Related papers: URGENT-PK: Perceptually-Aligned Ranking Model Desi…

200 papers

The expectation to deploy a universal neural network for speech enhancement, with the aim of improving noise robustness across diverse speech processing tasks, faces challenges due to the existing lack of awareness within static speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-21 Yanan Chen , Zihao Cui , Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

A common problem in machine learning is to rank a set of n items based on pairwise comparisons. Here ranking refers to partitioning the items into sets of pre-specified sizes according to their scores, which includes identification of the…

Machine Learning · Computer Science 2018-01-08 Reinhard Heckel , Max Simchowitz , Kannan Ramchandran , Martin J. Wainwright

Selectional Preference (SP) is a commonly observed language phenomenon and proved to be useful in many natural language processing tasks. To provide a better evaluation method for SP models, we introduce SP-10K, a large-scale evaluation set…

Computation and Language · Computer Science 2019-06-06 Hongming Zhang , Hantian Ding , Yangqiu Song

Despite significant progress made in the last decade, deep neural network (DNN) based speech enhancement (SE) still faces the challenge of notable degradation in the quality of recovered speech under low signal-to-noise ratio (SNR)…

Sound · Computer Science 2024-08-20 Zhongshu Hou , Tong Lei , Qinwen Hu , Zhanzhong Cao , Ming Tang , Jing Lu

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left…

Computation and Language · Computer Science 2016-09-29 Shihao Ji , Hyokun Yun , Pinar Yanardag , Shin Matsushima , S. V. N. Vishwanathan

The Transformer architecture has demonstrated a superior ability compared to recurrent neural networks in many different natural language processing applications. Therefore, our study applies a modified Transformer in a speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Szu-Wei Fu , Chien-Feng Liao , Tsun-An Hsieh , Kuo-Hsuan Hung , Syu-Siang Wang , Cheng Yu , Heng-Cheng Kuo , Ryandhimas E. Zezario , You-Jin Li , Shang-Yi Chuang , Yen-Ju Lu , Yu Tsao

Prosody is essential for speech technology, shaping comprehension, naturalness, and expressiveness. However, current text-to-speech (TTS) systems still struggle to accurately capture human-like prosodic variation, in part because existing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-05 Cedric Chan , Jianjing Kuang

Neural machine translation systems estimate probabilities of target sentences given source sentences, yet these estimates may not align with human preferences. This work introduces QE-fusion, a method that synthesizes translations using a…

Computation and Language · Computer Science 2024-06-07 Giorgos Vernikos , Andrei Popescu-Belis

Ranking and comparing items is crucial for collecting information about preferences in many areas, from marketing to politics. The Mallows rank model is among the most successful approaches to analyse rank data, but its computational…

Methodology · Statistics 2017-04-28 Valeria Vitelli , Øystein Sørensen , Marta Crispino , Arnoldo Frigessi , Elja Arjas

Evaluating 'anime-like' voices currently relies on costly subjective judgments, yet no standardized objective metric exists. A key challenge is that anime-likeness, unlike naturalness, lacks a shared absolute scale, making conventional Mean…

Sound · Computer Science 2026-03-13 Joonyong Park , Jerry Li

Research in modeling subjective metrics for quality assessment has led to the development of no-reference speech models that directly operate on utterance waveforms to predict the Mean Opinion Score (MOS). These models often rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-29 Imran E Kibria , Donald S. Williamson

We present the first edition of the VoiceMOS Challenge, a scientific event that aims to promote the study of automatic prediction of the mean opinion score (MOS) of synthetic speech. This challenge drew 22 participating teams from academia…

Sound · Computer Science 2022-07-05 Wen-Chin Huang , Erica Cooper , Yu Tsao , Hsin-Min Wang , Tomoki Toda , Junichi Yamagishi

Intelligent personal assistant systems with either text-based or voice-based conversational interfaces are becoming increasingly popular around the world. Retrieval-based conversation models have the advantages of returning fluent and…

Information Retrieval · Computer Science 2018-05-10 Liu Yang , Minghui Qiu , Chen Qu , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Jun Huang , Haiqing Chen

We present MooseNet, a trainable speech metric that predicts the listeners' Mean Opinion Score (MOS). We propose a novel approach where the Probabilistic Linear Discriminative Analysis (PLDA) generative model is used on top of an embedding…

Computation and Language · Computer Science 2023-10-27 Ondřej Plátek , Ondřej Dušek

Audio signal processing algorithms are frequently assessed through subjective listening tests in which participants directly score degraded signals on a unidimensional numerical scale. However, this approach is susceptible to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Jack Webb , Lorenzo Picinali

Mean Opinion Score (MOS) prediction has made significant progress in specific domains. However, the unstable performance of MOS prediction models across diverse samples presents ongoing challenges in the practical application of these…

Machine Learning · Computer Science 2024-08-26 Hui Wang , Shiwan Zhao , Jiaming Zhou , Xiguang Zheng , Haoqin Sun , Xuechen Wang , Yong Qin

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Automatic Speech Scoring (ASS) is the computer-assisted evaluation of a candidate's speaking proficiency in a language. ASS systems face many challenges like open grammar, variable pronunciations, and unstructured or semi-structured…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Yaman Kumar Singla , Avykat Gupta , Shaurya Bagga , Changyou Chen , Balaji Krishnamurthy , Rajiv Ratn Shah

Inference-time alignment methods have gained significant attention for their efficiency and effectiveness in aligning large language models (LLMs) with human preferences. However, existing dominant approaches using reward-guided search…

Computation and Language · Computer Science 2025-07-01 Bin Xie , Bingbing Xu , Yige Yuan , Shengmao Zhu , Huawei Shen

Recent advances in deep neural networks, language modeling and language generation have introduced new ideas to the field of conversational agents. As a result, deep neural models such as sequence-to-sequence, Memory Networks, and the…

Computation and Language · Computer Science 2019-02-27 Momchil Hardalov , Ivan Koychev , Preslav Nakov