English
Related papers

Related papers: Confidence Estimation for Black Box Automatic Spee…

200 papers

As opaque decision systems are being increasingly adopted in almost any application field, issues about their lack of transparency and human readability are a concrete concern for end-users. Amongst existing proposals to associate…

Artificial Intelligence · Computer Science 2022-11-02 Federico Sabbatini , Roberta Calegari

Masked language modeling is a widely used method for learning language representations, where the model predicts a randomly masked word in each input. However, this approach typically considers only a single correct answer during training,…

Computation and Language · Computer Science 2025-04-10 Seunghyun Ji , Soowon Lee

Evidence plays a crucial role in automated fact-checking. When verifying real-world claims, existing fact-checking systems either assume the evidence sentences are given or use the search snippets returned by the search engine. Such methods…

Computation and Language · Computer Science 2024-01-30 Xuming Hu , Junzhe Chen , Zhijiang Guo , Philip S. Yu

The paper investigates the feasibility of confidence estimation for neural machine translation models operating at the high end of the performance spectrum. As a side product of the data annotation process necessary for building such models…

Computation and Language · Computer Science 2020-10-28 Ciprian Chelba , Junpei Zhou , Yuezhang , Li , Hideto Kazawa , Jeff Klingner , Mengmeng Niu

The perceptual task of speech quality assessment (SQA) is a challenging task for machines to do. Objective SQA methods that rely on the availability of the corresponding clean reference have been the primary go-to approaches for SQA.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Pranay Manocha , Buye Xu , Anurag Kumar

Recent advances in sequence modeling have highlighted the strengths of the transformer architecture, especially in achieving state-of-the-art machine translation results. However, depending on the up-stream systems, e.g., speech…

Computation and Language · Computer Science 2019-06-14 Pei Zhang , Boxing Chen , Niyu Ge , Kai Fan

Recent advancements in Automatic Piano Transcription (APT) have significantly improved system performance, but the impact of noisy environments on the system performance remains largely unexplored. This study investigates the impact of…

Sound · Computer Science 2024-10-21 Yonghyun Kim , Alexander Lerch

Voice technology has become ubiquitous recently. However, the accuracy, and hence experience, in different languages varies significantly, which makes the technology not equally inclusive. The availability of data for different languages is…

Computation and Language · Computer Science 2023-05-24 Jan Silovsky , Liuhui Deng , Arturo Argueta , Tresi Arvizo , Roger Hsiao , Sasha Kuznietsov , Yiu-Chang Lin , Xiaoqiang Xiao , Yuanyuan Zhang

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

Sound · Computer Science 2026-05-13 Adam Wynn , Jingyun Wang

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Existing deep learning based speech enhancement mainly employ a data-driven approach, which leverage large amounts of data with a variety of noise types to achieve noise removal from noisy signal. However, the high dependence on the data…

Sound · Computer Science 2024-01-24 Huaying Xue , Xiulian Peng , Yan Lu

The objective of active level set estimation for a black-box function is to precisely identify regions where the function values exceed or fall below a specified threshold by iteratively performing function evaluations to gather more…

Machine Learning · Computer Science 2024-10-10 Giang Ngo , Dang Nguyen , Sunil Gupta

A new language model for speech recognition inspired by linguistic analysis is presented. The model develops hidden hierarchical structure incrementally and uses it to extract meaningful information from the word history - thus enabling the…

Computation and Language · Computer Science 2007-05-23 Ciprian Chelba , Frederick Jelinek

Prediction systems are successfully deployed in applications ranging from disease diagnosis, to predicting credit worthiness, to image recognition. Even when the overall accuracy is high, these systems may exhibit systematic biases that…

Machine Learning · Computer Science 2018-08-30 Michael P. Kim , Amirata Ghorbani , James Zou

Transformers have had a profound impact on the field of artificial intelligence, especially on large language models and their variants. However, as was the case with neural networks, their black-box nature limits trust and deployment in…

Machine Learning · Computer Science 2026-04-13 Abhiram Vellore , Niraj K. Jha

Automatic classification of speech commands has revolutionized human computer interactions in robotic applications. However, employed recognition models usually follow the methodology of deep learning with complicated networks which are…

Confidence measure is a performance index of particular importance for automatic speech recognition (ASR) systems deployed in real-world scenarios. In the present study, utterance-level neural confidence measure (NCM) in end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Wei Liu , Tan Lee

With the increasing prevalence of recorded human speech, spoken language understanding (SLU) is essential for its efficient processing. In order to process the speech, it is commonly transcribed using automatic speech recognition…

Computation and Language · Computer Science 2025-02-20 Ori Shapira , Shlomo E. Chazan , Amir DN Cohen

In conventional supervised pattern recognition tasks, model selection is typically accomplished by minimizing the classification error rate on a set of so-called development data, subject to ground-truth labeling by human experts or some…

Machine Learning · Statistics 2011-08-25 Christopher M. White , Sanjeev P. Khudanpur , Patrick J. Wolfe

Neural machine translation (NMT) takes deterministic sequences for source representations. However, either word-level or subword-level segmentations have multiple choices to split a source sequence with different word segmentors or…

Computation and Language · Computer Science 2019-06-05 Fengshun Xiao , Jiangtong Li , Hai Zhao , Rui Wang , Kehai Chen