中文
相关论文

相关论文: Are Generative Models Underconfident? Better Quali…

200 篇论文

This paper addresses a significant gap in explainable AI: the necessity of interpreting epistemic uncertainty in model explanations. Although current methods mainly focus on explaining predictions, with some including uncertainty, they fail…

人工智能 · 计算机科学 2024-10-10 Helena Löfström , Tuwe Löfström , Johan Hallberg Szabadvary

Modern problems in statistics tend to include estimators of high computational complexity and with complicated distributions. Statistical inference on such estimators usually relies on asymptotic normality assumptions, however, such…

统计方法学 · 统计学 2016-12-08 Eyal Fisher , Regev Schweiger , Saharon Rosset

Machine Translation Quality Estimation (QE) is a task of predicting the quality of machine translations without relying on any reference. Recently, the predictor-estimator framework trains the predictor as a feature extractor, which…

计算与语言 · 计算机科学 2021-05-18 Qu Cui , Shujian Huang , Jiahuan Li , Xiang Geng , Zaixiang Zheng , Guoping Huang , Jiajun Chen

From both human translators (HT) and machine translation (MT) researchers' point of view, translation quality evaluation (TQE) is an essential task. Translation service providers (TSPs) have to deliver large volumes of translations which…

计算与语言 · 计算机科学 2021-11-16 Serge Gladkoff , Irina Sorokina , Lifeng Han , Alexandra Alekseeva

Effective cooperation is pivotal in distributed learning for multi-agent systems, where the interplay between the quantity and quality of the machine learning models is crucial. This paper reveals the irrationality of indiscriminate…

机器学习 · 计算机科学 2026-01-22 Zewen Yang , Xiaobing Dai , Jiajun Cheng , Yulong Huang , Peng Shi

Recent years have seen big advances in the field of sentence-level quality estimation (QE), largely as a result of using neural-based architectures. However, the majority of these methods work only on the language pair they are trained on…

计算与语言 · 计算机科学 2020-11-05 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

The Best Estimate plus Uncertainty (BEPU) approach for nuclear systems modeling and simulation requires that the prediction uncertainty must be quantified in order to prove that the investigated design stays within acceptance criteria. A…

统计计算 · 统计学 2023-03-24 Ziyu Xie , Farah Alsafadi , Xu Wu

Machine Translation Quality Estimation (QE) is the task of evaluating translation output in the absence of human-written references. Due to the scarcity of human-labeled QE data, previous works attempted to utilize the abundant unlabeled…

计算与语言 · 计算机科学 2022-12-21 Baopu Qiu , Liang Ding , Di Wu , Lin Shang , Yibing Zhan , Dacheng Tao

Well-calibrated model confidence scores can improve the usefulness of text generation models. For example, users can be prompted to review predictions with low confidence scores, to prevent models from returning bad or potentially dangerous…

计算与语言 · 计算机科学 2025-06-16 Lorenzo Jaime Yu Flores , Ori Ernst , Jackie Chi Kit Cheung

Trustworthy machine learning is of primary importance to the practical deployment of deep learning models. While state-of-the-art models achieve astonishingly good performance in terms of accuracy, recent literature reveals that their…

机器学习 · 计算机科学 2023-02-07 Ailin Deng , Shen Li , Miao Xiong , Zhirui Chen , Bryan Hooi

In this work, we develop an importance sampling estimator by coupling the reduced-order model and the generative model in a problem setting of uncertainty quantification. The target is to estimate the probability that the quantity of…

机器学习 · 统计学 2024-12-20 Xiaoliang Wan , Shuangqing Wei

Datasets with missing values are very common on industry applications, and they can have a negative impact on machine learning models. Recent studies introduced solutions to the problem of imputing missing values based on deep generative…

机器学习 · 计算机科学 2019-02-28 Ramiro D. Camino , Christian A. Hammerschmidt , Radu State

Explainable AI methods facilitate the understanding of model behaviour, yet, small, imperceptible perturbations to inputs can vastly distort explanations. As these explanations are typically evaluated holistically, before model deployment,…

机器学习 · 计算机科学 2024-06-05 Sara Vera Marjanović , Isabelle Augenstein , Christina Lioma

This work presents a novel approach to Automatic Post-Editing (APE) and Word-Level Quality Estimation (QE) using ensembles of specialized Neural Machine Translation (NMT) systems. Word-level features that have proven effective for QE are…

计算与语言 · 计算机科学 2017-07-18 Chris Hokamp

A common assumption exists according to which machine learning models improve their performance when they have more data to learn from. In this study, the authors wished to clarify the dilemma by performing an empirical experiment utilizing…

机器学习 · 计算机科学 2021-12-20 Antti Kariluoto , Arto Pärnänen , Joni Kultanen , Jukka Soininen , Pekka Abrahamsson

The paper presents two approaches submitted to the WMT 2025 Automated Translation Quality Evaluation Systems Task 3 - Quality Estimation (QE)-informed Segment-level Error Correction. While jointly training QE systems with Automatic…

计算与语言 · 计算机科学 2025-11-19 Govardhan Padmanabhan

Learning from demonstrations has emerged as a promising paradigm for end-to-end robot control, particularly when scaled to diverse and large datasets. However, the quality of demonstration data, often collected through human teleoperation,…

机器人学 · 计算机科学 2026-03-11 Haeone Lee , Taywon Min , Junsu Kim , Sinjae Kang , Fangchen Liu , Lerrel Pinto , Kimin Lee

This paper develops new insights into quantitative methods for the validation of computational model prediction. Four types of methods are investigated, namely classical and Bayesian hypothesis testing, a reliability-based method, and an…

数据分析、统计与概率 · 物理学 2012-06-25 You Ling , Sankaran Mahadevan

A key factor in ensuring the accuracy of computer simulations that model physical systems is the proper calibration of their parameters based on real-world observations or experimental data. Inevitably, uncertainties arise, and Bayesian…

计算工程、金融与科学 · 计算机科学 2026-02-25 Daniel Andrés Arcones , Martin Weiser , Phaedon-Stelios Koutsourelakis , Jörg F. Unger

We develop a generative model-based approach to Bayesian inverse problems, such as image reconstruction from noisy and incomplete images. Our framework addresses two common challenges of Bayesian reconstructions: 1) It makes use of complex,…

机器学习 · 统计学 2019-10-24 Vanessa Böhm , François Lanusse , Uroš Seljak