中文
相关论文

相关论文: CAREF: Calibration-Aware Regularization for Explan…

200 篇论文

LLMs' overconfidence, particularly when hallucinating, poses a significant challenge for the deployment of the models in safety-critical settings and makes a reliable estimation of uncertainty necessary. Existing approaches for uncertainty…

机器学习 · 计算机科学 2026-05-26 Hamed Karimi , Vaishali Meyappan , Reza Samavi

Accurate sensor calibration is crucial for autonomous systems, yet its uncertainty quantification remains underexplored. We present the first approach to integrate uncertainty awareness into online extrinsic calibration, combining Monte…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Mathieu Cocheteux , Julien Moreau , Franck Davoine

LLM-as-a-judge ensembles are the standard paradigm for scalable evaluation, but their aggregation mechanisms suffer from a fundamental flaw: they implicitly assume that judges provide independent estimates of true quality. However, in…

机器学习 · 计算机科学 2026-03-03 Jitian Zhao , Changho Shin , Tzu-Heng Huang , Satya Sai Srinath Namburi GNVV , Frederic Sala

Precise recall control is critical in large-scale spatial conflation and entity-matching tasks, where missing even a few true matches can break downstream analytics, while excessive manual review inflates cost. Classical confidence-interval…

机器学习 · 计算机科学 2025-10-03 John N. Daras

Reinforcement learning post-training has substantially improved the reasoning accuracy of vision-language models, yet the resulting policies remain poorly calibrated. Terminal correctness rewards provide no gradient that penalizes confident…

机器学习 · 计算机科学 2026-05-19 Peng Cui , Boyao Yang , Jun Zhu

Knowledge graph (KG) refinement mainly aims at KG completion and correction (i.e., error detection). However, most conventional KG embedding models only focus on KG completion with an unreasonable assumption that all facts in KG hold…

人工智能 · 计算机科学 2019-07-30 Yu Zhao , Ji Liu

Numerous real-world decisions rely on machine learning algorithms and require calibrated uncertainty estimates. However, modern methods often yield overconfident, uncalibrated predictions. The dominant approach to quantifying the…

Calibrated probabilistic classifiers are models whose predicted probabilities can directly be interpreted as uncertainty estimates. It has been shown recently that deep neural networks are poorly calibrated and tend to output overconfident…

机器学习 · 统计学 2022-10-17 Teodora Popordanoska , Raphael Sayer , Matthew B. Blaschko

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-tuning to generate…

计算与语言 · 计算机科学 2025-09-18 Suyuchen Wang , Jinlin Wang , Xinyu Wang , Shiqi Li , Xiangru Tang , Sirui Hong , Xiao-Wen Chang , Chenglin Wu , Bang Liu

Large language models (LLMs) are increasingly deployed for tabular question answering, yet calibration on structured data is largely unstudied. This paper presents the first systematic comparison of five confidence estimation methods across…

计算与语言 · 计算机科学 2026-04-15 Lukas Voss

Large language models can produce correct answers while relying on flawed reasoning traces, partly because common training objectives reward final-answer correctness rather than faithful intermediate reasoning. This undermines…

人工智能 · 计算机科学 2026-01-06 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

Conformal Prediction provides distribution-free prediction intervals with guaranteed coverage, but its reliance on a single global calibration threshold obscures the sources of uncertainty at the instance level. In particular, it conflates…

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing and reasoning tasks. However, their performance in the foundational domain of arithmetic remains unsatisfactory. When…

人工智能 · 计算机科学 2024-10-11 Junyu Lai , Jiahe Xu , Yao Yang , Yunpeng Huang , Chun Cao , Jingwei Xu

Calibration ensures that probabilistic forecasts meaningfully capture uncertainty by requiring that predicted probabilities align with empirical frequencies. However, many existing calibration methods are specialized for post-hoc…

机器学习 · 计算机科学 2023-11-01 Charles Marx , Sofian Zalouk , Stefano Ermon

In this paper, we propose a novel \emph{uncertainty-aware graph self-training} approach for semi-supervised node classification. Our method introduces an Expectation-Maximization (EM) regularization scheme to incorporate an uncertainty…

机器学习 · 计算机科学 2025-07-31 Emily Wang , Michael Chen , Chao Li

While test-time scaling has enabled large language models to solve highly difficult tasks, state-of-the-art results come at exorbitant compute costs. These inefficiencies can be attributed to the miscalibration of post-trained language…

Explanation fidelity, which measures how accurately an explanation reflects a model's true reasoning, remains critically underexplored in recommender systems. We introduce SPINRec (Stochastic Path Integration for Neural Recommender…

信息检索 · 计算机科学 2025-11-25 Oren Barkan , Yahlly Schein , Yehonatan Elisha , Veronika Bogina , Mikhail Baklanov , Noam Koenigstein

Accurate multi-sensor calibration is essential for deploying robust perception systems in applications such as autonomous driving and intelligent transportation. Existing LiDAR-camera calibration methods often rely on manually placed…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Lei Cheng , Lihao Guo , Tianya Zhang , Tam Bang , Austin Harris , Mustafa Hajij , Mina Sartipi , Siyang Cao

Large language models often fail on multi-step reasoning due to fixed reasoning strategies that ignore problem specific difficulty. We introduce CARD (Complexity Agnostic Recursive Decomposition), a framework that predicts problem…

计算与语言 · 计算机科学 2026-01-09 Kaleem Ullah Qasim , Jiashu Zhang , Hafiz Saif Ur Rehman

This paper considers an alternative method for fitting CARR models using combined estimating functions (CEF) by showing its usefulness in applications in economics and quantitative finance. The associated information matrix for…

应用统计 · 统计学 2017-02-09 Kok-Haur Ng , Shelton Peiris , Jennifer So-kuen-Chan , David Allen , Kooi-Huat Ng