中文
相关论文

相关论文: Probing Routing-Conditional Calibration in Attenti…

200 篇论文

Post-Training Quantization (PTQ) compresses large language models to low bit-widths using a small calibration set, and its quality depends strongly on which samples are chosen. We identify a failure mode in which calibration samples fail to…

机器学习 · 计算机科学 2026-04-28 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

The neural plausibility of backpropagation has long been disputed, primarily for its use of non-local weight transport $-$ the biologically dubious requirement that one neuron instantaneously measure the synaptic weights of another. Until…

神经元与认知 · 定量生物学 2020-06-26 Daniel Kunin , Aran Nayebi , Javier Sagastuy-Brena , Surya Ganguli , Jonathan M. Bloom , Daniel L. K. Yamins

Coordinating multiple autonomous agents to explore and serve spatially heterogeneous demand requires jointly learning unknown spatial patterns and planning trajectories that maximize task performance. Pure model-based approaches provide…

机器学习 · 计算机科学 2026-03-05 Danish Rizvi , David Boyle

Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under- or over-confident in their predictions. Consequently, methods have been…

Confidence calibration is central to providing accurate and interpretable uncertainty estimates, especially under safety-critical scenarios. However, we find that existing calibration algorithms often overlook the issue of *proximity bias*,…

机器学习 · 计算机科学 2024-03-19 Miao Xiong , Ailin Deng , Pang Wei Koh , Jiaying Wu , Shen Li , Jianqing Xu , Bryan Hooi

Small instruct-tuned LLMs produce degenerate verbal confidence under minimal elicitation: ceiling rates above 95%, near-chance Type-2 AUROC, and Invalid validity profiles. We test whether confidence-conditioned supervised fine-tuning (CSFT)…

计算与语言 · 计算机科学 2026-04-28 Jon-Paul Cacioli

Deep neural networks have demonstrated remarkable performance across numerous learning tasks but often suffer from miscalibration, resulting in unreliable probability outputs. This has inspired many recent works on mitigating…

机器学习 · 计算机科学 2025-09-23 Wenjian Huang , Guiping Cao , Jiahao Xia , Jingkun Chen , Hao Wang , Jianguo Zhang

Industrial multi-label document understanding pipelines score candidate labels and threshold or rank them to form a label set per document. This early selection step directly affects the accuracy of downstream information extraction from…

信息检索 · 计算机科学 2026-05-19 Lasal Jayawardena , Nirmalie Wiratunga , Ikechukwu Nkisi-Orji , Darren Nicol

Agentic AI is increasingly judged not by fluent output alone but by whether it can act, remember, and verify under partial observability, delay, and strategic observation. Existing research often studies these demands separately: robotics…

人工智能 · 计算机科学 2026-04-06 Maximiliano Armesto , Christophe Kolb

The Pickup and Delivery Problem (PDP) is a fundamental and challenging variant of the Vehicle Routing Problem, characterized by tightly coupled pickup--delivery pairs, precedence constraints, and spatial layouts that often exhibit…

机器学习 · 计算机科学 2026-03-12 Wentao Wang , Lifeng Han , Guangyu Zou

A novel background calibration technique for Time-Interleaved Analog-to-Digital Converters (TI-ADCs) is presented in this paper. This technique is applicable to equalized digital communication receivers. As shown by Tsai et al. [1] and Luna…

信号处理 · 电气工程与系统科学 2022-04-12 Fredy Solis , Benjamín T. Reyes , Damián A. Morero , Mario R. Hueda

Learning in the combinatorially large output space of sequence generation problems is challenging as providing expert demonstrations scales poorly with sequence length, and RL struggles with sparse rewards. Between dense demonstrations in…

Trained models are often composed with post-hoc transforms such as temperature scaling (TS), ensembling and stochastic weight averaging (SWA) to improve performance, robustness, uncertainty estimation, etc. However, such transforms are…

机器学习 · 计算机科学 2024-10-07 Rishabh Ranjan , Saurabh Garg , Mrigank Raman , Carlos Guestrin , Zachary Lipton

Neural networks for automated image segmentation are typically trained to achieve maximum accuracy, while less attention has been given to the calibration of their confidence scores. However, well-calibrated confidence scores provide…

图像与视频处理 · 电气工程与系统科学 2020-10-28 Axel-Jan Rousseau , Thijs Becker , Jeroen Bertels , Matthew B. Blaschko , Dirk Valkenborg

Reliable usage of object detectors require them to be calibrated -- a crucial problem that requires careful attention. Recent approaches towards this involve (1) designing new loss functions to obtain calibrated detectors by training them…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Selim Kuzucu , Kemal Oksuz , Jonathan Sadeghi , Puneet K. Dokania

Productive human-AI collaboration requires appropriate reliance, yet contemporary AI systems are often miscalibrated, exhibiting systematic overconfidence or underconfidence. We investigate whether humans can learn to mentally recalibrate…

人机交互 · 计算机科学 2026-03-25 ZhaoBin Li , Mark Steyvers

Much recent work has been devoted to the problem of ensuring that a neural network's confidence scores match the true probability of being correct, i.e. the calibration problem. Of note, it was found that training with focal loss leads to…

机器学习 · 计算机科学 2023-06-21 Arindam Ghosh , Thomas Schaaf , Matthew R. Gormley

Post-training quantization (PTQ) is essential for deploying LLMs under memory and bandwidth constraints. However, extreme low-bit quantization remains highly sensitive to activation outliers and anisotropic weight curvature. Existing…

机器学习 · 计算机科学 2026-05-29 Artur Zagitov , Gleb Molodtsov , Aleksandr Beznosikov

Calibration is commonly evaluated by comparing model confidence with its empirical correctness, implicitly treating reliability as a function of the confidence score alone. However, this view can hide substantial structure: models may be…

机器学习 · 计算机科学 2026-05-14 Katarzyna Kobalczyk , Mihaela van der Schaar

The generalization ability of machine learning models degrades significantly when the test distribution shifts away from the training distribution. We investigate the problem of training models that are robust to shifts caused by changes in…

机器学习 · 计算机科学 2023-09-19 Jiaheng Wei , Harikrishna Narasimhan , Ehsan Amid , Wen-Sheng Chu , Yang Liu , Abhishek Kumar