中文
相关论文

相关论文: The Well-Tempered Classifier: Some Elementary Prop…

200 篇论文

Calibration is a popular framework to evaluate whether a classifier knows when it does not know - i.e., its predictive probabilities are a good indication of how likely a prediction is to be correct. Correctness is commonly estimated…

计算与语言 · 计算机科学 2022-12-01 Joris Baan , Wilker Aziz , Barbara Plank , Raquel Fernández

Scaling the test-time compute of large language models has demonstrated impressive performance on reasoning benchmarks. However, existing evaluations of test-time scaling make the strong assumption that a reasoning system should always give…

计算与语言 · 计算机科学 2025-07-21 William Jurayj , Jeffrey Cheng , Benjamin Van Durme

Large Language Models (LLMs) are increasingly applied to complex tasks that require extended reasoning. In such settings, models often benefit from diverse chains-of-thought to arrive at multiple candidate solutions. This requires two…

机器学习 · 计算机科学 2025-10-08 Xueyan Li , Guinan Su , Mrinmaya Sachan , Jonas Geiping

As Large Language Models (LLMs) become integral to human-centered applications, understanding their personality-like behaviors is increasingly important for responsible development and deployment. This paper systematically evaluates six…

计算与语言 · 计算机科学 2025-11-07 Christos-Nikolaos Zacharopoulos , Revekka Kyriakoglou

We compare probabilistic predictions of extreme temperature anomalies issued by two different forecast schemes. One is a dynamical physical weather model, the other a simple data model. We recall the concept of skill scores in order to…

应用统计 · 统计学 2013-12-17 Stefan Siegert , Jochen Broecker , Holger Kantz

The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy…

Uncertainty calibration is essential for the safe deployment of large language models (LLMs), particularly when users rely on verbalized confidence estimates. While prior work has focused on classifiers or short-form generation, confidence…

计算与语言 · 计算机科学 2025-06-05 Chaeyun Jang , Moonseok Choi , Yegon Kim , Hyungi Lee , Juho Lee

We present a state-of-the-art model for fine-grained probability estimation of propositions conditioned on context. Recent advances in large language models (LLMs) have significantly enhanced their reasoning capabilities, particularly on…

计算与语言 · 计算机科学 2026-04-28 Liaoyaqi Wang , Zhengping Jiang , Anqi Liu , Benjamin Van Durme

Fine-tuning LLMs on tabular classification tasks can lead to the phenomenon of fine-tuning multiplicity where equally well-performing models make conflicting predictions on the same input. Fine-tuning multiplicity can arise due to…

机器学习 · 计算机科学 2025-06-05 Faisal Hamman , Pasan Dissanayake , Saumitra Mishra , Freddy Lecue , Sanghamitra Dutta

Reinforcement Learning from Verifiable Rewards (RLVR) trains large language models (LLMs) from sampled trajectories, making decoding strategy a core component of learning rather than a purely inference-time choice. Sampling temperature…

机器学习 · 计算机科学 2026-02-16 Yixiao Zhou , Yang Li , Dongzhou Cheng , Hehe Fan , Yu Cheng

Thermal history models, that have been used to understand the geological history of Earth, are now being coupled to climate models to map conditions that allow planets to maintain surface water over geologic time - a criteria considered…

地球与行星天体物理 · 物理学 2020-01-08 Johnny Seales , Adrian Lenardic , William Moore

Distillation is the technique of training a "student" model based on examples that are labeled by a separate "teacher" model, which itself is trained on a labeled dataset. The most common explanations for why distillation "works" are…

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

计算与语言 · 计算机科学 2024-05-07 Yuval Reif , Roy Schwartz

Large language models (LLMs) have become increasingly prevalent in our daily lives, leading to an expectation for LLMs to be trustworthy -- - both accurate and well-calibrated (the prediction confidence should align with its ground truth…

计算与语言 · 计算机科学 2024-10-04 KaShun Shum , Minrui Xu , Jianshu Zhang , Zixin Chen , Shizhe Diao , Hanze Dong , Jipeng Zhang , Muhammad Omer Raza

The operation of machine tools often demands a highly accurate knowledge of the tool center point's (TCP) position. The displacement of the TCP over time can be inferred from thermal models, which comprise a set of geometrically coupled…

数值分析 · 数学 2023-06-23 Alexandra Bünger , Roland Herzog , Andreas Naumann , Martin Stoll

Using optimal detection techniques with climate model simulations, most of the observed increase of near surface temperatures over the second half of the twentieth century is attributed to anthropogenic influences. However, the partitioning…

大气与海洋物理 · 物理学 2016-08-03 Gareth S. Jones , Peter A. Stott , John F. B. Mitchell

One of the most used metrics to gauge the effects of climate change is the equilibrium climate sensitivity, defined as the long-term (equilibrium) temperature increase resulting from instantaneous doubling of atmospheric CO$_2$. Since…

大气与海洋物理 · 物理学 2021-02-04 Robbin Bastiaansen , Henk A. Dijkstra , Anna S. von der Heydt

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would…

Tempered Exponential Measures (TEMs) are a parametric generalization of the exponential family of distributions maximizing the tempered entropy function among positive measures subject to a probability normalization of their power…

机器学习 · 计算机科学 2023-11-23 Ehsan Amid , Frank Nielsen , Richard Nock , Manfred K. Warmuth

Simulated annealing is an effective and general means of optimization. It is in fact inspired by metallurgy, where the temperature of a material determines its behavior in thermodynamics. Likewise, in simulated annealing, the actions that…

机器学习 · 计算机科学 2020-07-01 Avrim Blum , Chen Dan , Saeed Seddighin