English
Related papers

Related papers: Understanding temperature tuning in energy-based m…

200 papers

For quantum many-body systems in one dimension, computational complexity theory reveals that the evaluation of ground-state energy remains elusive on quantum computers, contrasting the existence of a classical algorithm for temperatures…

Statistical Mechanics · Physics 2024-06-11 Atsushi Iwaki , Chisa Hotta

Parameterized artificial neural networks (ANNs) can be very expressive ansatzes for variational algorithms, reaching state-of-the-art energies on many quantum many-body Hamiltonians. Nevertheless, the training of the ANN can be slow and…

Quantum Physics · Physics 2025-06-04 Conor Smith , Quinn T. Campbell , Tameem Albash

Temperature is a crucial hyperparameter in large language models (LLMs), controlling the trade-off between exploration and exploitation during text generation. High temperatures encourage diverse but noisy outputs, while low temperatures…

Machine Learning · Computer Science 2026-02-13 Haoran Dang , Cuiling Lan , Hai Wan , Xibin Zhao , Yan Lu

Personal thermal comfort models aim to predict an individual's thermal comfort response, instead of the average response of a large group. Recently, machine learning algorithms have proven to be having enormous potential as a candidate for…

Machine Learning · Computer Science 2022-11-22 Hari Prasanna Das , Costas J. Spanos

A central idea of knowledge distillation is to expose relational structure embedded in the teacher's weights for the student to learn, which is often facilitated using a temperature parameter. Despite its widespread use, there remains…

Machine Learning · Computer Science 2026-03-05 Logan Frank , Jim Davis

We present a mechanism to steer the sampling diversity of denoising diffusion and flow matching models, allowing users to sample from a sharper or broader distribution than the training distribution. We build on the observation that these…

Machine Learning · Computer Science 2026-05-26 Yanbo Xu , Yu Wu , Sungjae Park , Zhizhuo Zhou , Shubham Tulsiani

Power grid expansion planning requires making large investment decisions in the present that will impact the future cost and reliability of a system exposed to wide-ranging uncertainties. Extreme temperatures can pose significant challenges…

Optimization and Control · Mathematics 2024-05-30 Ramsey Rossmann , Mihai Anitescu , Julie Bessac , Michael Ferris , Mitchell Krock , James Luedtke , Line Roald

Reliable models of the thermodynamic properties of materials are critical for industrially relevant applications that require a good understanding of equilibrium phase diagrams, thermal and chemical transport, and microstructure evolution.…

Materials Science · Physics 2018-09-21 Noah H. Paulson , Elise Jennings , Marius Stan

The Hot Stove Effect is a negativity bias resulting from the adaptive character of learning. The mechanism is that learning algorithms that pursue alternatives with positive estimated values, but avoid alternatives with negative estimated…

Machine Learning · Computer Science 2024-04-04 Jerker Denrell

Adaptive systems -- such as a biological organism gaining survival advantage, an autonomous robot executing a functional task, or a motor protein transporting intracellular nutrients -- must model the regularities and stochasticity in their…

Statistical Mechanics · Physics 2021-04-13 A. B. Boyd , J. P. Crutchfield , M. Gu

Performance models are well-known instruments to understand the scaling behavior of parallel applications. They express how performance changes as key execution parameters, such as the number of processes or the size of the input problem,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-01 Marcin Copik , Alexandru Calotoiu , Tobias Grosser , Nicolas Wicki , Felix Wolf , Torsten Hoefler

Precise and reliable climate projections are required for climate adaptation and mitigation, but Earth system models still exhibit great uncertainties. Several approaches have been developed to reduce the spread of climate projections and…

Power and thermal management are critical components of High-Performance-Computing (HPC) systems, due to their high power density and large total power consumption. The assessment of thermal dissipation by means of compact models directly…

Machine Learning · Computer Science 2018-11-08 Federico Pittino , Roberto Diversi , Luca Benini , Andrea Bartolini

Recent work has highlighted the complex influence training hyperparameters, e.g., the number of training epochs, can have on the prunability of machine learning models. Perhaps surprisingly, a systematic approach to predict precisely how…

Machine Learning · Statistics 2024-03-04 Yefan Zhou , Yaoqing Yang , Arin Chang , Michael W. Mahoney

Atmospheric models used for weather and climate prediction are traditionally formulated in a deterministic manner. In other words, given a particular state of the resolved scale variables, the most likely forcing from the sub-grid scale…

Machine Learning · Computer Science 2024-02-16 Hannah M. Christensen , Salah Kouhen , Greta Miller , Raghul Parthipan

For most statistical postprocessing schemes used to correct weather forecasts, changes to the forecast model induce a considerable reforecasting effort. We present a new approach based on response theory to cope with slight model changes.…

Atmospheric and Oceanic Physics · Physics 2020-06-24 Jonathan Demaeyer , Stéphane Vannitsem

Overfitting is a phenomenon that occurs when a machine learning model is trained for too long and focused too much on the exact fitness of the training samples to the provided training labels and cannot keep track of the predictive rules…

Machine Learning · Computer Science 2025-09-22 Nuri Korhan , Samet Bayram

The limit of small entropy production is reached in relaxing systems long after preparation, and in stationary driven systems in the limit of small driving power. Surprisingly, for extended systems this limit is not in general the…

Condensed Matter · Physics 2009-10-31 Leticia F. Cugliandolo , Jorge Kurchan

Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifying uncertainty by…

Machine Learning · Computer Science 2023-12-06 Seohyeon Cha , Honggu Kang , Joonhyuk Kang

Self-consistency improves reasoning by aggregating diverse stochastic samples, yet the dynamics behind its efficacy remain underexplored. We reframe self-consistency as a dynamic distributional alignment problem, revealing that decoding…

Computation and Language · Computer Science 2025-06-12 Yiwei Li , Ji Zhang , Shaoxiong Feng , Peiwen Yuan , Xinglin Wang , Jiayi Shi , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li