English
Related papers

Related papers: Temperature Optimization for Bayesian Deep Learnin…

200 papers

In recent years, inconsistency in Bayesian deep learning has attracted significant attention. Tempered or generalized posterior distributions are frequently employed as direct and effective solutions. Nonetheless, the underlying mechanisms…

Machine Learning · Computer Science 2025-09-23 Yinsong Chen , Samson S. Yu , Zhong Li , Chee Peng Lim

It is now well known that neural networks can be wrong with high confidence in their predictions, leading to poor calibration. The most common post-hoc approach to compensate for this is to perform temperature scaling, which adjusts the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Tom Joy , Francesco Pinto , Ser-Nam Lim , Philip H. S. Torr , Puneet K. Dokania

Passive radiative cooling toward the sky is a developing technology for adaptation in hot climates. Previous calculations of cooling performance have generally used uniform atmospheric models that assume a single sky temperature and…

Optics · Physics 2025-03-24 Yeonghoon Jin , Mikhail A. Kats

Matrix factorization is one of the most efficient approaches in recommender systems. However, such algorithms, which rely on the interactions between users and items, perform poorly for "cold-users" (users with little history of such…

Information Retrieval · Computer Science 2018-05-18 ThaiBinh Nguyen , Atsuhiro Takasu

A physics-informed neural network is developed to solve conductive heat transfer partial differential equation (PDE), along with convective heat transfer PDEs as boundary conditions (BCs), in manufacturing and engineering applications where…

Machine Learning · Computer Science 2021-03-29 Navid Zobeiry , Keith D. Humfeld

Aleatoric uncertainty captures the inherent randomness of the data, such as measurement noise. In Bayesian regression, we often use a Gaussian observation model, where we control the level of aleatoric uncertainty with a noise variance…

Machine Learning · Computer Science 2022-03-31 Sanyam Kapoor , Wesley J. Maddox , Pavel Izmailov , Andrew Gordon Wilson

We consider the problem of estimating a temperature-dependent thermal conductivity model (curve) from temperature measurements. We apply a Bayesian estimation approach that takes into account measurement errors and limited prior information…

Computational Engineering, Finance, and Science · Computer Science 2024-03-21 Rodrigo L. S. Silva , Clemens Verhoosel , Erik Quaeghebeur

Climate models play a critical role in understanding and projecting climate change. Due to their complexity, their horizontal resolution of about 40-100 km remains too coarse to resolve processes such as clouds and convection, which need to…

Machine Learning · Computer Science 2025-03-18 Birgit Kühbacher , Fernando Iglesias-Suarez , Niki Kilbertus , Veronika Eyring

A new model is presented for multisite statistical downscaling of temperature and precipitation using convolutional conditional neural processes (convCNPs). ConvCNPs are a recently developed class of models that allow deep learning…

Machine Learning · Computer Science 2021-01-21 Anna Vaughan , Will Tebbutt , J. Scott Hosking , Richard E. Turner

Predictive coding (PC) is an influential theory of information processing in the brain, providing a biologically plausible alternative to backpropagation. It is motivated in terms of Bayesian inference, as hidden states and parameters are…

Many processes in science and engineering can be described by partial differential equations (PDEs). Traditionally, PDEs are derived by considering first principles of physics to derive the relations between the involved physical quantities…

Machine Learning · Statistics 2019-03-27 Jens Berg , Kaj Nyström

Superconductors have been among the most fascinating substances, as the fundamental concept of superconductivity as well as the correlation of critical temperature and superconductive materials have been the focus of extensive investigation…

Although theoretically compelling, Bayesian learning with modern machine learning models is computationally challenging since it requires approximating a high dimensional posterior distribution. In this work, we (i) introduce posteriors, an…

Machine Learning · Computer Science 2025-04-15 Samuel Duffield , Kaelan Donatella , Johnathan Chiu , Phoebe Klett , Daniel Simpson

Outliers can seriously distort statistical inference by inducing excessive sensitivity in the likelihood function, thereby compromising the reliability of Bayesian estimation. To address this issue, we develop a robust Bayesian estimation…

Statistics Theory · Mathematics 2026-02-09 Jeongho Lee , Junmo Song

Various techniques can be employed to determine the temperature of magnetic transformation, whether it be the Curie or Neel temperature. The standard procedure typically involves creating alloys with defined compositions and performing…

Materials Science · Physics 2025-11-11 Svitlana Ponomarova , Oleksandr Ponomarov , Yurii Koval

Model-based filtering is often carried out while subject to an imperfect model, as learning partially-observable stochastic systems remains a challenge. Recent work on Bayesian inference found that tempering the likelihood or full posterior…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Menno van Zutphen , Domagoj Herceg , Giannis Delimpaltadakis , Duarte J. Antunes

Temperature is a widely used hyperparameter in various tasks involving neural networks, such as classification or metric learning, whose choice can have a direct impact on the model performance. Most of existing works select its value using…

Machine Learning · Computer Science 2022-10-19 Benjamin Chamand , Olivier Risser-Maroix , Camille Kurtz , Philippe Joly , Nicolas Loménie

Tempering is a popular tool in Bayesian computation, being used to transform a posterior distribution $p_1$ into a reference distribution $p_0$ that is more easily approximated. Several algorithms exist that start by approximating $p_0$ and…

Computation · Statistics 2025-09-16 Mengxin Xi , Zheyang Shen , Marina Riabiz , Nicolas Chopin , Chris J. Oates

The temperature parameter plays a profound role during training and/or inference with large foundation models (LFMs) such as large language models (LLMs) and CLIP models. Particularly, it adjusts the logits in the softmax function in LLMs,…

Machine Learning · Computer Science 2024-06-18 Zi-Hao Qiu , Siqi Guo , Mao Xu , Tuo Zhao , Lijun Zhang , Tianbao Yang

The cold-start issue is the challenge when we talk about recommender systems, especially in the case when we do not have the past interaction data of new users or new items. Content-based features or hybrid solutions are common as…

Information Retrieval · Computer Science 2025-09-17 Yushang Zhao , Xinyue Han , Qian Leng , Qianyi Sun , Haotian Lyu , Chengrui Zhou