English
Related papers

Related papers: Temperature Optimization for Bayesian Deep Learnin…

200 papers

Current causal discovery approaches require restrictive model assumptions in the absence of interventional data to ensure structure identifiability. These assumptions often do not hold in real-world applications leading to a loss of…

Machine Learning · Statistics 2025-06-25 Anish Dhir , Ruby Sedgwick , Avinash Kori , Ben Glocker , Mark van der Wilk

Collaborative filtering (CF) is a successful approach commonly used by many recommender systems. Conventional CF-based methods use the ratings given to items by users as the sole source of information for learning to make recommendation.…

Machine Learning · Computer Science 2015-06-22 Hao Wang , Naiyan Wang , Dit-Yan Yeung

We introduce a new preference-based framework for conditional treatment effect estimation and policy learning, built on the Conditional Preference-based Treatment Effect (CPTE). CPTE requires only that outcomes be ranked under a preference…

Machine Learning · Statistics 2026-02-04 Dovid Parnas , Mathieu Even , Julie Josse , Uri Shalit

Temperature scaling is a simple method that allows to control the uncertainty of probabilistic models. It is mostly used in two contexts: improving the calibration of classifiers and tuning the stochasticity of large language models (LLMs).…

Machine Learning · Statistics 2026-05-28 Pierre-Alexandre Mattei , Bruno Loureiro

In metal Additive Manufacturing (AM), monitoring the temperature of the Melt Pool (MP) is crucial for ensuring part quality, process stability, defect prevention, and overall process optimization. Traditional methods, are slow to converge…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Javid Akhavan , Chaitanya Krishna Vallabh , Xiayun Zhao , Souran Manoochehri

This paper proposes a probabilistic contrastive loss function for self-supervised learning. The well-known contrastive loss is deterministic and involves a temperature hyperparameter that scales the inner product between two normed feature…

Machine Learning · Computer Science 2021-12-06 Shen Li , Jianqing Xu , Bryan Hooi

In contemporary self-supervised contrastive algorithms like SimCLR, MoCo, etc., the task of balancing attraction between two semantically similar samples and repulsion between two samples of different classes is primarily affected by the…

Machine Learning · Computer Science 2024-05-13 Siladittya Manna , Soumitri Chattopadhyay , Rakesh Dey , Saumik Bhattacharya , Umapada Pal

In the realm of point cloud registration, the most prevalent pose evaluation approaches are statistics-based, identifying the optimal transformation by maximizing the number of consistent correspondences. However, registration recall…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Junjie Gao , Chongjian Wang , Zhongjun Ding , Shuangmin Chen , Shiqing Xin , Changhe Tu , Wenping Wang

When training classification models, it expects that the learned features are compact within classes, and can well separate different classes. As the dominant loss function for training classification models, minimizing cross-entropy (CE)…

Machine Learning · Computer Science 2025-05-12 Qiufu Li , Huibin Xiao , Linlin Shen

Uncertainty quantification and robustness to distribution shifts are important goals in machine learning and artificial intelligence. Although Bayesian Neural Networks (BNNs) allow for uncertainty in the predictions to be assessed,…

Machine Learning · Computer Science 2024-10-23 Michele Caprio , Souradeep Dutta , Kuk Jin Jang , Vivian Lin , Radoslav Ivanov , Oleg Sokolsky , Insup Lee

We systematically investigate the dependence of the temperature of cold cesium atoms of polarization gradient cooling (PGC) in optical molasses on experimental parameters, which contain changing modes of cooling laser, PGC interaction time,…

Atomic Physics · Physics 2015-03-23 Zhonghua Ji , Jinpeng Yuan , Yanting Zhao , Xuefang Chang , Yonggang Yang , Liantuan Xiao , Suotang Jia

Electron temperature (Te) is an important parameter governing space weather in the upper atmosphere, but has historically been underexplored in the space weather machine learning literature. We present CLARE, a machine learning model for…

Space Physics · Physics 2026-03-16 Michael Liang , Blake DeHaas , Naomi Maruyama , Xiangning Chu , Takumi Abe , Koh-Ichiro Oyama

Bayesian Dark Knowledge is a method for compressing the posterior predictive distribution of a neural network model into a more compact form. Specifically, the method attempts to compress a Monte Carlo approximation to the parameter…

Machine Learning · Computer Science 2019-06-11 Meet P. Vadera , Benjamin M. Marlin

Despite their incredible performance, it is well reported that deep neural networks tend to be overoptimistic about their prediction confidence. Finding effective and efficient calibration methods for neural networks is therefore an…

Machine Learning · Computer Science 2023-09-07 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

A learning-based posterior distribution estimation method, Probabilistic Dipole Inversion (PDI), is proposed to solve quantitative susceptibility mapping (QSM) inverse problem in MRI with uncertainty estimation. A deep convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Jinwei Zhang , Hang Zhang , Mert Sabuncu , Pascal Spincemaille , Thanh Nguyen , Yi Wang

In applications of climate information, coarse-resolution climate projections commonly need to be downscaled to a finer grid. One challenge of this requirement is the modeling of sub-grid variability and the spatial and temporal dependence…

PAC-Bayesian algorithms and Gibbs posteriors are gaining popularity due to their robustness against model misspecification even when Bayesian inference is inconsistent. The PAC-Bayesian alpha-posterior is a generalization of the standard…

Machine Learning · Computer Science 2020-04-23 Lucie Perrotta

Representing uncertainty in causal discovery is a crucial component for experimental design, and more broadly, for safe and reliable causal decision making. Bayesian Causal Discovery (BCD) offers a principled approach to encapsulating this…

In this paper, we study a class of non-parametric density estimators under Bayesian settings. The estimators are piecewise constant functions on binary partitions. We analyze the concentration rate of the posterior distribution under a…

Statistics Theory · Mathematics 2015-08-21 Linxi Liu , Wing Hung Wong

Variational inference (VI) combined with data subsampling enables approximate posterior inference over large data sets, but suffers from poor local optima. We first formulate a deterministic annealing approach for the generic class of…

Machine Learning · Statistics 2016-05-31 Stephan Mandt , James McInerney , Farhan Abrol , Rajesh Ranganath , David Blei