Related papers: Analytical Softmax Temperature Setting from Featur…
It is now well known that neural networks can be wrong with high confidence in their predictions, leading to poor calibration. The most common post-hoc approach to compensate for this is to perform temperature scaling, which adjusts the…
Since the internal temperature is less accessible than surface temperature, there is an urgent need to develop accurate and real-time estimation algorithms for better thermal management and safety. This work presents a novel framework for…
In many classification applications, the prediction of a deep neural network (DNN) based classifier needs to be accompanied by some confidence indication. Two popular approaches for that aim are: 1) Calibration: modifies the classifier's…
Outdoor thermal comfort is a critical determinant of urban livability, particularly in hot desert climates where extreme heat poses challenges to public health, energy consumption, and urban planning. Mean Radiant Temperature ($T_{mrt}$) is…
We calculate the temperature dependence of the weak localization correction in a two dimensional system at arbitrary relation between temperature, $T$ and the elastic mean free time. We describe the crossover in the dephasing time…
This work focuses on determining the coefficient of thermal diffusivity in a one-dimensional heat transfer process along a homogeneous and isotropic bar, embedded in a moving fluid with heat generation. A first type (Dirichlet) condition is…
We explain recently observed linear temperature dependence of the nodal Fermi velocity $v_F (T)$ in near-optimally doped cuprates. We argue that it originates from electron-electron interaction, and is a fundamental property of an arbitrary…
Facial landmark detection is an important task in computer vision with numerous applications, such as head pose estimation, expression analysis, face swapping, etc. Heatmap regression-based methods have been widely used to achieve…
Softmax is the most commonly used output function for multiclass problems and is widely used in areas such as vision, natural language processing, and recommendation. A softmax model has linear costs in the number of classes which makes it…
Transformer-based architectures traditionally employ softmax to compute attention weights, which produces dense distributions over all tokens in a sequence. While effective in many settings, this density has been shown to be detrimental for…
A boundary value problem, which could represent a transcendent temperature conduction problem with evaporation in a part of the boundary, was studied to determine unknown thermophysical parameters, which can be constants or time dependent…
This work aims to develop a measure that can accurately rank the performance of various classifiers when they are tested on unlabeled data from out-of-distribution (OOD) distributions. We commence by demonstrating that conventional…
Optimisation of heat engines at the micro-scale has applications in biological and artificial nano-technology, and stimulates theoretical research in non-equilibrium statistical physics. Here we consider non-interacting overdamped particles…
Temperature scaling is a simple method that allows to control the uncertainty of probabilistic models. It is mostly used in two contexts: improving the calibration of classifiers and tuning the stochasticity of large language models (LLMs).…
The optimal management of a building's microclimate to satisfy the occupants' needs and objectives in terms of comfort, energy efficiency, and costs is particularly challenging. This complexity arises from the non-linear, time-dependent…
Thermal dynamics modeling has been a critical issue in building heating, ventilation, and air-conditioning (HVAC) systems, which can significantly affect the control and maintenance strategies. Due to the uniqueness of each specific…
In a recent study by some of us, we have proposed a new measure of the structure of a liquid, the softness of the mean-field caging potential, and shown that it can describe the temperature dependence of the dynamics. In this work, we put…
An ensuing challenge in Artificial Intelligence (AI) is the perceived difficulty in interpreting sophisticated machine learning models, whose ever-increasing complexity makes it hard for such models to be understood, trusted and thus…
Melting is a high temperature process that requires extensive sampling of configuration space, thus making melting temperature prediction computationally very expensive and challenging. Over the past few years, I have built two methods to…
We propose DropMax, a stochastic version of softmax classifier which at each iteration drops non-target classes according to dropout probabilities adaptively decided for each instance. Specifically, we overlay binary masking variables over…