Related papers: Analytical Softmax Temperature Setting from Featur…
Decoding in large language models is often described as scoring tokens and normalizing with softmax. We give a minimal, self-contained account of this step as a constrained variational principle on the probability simplex. The discrete,…
State-of-the-art space science missions increasingly rely on automation due to spacecraft complexity and the costs of human oversight. The high volume of data, including scientific and telemetry data, makes manual inspection challenging.…
A new method called `Configurational Temperature' is introduced in the context of dusty plasma, where the temperature of the dust particles, submerged in the plasma, can be measured directly from the positional information of the individual…
The Eliashberg theory of superconductivity accounts for the fundamental physics of conventional electron-phonon superconductors, including the retardation of the interaction and the effect of the Coulomb pseudopotential, to predict the…
This study presents a novel physics informed, data-driven modeling framework for capturing the strongly nonlinear thermo-viscoelastic behavior of soft materials exhibiting stress softening, with emphasis on the Mullins effect. Unlike…
Simulated annealing is an effective and general means of optimization. It is in fact inspired by metallurgy, where the temperature of a material determines its behavior in thermodynamics. Likewise, in simulated annealing, the actions that…
Using two extremely different models of glass formers in two and three dimensions we demonstrate how to encode the subtle changes in the geometric rearrangement of particles during the scenario of the glass transition. We construct a…
A machine-learning non-contact method to determine the temperature of a laser gain medium via its laser emission with a trained few-layer neural net model is presented. The training of the feed-forward Neural Network (NN) enables the…
The accurate interpretation of experiments with matter at extreme densities and pressures is a notoriously difficult challenge. In a recent work [T.~Dornheim et al., Nature Comm. (in print), arXiv:2206.12805], we have introduced a formally…
In state-of-the-art deep learning for object recognition, SoftMax and Sigmoid functions are most commonly employed as the predictor outputs. Such layers often produce overconfident predictions rather than proper probabilistic scores, which…
Among the statistical mechanical frameworks able to describe systems in non-equilibrium steady states such as collisionless plasmas, self-gravitating systems and other complex systems, superstatistics have gained recent attention.…
We study several variations of the question of minimum-error discrimination of thermal states. Besides of providing the optimal values for the probability of error, we also characterize the optimal measurements. For the case of a fixed…
In this study, we evaluate several classifiers and focus on selecting a minimal set of appropriate material features. Our objective is to propose and discuss general strategies for reducing the number of descriptors required for material…
We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…
Laser melting, such as that encountered during additive manufacturing (AM), produces extreme gradients of temperature in both space and time, which in turn influence microstructural development in the material. Qualification and model…
Physical field reconstruction is highly desirable for the measurement and control of engineering systems. The reconstruction of the temperature field from limited observation plays a crucial role in thermal management for electronic…
Certified verification of transformer attention requires bounding the softmax function over interval constraints on the pre-softmax scores. Existing verifiers relax softmax ndependently of the downstream objective, leaving avoidable slack.…
We address the existence and uniqueness of the so-called modified error function that arises in the study of phase-change problems with specific heat and thermal conductivity given by linear functions of the material temperature. This…
Thermal comfort in shared spaces is essential to occupants well-being and necessary in the management of energy consumption. Existing thermal control systems for indoor shared spaces adjust temperature set points mechanically, making it…
Heat stress is one of the main welfare and productivity problems faced by dairy cattle in Mediterranean climates. In this study, we approach the prediction of the daily shade-seeking count as a non-linear multivariate regression problem and…