Related papers: Construction of a Neural Network with Temperature-…
In analog neuromorphic chips, designers can embed computing primitives in the intrinsic physical properties of devices and circuits, heavily reducing device count and energy consumption, and enabling high parallelism, because all devices…
We study a simple extended model of oscillator neural networks capable of storing sparsely coded phase patterns, in which information is encoded both in the mean firing rate and in the timing of spikes. Applying the methods of statistical…
We study the deviations from perfect memory in negative temperature cycle spin glass experiments. It is known that the a.c. susceptibility after the temperature is raised back to its initial value is superimposed to the reference isothermal…
A new network model is proposed to describe the $1/f^\alpha$ resistance noise in disordered materials for a wide range of $\alpha$ values ($0< \alpha < 2$). More precisely, we have considered the resistance fluctuations of a thin resistor…
Although considerable attention has been devoted to the development of models for isothermal, rate-independent plasticity, many high-consequence performance assessments involve viscoplastic processes that generate substantial heat. In…
Temperature is a widely used hyperparameter in various tasks involving neural networks, such as classification or metric learning, whose choice can have a direct impact on the model performance. Most of existing works select its value using…
Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…
We consider the setting where a collection of time series, modeled as random processes, evolve in a causal manner, and one is interested in learning the graph governing the relationships of these processes. A special case of wide interest…
Graph attention networks learn neighbor importance through data-dependent coefficients, but standard layers lack explicit control over unreliable feature dimensions and use fixed sharpness of attention coefficient distributions. This paper…
Simulated annealing is an effective and general means of optimization. It is in fact inspired by metallurgy, where the temperature of a material determines its behavior in thermodynamics. Likewise, in simulated annealing, the actions that…
Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…
Reasoning models (e.g., DeepSeek-R1) generate long chains of thought to solve harder problems, but they often loop, repeating the same text at low temperatures or with greedy decoding. We study why this happens and what role temperature…
Little is known theoretically about the associative memory capabilities of neural networks in which information is encoded not only in the mean firing rate but also in the timing of firings. Particularly, in the case that the fraction of…
We study the influence of thermal fluctuations in the phase diagram of a recently introduced two-dimensional phase field crystal model with an external pinning potential. The model provides a continuum description of pinned lattice systems…
We explore a one-to-one correspondence between a neural network (NN) and a statistical mechanical spin model where neurons are mapped to Ising spins and weights to spin-spin couplings. The process of training an NN produces a family of spin…
Early recordings of nervous conduction revealed a notable thermal signature associated with the electrical signal. The observed production and subsequent absorption of heat arise from physicochemical processes that occur at the cell…
Glass-forming liquids exhibit slow dynamics below their melting temperatures, maintaining an amorphous structure reminiscent of normal liquids. Distinguishing microscopic structures in the supercooled and high-temperature regimes remains a…
The resistivity around the ferromagnetic transition temperature in the double exchange model is studied by the Schwinger boson approach. The spatial spin correlation responsible for scattering of conduction electrons are taken into account…
Histogram-based template fits are the main technique used for estimating parameters of high energy physics Monte Carlo generators. Parametrized neural network reweighting can be used to extend this fitting procedure to many dimensions and…
We introduce an efficient dynamical tree method that enables us, for the first time, to explicitly demonstrate thermo-remanent magnetization memory effect in a hierarchical energy landscape. Our simulation nicely reproduces the nontrivial…