English
Related papers

Related papers: Construction of a Neural Network with Temperature-…

200 papers

In analog neuromorphic chips, designers can embed computing primitives in the intrinsic physical properties of devices and circuits, heavily reducing device count and energy consumption, and enabling high parallelism, because all devices…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Tommaso Rizzo , Sebastiano Strangio , Alessandro Catania , Giuseppe Iannaccone

We study a simple extended model of oscillator neural networks capable of storing sparsely coded phase patterns, in which information is encoded both in the mean firing rate and in the timing of spikes. Applying the methods of statistical…

Disordered Systems and Neural Networks · Physics 2009-10-31 Masaki Nomura , Toshio Aoyagi

We study the deviations from perfect memory in negative temperature cycle spin glass experiments. It is known that the a.c. susceptibility after the temperature is raised back to its initial value is superimposed to the reference isothermal…

Disordered Systems and Neural Networks · Physics 2009-11-07 M. Sasaki , V. Dupuis , J. -P. Bouchaud , E. Vincent

A new network model is proposed to describe the $1/f^\alpha$ resistance noise in disordered materials for a wide range of $\alpha$ values ($0< \alpha < 2$). More precisely, we have considered the resistance fluctuations of a thin resistor…

Materials Science · Physics 2009-11-13 C. Pennetta , E. Alfinito , L. Reggiani

Although considerable attention has been devoted to the development of models for isothermal, rate-independent plasticity, many high-consequence performance assessments involve viscoplastic processes that generate substantial heat. In…

Materials Science · Physics 2025-12-11 Reese E. Jones , Asghar Jadoon , D. Thomas Seidl , Jan N. Fuhg

Temperature is a widely used hyperparameter in various tasks involving neural networks, such as classification or metric learning, whose choice can have a direct impact on the model performance. Most of existing works select its value using…

Machine Learning · Computer Science 2022-10-19 Benjamin Chamand , Olivier Risser-Maroix , Camille Kurtz , Philippe Joly , Nicolas Loménie

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

We consider the setting where a collection of time series, modeled as random processes, evolve in a causal manner, and one is interested in learning the graph governing the relationships of these processes. A special case of wide interest…

Machine Learning · Computer Science 2016-08-30 Hossein Hosseini , Sreeram Kannan , Baosen Zhang , Radha Poovendran

Graph attention networks learn neighbor importance through data-dependent coefficients, but standard layers lack explicit control over unreliable feature dimensions and use fixed sharpness of attention coefficient distributions. This paper…

Machine Learning · Computer Science 2026-05-29 Zhongtian Ma , Hao Wu , Yexin Zhang , Qiaosheng Zhang , Zhen Wang

Simulated annealing is an effective and general means of optimization. It is in fact inspired by metallurgy, where the temperature of a material determines its behavior in thermodynamics. Likewise, in simulated annealing, the actions that…

Machine Learning · Computer Science 2020-07-01 Avrim Blum , Chen Dan , Saeed Seddighin

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

Reasoning models (e.g., DeepSeek-R1) generate long chains of thought to solve harder problems, but they often loop, repeating the same text at low temperatures or with greedy decoding. We study why this happens and what role temperature…

Little is known theoretically about the associative memory capabilities of neural networks in which information is encoded not only in the mean firing rate but also in the timing of firings. Particularly, in the case that the fraction of…

Disordered Systems and Neural Networks · Physics 2009-10-31 Toshio Aoyagi , Masaki Nomura

We study the influence of thermal fluctuations in the phase diagram of a recently introduced two-dimensional phase field crystal model with an external pinning potential. The model provides a continuum description of pinned lattice systems…

Materials Science · Physics 2008-09-10 J. A. P. Ramos , E. Granato , C. V. Achim , S. C. Ying , K. R. Elder , T. Ala-Nissila

We explore a one-to-one correspondence between a neural network (NN) and a statistical mechanical spin model where neurons are mapped to Ising spins and weights to spin-spin couplings. The process of training an NN produces a family of spin…

Disordered Systems and Neural Networks · Physics 2024-08-14 Richard Barney , Michael Winer , Victor Galitski

Early recordings of nervous conduction revealed a notable thermal signature associated with the electrical signal. The observed production and subsequent absorption of heat arise from physicochemical processes that occur at the cell…

Biological Physics · Physics 2020-02-19 Aymar C. L. de Lichtervelde , J. Pedro de Souza , Martin Z. Bazant

Glass-forming liquids exhibit slow dynamics below their melting temperatures, maintaining an amorphous structure reminiscent of normal liquids. Distinguishing microscopic structures in the supercooled and high-temperature regimes remains a…

Soft Condensed Matter · Physics 2025-07-14 Kohei Yoshikawa , Kentaro Yano , Shota Goto , Kang Kim , Nobuyuki Matubayasi

The resistivity around the ferromagnetic transition temperature in the double exchange model is studied by the Schwinger boson approach. The spatial spin correlation responsible for scattering of conduction electrons are taken into account…

Strongly Correlated Electrons · Physics 2007-05-23 Satoshi Ishizaka , Sumio Ishihara

Histogram-based template fits are the main technique used for estimating parameters of high energy physics Monte Carlo generators. Parametrized neural network reweighting can be used to extend this fitting procedure to many dimensions and…

High Energy Physics - Phenomenology · Physics 2021-04-08 Anders Andreassen , Shih-Chieh Hsu , Benjamin Nachman , Natchanon Suaysom , Adi Suresh

We introduce an efficient dynamical tree method that enables us, for the first time, to explicitly demonstrate thermo-remanent magnetization memory effect in a hierarchical energy landscape. Our simulation nicely reproduces the nontrivial…

Disordered Systems and Neural Networks · Physics 2023-03-21 Depei Zhang , Tianran Chen , Marija Vucelja , Seung-Hun Lee , Gia-Wei Chern