中文
相关论文

相关论文: Symmetric Equilibrium Propagation for Thermodynami…

200 篇论文

We introduce Equilibrium Propagation, a learning framework for energy-based models. It involves only one kind of neural computation, performed in both the first phase (when the prediction is made) and the second phase of training (after the…

机器学习 · 计算机科学 2017-03-30 Benjamin Scellier , Yoshua Bengio

Equilibrium Propagation (EP) is a biologically-inspired algorithm for convergent RNNs with a local learning rule that comes with strong theoretical guarantees. The parameter updates of the neural network during the credit assignment phase…

神经与进化计算 · 计算机科学 2020-06-09 Axel Laborieux , Maxence Ernoult , Benjamin Scellier , Yoshua Bengio , Julie Grollier , Damien Querlioz

Diffusion-model inference and overdamped Langevin dynamics are formally identical. A physical substrate that encodes the score function therefore equilibrates to the correct output by thermodynamics alone, requiring no digital arithmetic…

机器学习 · 计算机科学 2026-04-17 Aditi De

Equilibrium Propagation (EP) is a biologically-inspired counterpart of Backpropagation Through Time (BPTT) which, owing to its strong theoretical guarantees and the locality in space of its learning rule, fosters the design of…

机器学习 · 计算机科学 2021-01-15 Axel Laborieux , Maxence Ernoult , Benjamin Scellier , Yoshua Bengio , Julie Grollier , Damien Querlioz

We propose a method for training dynamical systems governed by Lagrangian mechanics using Equilibrium Propagation. Our approach extends Equilibrium Propagation - initially developed for energy-based models - to dynamical trajectories by…

混沌动力学 · 物理学 2025-07-21 Serge Massar

This work establishes that a physical system can perform statistical learning without gradient computations, via an Agnostic Equilibrium Propagation (Aeqprop) procedure that combines energy minimization, homeostatic control, and nudging…

机器学习 · 计算机科学 2022-05-31 Benjamin Scellier , Siddhartha Mishra , Yoshua Bengio , Yann Ollivier

Computing gradients of a cost function is central to design-based optimization and machine learning algorithms. Equilibrium propagation provides an exact method to compute gradients in hardware by exploiting the inherent physical laws. The…

无序系统与神经网络 · 物理学 2025-08-11 Marc Berneman , Daniel Hexner

We introduce Gradient Equilibrium Propagation (GradEP), a mechanism that extends Equilibrium Propagation (EP) to train energy gradients rather than energy minima, enabling EP to be applied to tasks where the learning objective depends on…

无序系统与神经网络 · 物理学 2026-05-26 Alex Gower

Backpropagation learning algorithm, the workhorse of modern artificial intelligence, is notoriously difficult to implement in physical neural networks. Equilibrium Propagation (EP) is an alternative with comparable efficiency and strong…

机器学习 · 计算机科学 2026-03-17 Karol Sajnok , Michał Matuszewski

Recurrent Backpropagation and Equilibrium Propagation are supervised learning algorithms for fixed point recurrent neural networks which differ in their second phase. In the first phase, both algorithms converge to a fixed point which…

机器学习 · 计算机科学 2018-05-24 Benjamin Scellier , Yoshua Bengio

Finding spike-based learning algorithms that can be implemented within the local constraints of neuromorphic systems, while achieving high accuracy, remains a formidable challenge. Equilibrium Propagation is a promising alternative to…

神经与进化计算 · 计算机科学 2021-02-18 Erwann Martin , Maxence Ernoult , Jérémie Laydevant , Shuai Li , Damien Querlioz , Teodora Petrisor , Julie Grollier

We liberate Equilibrium Propagation (EP) from the limit of infinitesimal perturbations by establishing a finite-nudge foundation for local credit assignment. By modeling network states as Gibbs-Boltzmann distributions rather than…

机器学习 · 计算机科学 2025-12-01 Elon Litman

Physical systems that naturally perform energy descent offer a direct route to accelerating machine learning. Oscillator Ising Machines (OIMs) exemplify this idea: their GHz-frequency dynamics mirror both the optimization of energy-based…

机器学习 · 计算机科学 2025-11-18 Alex Gower

Equilibrium propagation (EP) is a training framework for energy-based systems, i.e. systems whose physics minimizes an energy function. EP has been explored in various classical physical systems such as resistor networks, elastic networks,…

量子物理 · 物理学 2024-06-04 Benjamin Scellier

Equilibrium Propagation (EP) is a physics-inspired learning algorithm that uses stationary states of a dynamical system both for inference and learning. In its original formulation it is limited to conservative systems, $\textit{i.e.}$ to…

机器学习 · 计算机科学 2026-02-04 Antonino Emanuele Scurria , Dimitri Vanden Abeele , Bortolo Matteo Mognetti , Serge Massar

We introduce a principled method to train end-to-end analog neural networks by stochastic gradient descent. In these analog neural networks, the weights to be adjusted are implemented by the conductances of programmable resistive devices…

神经与进化计算 · 计算机科学 2020-06-11 Jack Kendall , Ross Pantone , Kalpana Manickavasagam , Yoshua Bengio , Benjamin Scellier

Equilibrium Propagation (EP) is a biologically inspired local learning rule first proposed for convergent recurrent neural networks (CRNNs), in which synaptic updates depend only on neuron states from two distinct phases. EP estimates…

机器学习 · 计算机科学 2026-05-11 Jiaqi Lin , Malyaban Bal , Abhronil Sengupta

Equilibrium Propagation (EP) is a supervised learning algorithm that trains network parameters using local neuronal activity. This is in stark contrast to backpropagation, where updating the parameters of the network requires significant…

机器学习 · 计算机科学 2025-04-01 Jonathan Peters , Philippe Talatchian

The widespread adoption of machine learning and artificial intelligence in all branches of science and technology has created a need for energy-efficient, alternative hardware platforms. While such neuromorphic approaches have been proposed…

量子物理 · 物理学 2024-06-11 Clara C. Wanjura , Florian Marquardt

Equilibrium Propagation (EP) is an algorithm intrinsically adapted to the training of physical networks, thanks to the local updates of weights given by the internal dynamics of the system. However, the construction of such a hardware…

神经与进化计算 · 计算机科学 2021-04-20 Jérémie Laydevant , Maxence Ernoult , Damien Querlioz , Julie Grollier
‹ 上一页 1 2 3 10 下一页 ›