English
Related papers

Related papers: Unlocked Backpropagation using Wave Scattering

200 papers

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

In both machine learning and in computational neuroscience, plasticity in functional neural networks is frequently expressed as gradient descent on a cost. Often, this imposes symmetry constraints that are difficult to reconcile with local…

Neurons and Cognition · Quantitative Biology 2026-04-09 Timo Gierlich , Andreas Baumbach , Akos F. Kungl , Kevin Max , Mihai A. Petrovici

In this paper we develop a time reversal method for the radiative transport equation to solve two problems: an inverse problem for the recovery of an initial condition from boundary measurements, and the exact boundary controllability of…

Analysis of PDEs · Mathematics 2013-08-06 Sebastian Acosta

The backpropagation algorithm, or backprop, is a widely utilized optimization technique in deep learning. While there's growing evidence suggesting that models trained with backprop can accurately explain neuronal data, no backprop-like…

Machine Learning · Computer Science 2024-05-28 Gananath R

We review recent progress in analysing wave scattering in systems with both intrinsic chaos and/or disorder and internal losses, when the scattering matrix is no longer unitary. By mapping the problem onto a nonlinear supersymmetric…

Mesoscale and Nanoscale Physics · Physics 2007-05-23 Y. V. Fyodorov , D. V. Savin , H. -J. Sommers

We study online learning in \emph{constrained MDPs} (CMDPs), focusing on the goal of attaining sublinear strong regret and strong cumulative constraint violation. Differently from their standard (weak) counterparts, these metrics do not…

Machine Learning · Computer Science 2024-10-04 Francesco Emanuele Stradi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Backpropagation through nonlinear neurons is an outstanding challenge to the field of optical neural networks and the major conceptual barrier to all-optical training schemes. Each neuron is required to exhibit a directionally dependent…

Emerging Technologies · Computer Science 2021-03-22 Xianxin Guo , Thomas D. Barrett , Zhiming M. Wang , A. I. Lvovsky

We consider the following geometric optics problem: Construct a system of two reflectors which transforms a spherical wavefront generated by a point source into a beam of parallel rays. This beam has a prescribed intensity distribution. We…

Analysis of PDEs · Mathematics 2015-05-13 Tilmann Glimm

The Forward-Forward algorithm is an alternative learning method which consists of two forward passes rather than a forward and backward pass employed by backpropagation. Forward-Forward networks employ layer local loss functions which are…

Machine Learning · Computer Science 2025-04-16 Reece Adamson

We consider the problem of controlling an unknown linear dynamical system in the presence of (nonstochastic) adversarial perturbations and adversarial convex loss functions. In contrast to classical control, the a priori determination of an…

Machine Learning · Computer Science 2020-01-22 Elad Hazan , Sham M. Kakade , Karan Singh

The backpropagation of error algorithm used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backward updates and non-local computations, which make it challenging to…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Beren Millidge , Tommaso Salvatori , Yuhang Song , Rafal Bogacz , Thomas Lukasiewicz

Metasurfaces are subwavelength-structured artificial media that can shape and localize electromagnetic waves in unique ways. The inverse design of these devices is a non-convex optimization problem in a high dimensional space, making global…

Computational Physics · Physics 2019-11-22 Jiaqi Jiang , Jonathan A. Fan

A general framework for determining fundamental bounds in nanophotonics is introduced in this paper. The theory is based on convex optimization of dual problems constructed from operators generated by electromagnetic integral equations. The…

Optics · Physics 2021-06-23 M. Gustafsson , K. Schab , L. Jelinek , M. Capek

The paper is devoted to the optimal control of a system with two time-scales, in a regime when the limit equation is not of averaging type but, in the spirit of Wong-Zakai principle, it is a stochastic differential equation for the slow…

Optimization and Control · Mathematics 2024-11-26 Franco Flandoli , Giuseppina Guatteri , Umberto Pappalettera , Gianmario Tessitore

We propose a distributed algorithm for controlling traffic signals, allowing constraints such as periodic switching sequences of phases and minimum and maximum green time to be incorporated. Our algorithm is adapted from backpressure…

Systems and Control · Computer Science 2014-07-07 Tichakorn Wongpiromsarn , Tawit Uthaicharoenpong , Emilio Frazzoli , Yu Wang , Danwei Wang

We propose a mathematical framework to systematically explore the propagation properties of a class of continuous in time nonlinear neural network models comprising a hierarchy of processing areas, mutually connected according to the…

Analysis of PDEs · Mathematics 2025-05-15 Andrea Alamia , Léa Dalliès , Grégory Faye , Rufin Vanrullen

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

The multichannel generalization of the theory of spectral, scattering and decay control is presented. New universal algorithms of construction of complex quantum systems with given properties are suggested. Particularly, transformations of…

Quantum Physics · Physics 2009-11-07 V. M. Chabanov , B. N. Zakhariev , I. V. Amirkhanov

In this work, we conduct a comparative study on two deep unfolding mechanisms to efficiently perform power control in the next generation wireless networks. The power control problem is formulated as energy efficiency over multiple…

Networking and Internet Architecture · Computer Science 2024-03-29 Abuzar B. M. Adam , Mohammed A. M. Elhassan , Elhadj Moustapha Diallo

Inverse medium scattering is an ill-posed, nonlinear wave-based imaging problem arising in medical imaging, remote sensing, and non-destructive testing. Machine learning (ML) methods offer increased inference speed and flexibility in…

Computational Physics · Physics 2025-12-12 Olivia Tsang , Owen Melia , Vasileios Charisopoulos , Jeremy Hoskins , Yuehaw Khoo , Rebecca Willett