English
Related papers

Related papers: Backpropagation in hyperbolic chaos via adjoint sh…

200 papers

The scaling hypothesis motivates the expansion of models past trillions of parameters as a path towards better performance. Recent significant developments, such as GPT-3, have been driven by this conjecture. However, as models scale-up,…

The problem of specification of self-adjoint operators corresponding to singular bilinear forms is very important for applications, such as quantum field theory and theory of partial differential equations with coefficient functions being…

Mathematical Physics · Physics 2007-05-23 Oleg Shvedov

Sequential propagation of chaos (SPoC) is a recently developed tool to solve mean-field stochastic differential equations and their related nonlinear Fokker-Planck equations. Based on the theory of SPoC, we present a new method (deepSPoC)…

Machine Learning · Computer Science 2024-08-30 Kai Du , Yongle Xie , Tao Zhou , Yuancheng Zhou

Mathematical models of physical systems are subject to many uncertainties such as measurement errors and uncertain initial and boundary conditions. After accounting for these uncertainties, it is often revealed that discrepancies between…

Computational Engineering, Finance, and Science · Computer Science 2018-05-23 Rebecca E Morrison , Todd A Oliver , Robert D Moser

Chaotic multiscale dynamical systems are common in many areas of science, one of the examples being the interaction of the low-frequency dynamics in the atmosphere with the fast turbulent weather dynamics. One of the key questions about…

Dynamical Systems · Mathematics 2016-04-08 Rafail V. Abramov

We present an auxiliary space theory that provides a unified framework for analyzing various iterative methods for solving linear systems that may be semidefinite. By interpreting a given iterative method for the original system as an…

Numerical Analysis · Mathematics 2025-09-10 Jongho Park , Jinchao Xu

We present an optimization framework for photo-acoustic tomography of brain based on a system of coupled equations that describe the propagation of sound waves in linear isotropic inhomogeneous and lossy elastic media with the absorption…

Numerical Analysis · Mathematics 2018-07-04 Ashkan Javaherian , Sean Holman

The scattering properties of any complex scattering potential, v:R -> C, can be obtained from the dynamics of a particular non-unitary two-level quantum system S_v. The application of the adiabatic approximation to S_v yields a…

Quantum Physics · Physics 2015-03-16 Ali Mostafazadeh

We develop a systematic analytical approach on linear and nonlinear pulse propagations in an open Lambda-type molecular system with Doppler broadening. In linear case, by using residue theorem and a spectrum decomposition method, we prove…

Optics · Physics 2014-12-09 Chaohua Tan , Chengjie Zhu , Guoxiang Huang

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

In this paper, applications of the connection between the soliton theory and the commuting nonselfadjoint operator theory, established by M.S. Liv\v{s}ic and Y. Avishai, are considered. An approach to the inverse scattering problem and to…

Functional Analysis · Mathematics 2019-09-24 Galina S. Borisova

The paper contributes to strengthening the relation between machine learning and the theory of differential equations. In this context, the inverse problem of fitting the parameters, and the initial condition of a differential equation to…

Machine Learning · Computer Science 2022-06-22 Imre Fekete , András Molnár , Péter L. Simon

Based on a coupling approach, we prove uniform in time propagation of chaos for weakly interacting mean-field particle systems with possibly non-convex confinement and interaction potentials. The approach is based on a combination of…

Probability · Mathematics 2018-05-30 Alain Durmus , Andreas Eberle , Arnaud Guillin , Raphael Zimmer

The transfer matrix of a possibly complex and energy-dependent scattering potential can be identified with the $S$-matrix of a two-level time-dependent non-Hermitian Hamiltonian H(t). We show that the application of the adiabatic…

Quantum Physics · Physics 2014-05-20 Ali Mostafazadeh

We extend the operations of shorting and parallel addition from the cone of bounded nonnegative selfadjoint operators in a Hilbert space to the set of all nonnegative selfadjoint linear relations. New properties of these operations and…

Functional Analysis · Mathematics 2019-12-03 Yu. M. Arlinskii

In the paper, we prove an analogue of the Kato-Rosenblum theorem in a semifinite von Neumann algebra. Let $\mathcal{M}$ be a countably decomposable, properly infinite, semifinite von Neumann algebra acting on a Hilbert space $\mathcal{H}$…

Operator Algebras · Mathematics 2017-06-30 Qihui Li , Junhao Shen , Rui Shi , Liguang Wang

We turn back to the well known problem of interpretation of the Schrodinger operator with the pseudopotential being the first derivative of the Dirac function. We show that the problem in its conventional formulation contains hidden…

Spectral Theory · Mathematics 2011-06-08 Yuriy D. Golovaty , Stepan S. Man'ko

We consider time-periodically perturbed 1D Hamiltonian systems possessing one or more separatrices. If the perturbation is weak, then the separatrix chaos is most developed when the perturbation frequency lies in the logarithmically small…

Chaotic Dynamics · Physics 2015-05-13 S. M. Soskin , R. Mannella , O. M. Yevtushenko , I. A. Khovanov , P. V. E. McClintock

Backpropagation through nonlinear neurons is an outstanding challenge to the field of optical neural networks and the major conceptual barrier to all-optical training schemes. Each neuron is required to exhibit a directionally dependent…

Emerging Technologies · Computer Science 2021-03-22 Xianxin Guo , Thomas D. Barrett , Zhiming M. Wang , A. I. Lvovsky

Compositional observations are an increasingly prevalent data source in spatial statistics. Analysis of such data is typically done on log-ratio transformations or via Dirichlet regression. However, these approaches often make unnecessarily…

Methodology · Statistics 2025-05-27 Michael R. Schwob , Mevin B. Hooten , Nicholas M. Calzada , Timothy H. Keitt