English
Related papers

Related papers: The high-dimensional asymptotics of first order me…

200 papers

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

We approximate stochastic processes in finite dimension by dynamical systems. We provide trajectorial estimates which are uniform with respect to the initial condition for a well chosen distance. This relies on some non-expansivity property…

Probability · Mathematics 2017-01-11 Vincent Bansaye

The reconstruction and prediction of full-state flows from sparse data are of great scientific and engineering significance yet remain challenging, especially in applications where data are sparse and/or subjected to noise. To this end,…

Fluid Dynamics · Physics 2023-12-08 Jiaxin Wu , Dunhui Xiao , Min Luo

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

Machine Learning · Computer Science 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

Reduced-order modelling and system identification can help us figure out the elementary degrees of freedom and the underlying mechanisms from the high-dimensional and nonlinear dynamics of fluid flow. Machine learning has brought new…

Fluid Dynamics · Physics 2021-04-13 Nan Deng , Luc R. Pastur , Bernd R. Noack

In this work we study of the dynamics of large size random neural networks. Different methods have been developed to analyse their behavior, most of them rely on heuristic methods based on Gaussian assumptions regarding the fluctuations in…

Disordered Systems and Neural Networks · Physics 2018-12-19 A. Crisanti , H. Sompolinsky

Standard dynamical systems theory is centred around the coordinate-invariant asymptotic-time properties of autonomous systems. We identify three limitations of this approach. Firstly, we discuss how the traditional approach cannot take into…

Adaptation and Self-Organizing Systems · Physics 2018-10-10 Julian Newman , Maxime Lucas , Aneta Stefanovska

Understanding the inductive bias and generalization properties of large overparametrized machine learning models requires to characterize the dynamics of the training algorithm. We study the learning dynamics of large two-layer neural…

Machine Learning · Statistics 2025-10-30 Andrea Montanari , Pierfrancesco Urbani

Dynamical processes can be classified in various ways as deterministic or stochastic, and continuous or discrete time. All these types can be studied by the path-spaces they generate, and stationary measures on that path-space. Such…

Dynamical Systems · Mathematics 2026-03-19 Suddhasattwa Das

We analyse second order (in Riemann curvature) geometric flows (un-normalised) on locally homogeneous three manifolds and look for specific features through the solutions (analytic whereever possible, otherwise numerical) of the evolution…

Differential Geometry · Mathematics 2015-04-13 Sanjit Das , Kartik Prabhu , Sayan Kar

We consider the motion of a particle in a periodic two dimensional flow perturbed by small (molecular) diffusion. The flow is generated by a divergence free zero mean vector field. The long time behavior corresponds to the behavior of the…

Probability · Mathematics 2009-03-04 L. Koralov

We study central limit theorems for a totally asymmetric, one-dimensional interacting random system. The models we work with are the Aldous-Diaconis-Hammersley process and the related stick model. The A-D-H process represents a particle…

Probability · Mathematics 2009-11-07 Timo Seppalainen

We propose a high dimensional generalisation of the standard Klein bottle, going beyond those considered previously. We address the problem of generating continuous scalar fields (distributions) and dynamical systems (flows) on such state…

Dynamical Systems · Mathematics 2024-12-18 Peter Grindrod , Ka Man Yim

Stochastic gradient descent is a classic algorithm that has gained great popularity especially in the last decades as the most common approach for training models in machine learning. While the algorithm has been well-studied when…

Machine Learning · Statistics 2025-09-09 Jose Blanchet , Aleksandar Mijatović , Wenhao Yang

The filtering distribution is a time-evolving probability distribution on the state of a dynamical system, given noisy observations. We study the large-time asymptotics of this probability distribution for discrete-time, randomly…

Dynamical Systems · Mathematics 2014-11-25 D. Sanz-Alonso , A. M. Stuart

In this work, we present a new approach to analyze the gradient flow for a positive semi-definite matrix denoising problem in an extensive-rank and high-dimensional regime. We use recent linear pencil techniques of random matrix theory to…

Machine Learning · Statistics 2023-03-17 Antoine Bodin , Nicolas Macris

We study the distributional properties of the linear discriminant function under the assumption of normality by comparing two groups with the same covariance matrix but different mean vectors. A stochastic representation for the…

Statistics Theory · Mathematics 2017-05-09 Taras Bodnar , Stepan Mazur , Edward Ngailo , Nestor Parolya

We consider $d>4$-dimensional space-times which are asymptotically flat at spatial infinity and show that, in the first order framework, the action principle is well-defined \emph{without the need of infinite counter terms.} It naturally…

General Relativity and Quantum Cosmology · Physics 2008-11-26 Abhay Ashtekar , David Sloan

A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains. The proposed approach is able to formally verify discrete-time stochastic dynamical systems against temporal logic…

Systems and Control · Electrical Eng. & Systems 2024-03-11 Zhi Zhang , Chenyu Ma , Saleh Soudijani , Sadegh Soudjani

Consider $d$ dependent change point tests, each based on a CUSUM-statistic. We provide an asymptotic theory that allows us to deal with the maximum over all test statistics as both the sample size $n$ and $d$ tend to infinity. We achieve…

Statistics Theory · Mathematics 2017-12-07 Moritz Jirak