English
Related papers

Related papers: The high-dimensional asymptotics of first order me…

200 papers

Randomized value functions offer a promising approach towards the challenge of efficient exploration in complex environments with high dimensional state and action spaces. Unlike traditional point estimate methods, randomized value…

Machine Learning · Computer Science 2019-07-02 Ahmed Touati , Harsh Satija , Joshua Romoff , Joelle Pineau , Pascal Vincent

We consider a quite general problem concerning a linear free oscillation of a discrete mass-spring-damper system. This discrete sub-system is embedded into a one-dimensional continuum medium described by the linear telegraph equation. In a…

Classical Physics · Physics 2024-11-15 Serge N. Gavrilov , Ilya O. Poroshin , Ekaterina V. Shishkina , Yulia A. Mochalova

Driven Langevin processes have appeared in a variety of fields due to the relevance of natural phenomena having both deterministic and stochastic effects. The stochastic currents and fluxes in these systems provide a convenient set of…

Chemical Physics · Physics 2017-01-04 Michael J. Catanzaro , Vladimir Y. Chernyak , John R. Klein

We discuss asymptotics for large random planar maps under the assumption that the distribution of the degree of a typical face is in the domain of attraction of a stable distribution with index $\alpha\in(1,2)$. When the number $n$ of…

Probability · Mathematics 2017-08-23 Jean-François Le Gall , Grégory Miermont

General first order methods (GFOMs), including various gradient descent and AMP algorithms, constitute a broad class of iterative algorithms in modern statistical learning problems. Some GFOMs also serve as constructive proof devices,…

Statistics Theory · Mathematics 2025-05-30 Qiyang Han

We establish central and non-central limit theorems for sequences of functionals of the Gaussian output of an infinitely-wide random neural network on the d-dimensional sphere . We show that the asymptotic behaviour of these functionals as…

Probability · Mathematics 2026-04-24 Simmaco Di Lillo , Leonardo Maini , Domenico Marinucci

Nonparametric estimation of the mean and covariance functions is ubiquitous in functional data analysis and local linear smoothing techniques are most frequently used. Zhang and Wang (2016) explored different types of asymptotic properties…

Statistics Theory · Mathematics 2025-01-28 Shaojun Guo , Dong Li , Xinghao Qiao , Yizhu Wang

The Cahn-Hilliard equation with an externally-prescribed chaotic shear flow is studied in two and three dimensions. The main goal is to compare and contrast the phase separation in two and three dimensions, using high-resolution numerical…

Fluid Dynamics · Physics 2014-12-23 Lennon O'Naraigh , Selma Shun , Aurore Naso

Recent evidence has shown the existence of a so-called double-descent and even triple-descent behavior for the generalization error of deep-learning models. This important phenomenon commonly appears in implemented neural network…

Machine Learning · Computer Science 2021-10-25 Antoine Bodin , Nicolas Macris

Modeling the evolution of high-dimensional systems from limited snapshot observations at irregular time points poses a significant challenge in quantitative biology and related fields. Traditional approaches often rely on dimensionality…

Machine Learning · Computer Science 2025-08-07 Justin Lee , Behnaz Moradijamei , Heman Shakeri

Here we study the long time behavior of an advection-diffusion equation with a general time varying (including random) shear flow imposing no-flux boundary conditions on channel walls. We derive the asymptotic approximation of the scalar…

Fluid Dynamics · Physics 2021-09-14 Lingyun. Ding , Richard M. McLaughlin

We consider the diffusion of independent particles experiencing random accelerations by a space- and time-dependent force as well as viscous damping. This model can exhibit several asymptotic behaviours, depending upon the limiting cases…

Chaotic Dynamics · Physics 2012-06-13 B. Mehlig , M. Wilkinson , V. Bezuglyy , K. Gustavsson , K. Nakamura

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. In this work, we propose…

Optimization and Control · Mathematics 2024-10-01 Yue Xie , Jiawen Bi , Hongcheng Liu

A succesful method to describe the asymptotic behavior of a discrete time stochastic process governed by some recursive formula is to relate it to the limit sets of a well chosen mean differential equation. Under an attainability condition,…

Probability · Mathematics 2011-01-19 Mathieu Faure , Gregory Roth

We study the asymptotic behavior of branching diffusion processes in periodic media. For a super-critical branching process, we distinguish two types of behavior for the normalized number of particles in a bounded domain, depending on the…

Probability · Mathematics 2020-03-05 Pratima Hebbar , Leonid Koralov , James Nolen

Performance accuracy of the Euclidean Distance Discriminant rule (EDDR) is studied in the high-dimensional asymptotic framework which allows the dimensionality to exceed sample size. Under mild assumptions on the traces of the covariance…

Statistics Theory · Mathematics 2014-03-04 H. Watanabe , M. Hyodo , T. Seo , T. Pavlenko

In our companion work \cite{Stojnicl1RegPosasymldp} we revisited random under-determined linear systems with sparse solutions. The main emphasis was on the performance analysis of the $\ell_1$ heuristic in the so-called asymptotic regime,…

Optimization and Control · Mathematics 2016-12-20 Mihailo Stojnic

Accelerated gradient descent iterations are widely used in optimization. It is known that, in the continuous-time limit, these iterations converge to a second-order differential equation which we refer to as the accelerated gradient flow.…

Optimization and Control · Mathematics 2020-06-16 Mohammad Farazmand

Understanding the behavior of stochastic gradient methods is a central problem in modern machine learning. Recent work has highlighted diagonal linear networks as a simplified yet expressive setting for analyzing the optimization and…

Optimization and Control · Mathematics 2026-05-19 Begoña García Malaxechebarría , Courtney Paquette , Maryam Fazel , Dmitriy Drusvyatskiy

We consider a finite collection of reinforced stochastic processes with a general network-based interaction among them. We provide sufficient and necessary conditions in order to have some form of almost sure asymptotic synchronization,…

Probability · Mathematics 2025-06-11 Giacomo Aletti , Irene Crimaldi , Andrea Ghiglietti