Related papers: Diluted banded random matrices: Scaling behavior o…
We consider the eigenvalues of a fixed, non-normal matrix subject to a small additive perturbation. In particular, we consider the case when the fixed matrix is a banded Toeplitz matrix, where the bandwidth is allowed to grow slowly with…
Empirical scaling laws describe how test loss and other performance metrics depend on model size, dataset size, and compute. While such laws are consistent within specific regimes, apparently distinct scaling behaviors have been reported…
In homogenization theory and multiscale modeling, typical functions satisfy the scaling law $f^{\epsilon}(x) = f(x,x/\epsilon)$, where $f$ is periodic in the second variable and $\epsilon$ is the smallest relevant wavelength,…
We investigate a random normal matrix model with eigenvalues forced to be in the droplet, the support of the equilibrium measure associated with an external field. For radially symmetric external fields, we show that the fluctuations of the…
Randomized matrix sparsification has proven to be a fruitful technique for producing faster algorithms in applications ranging from graph partitioning to semidefinite programming. In the decade or so of research into this technique, the…
In this paper we construct a class of random matrix ensembles labelled by a real parameter $\alpha \in (0,1)$, whose eigenvalue density near zero behaves like $|x|^\alpha$. The eigenvalue spacing near zero scales like $1/N^{1/(1+\alpha)}$…
We introduce a new disorder regime for directed polymers in dimension $1+1$ that sits between the weak and strong disorder regimes. We call it the intermediate disorder regime. It is accessed by scaling the inverse temperature parameter…
Using one-dimensional tight-binding lattices and an analytical expression based on the Green's matrix, we show that anomalous minimum of the localization length near an isolated flat band, previously found for evanescent waves in a…
In this text, we consider an N by N random matrix X such that all but o(N) rows of X have W non identically zero entries, the other rows having lass than $W$ entries (such as, for example, standard or cyclic band matrices). We always…
We study the spectral norm of matrices M that can be factored as M=BA, where A is a random matrix with independent mean zero entries, and B is a fixed matrix. Under the (4+epsilon)-th moment assumption on the entries of A, we show that the…
We study the fluctuations of the area $A=\int_0^T x(t) dt$ under a one-dimensional Brownian motion $x(t)$ in a trapping potential $\sim |x|$, at long times $T\to\infty$. We find that typical fluctuations of $A$ follow a Gaussian…
We study random normal matrix models whose eigenvalues tend to be distributed within a narrow "band" around the unit circle of width proportional to $\frac1n$, where $n$ is the size of matrices. For general radially symmetric potentials…
Scaling laws, a defining feature of deep learning, reveal a striking power-law improvement in model performance with increasing dataset and model size. Yet, their mathematical origins, especially the scaling exponent, have remained elusive.…
The Thomson scattering spectra by an electron moving in the laser-magnetic resonance acceleration regime are computed numerically and analytically. The dependence of fundamental frequency on the laser intensity and magnetic resonance…
We consider Hermitian and symmetric random band matrices $H$ in $d \geq 1$ dimensions. The matrix elements $H_{xy}$, indexed by $x,y \in \Lambda \subset \Z^d$, are independent and their variances satisfy $\sigma_{xy}^2:=\E \abs{H_{xy}}^2 =…
We study asymptotics of the spectral measure of a randomly chosen partial automorphism of a rooted tree. To every partial automorphism $x$ we assign its action matrix $A_x$. It is shown that the uniform distribution on eigenvalues of $A_x$…
The scaling function $F(s)$ in detrended fluctuation analysis (DFA) scales as $F(s)\sim s^{H}$ for stochastic processes with Hurst exponents $H$. We prove this scaling law for both stationary stochastic processes with $0<H<1$, and…
We introduce a model for neural scaling laws under sparse activations. In the model, test loss is often dominated by rare coordinates that are never observed in the training input. This mechanism induces a novel bottleneck absent from dense…
In systems exhibiting fluctuation-dominated phase ordering, a single order parameter does not suffice to characterize the order, and it is necessary to monitor a larger set. For hard-core sliding particles (SP) on a fluctuating surface and…
Neural scaling laws describe how the performance of deep neural networks scales with key factors such as training data size, model complexity, and training time, often following power-law behaviors over multiple orders of magnitude. Despite…