English
Related papers

Related papers: Intrinsic Complexity And Scaling Laws: From Random…

200 papers

We explore the concept of scaling invariance in a type of dynamical systems that undergo a transition from order (regularity) to disorder (chaos). The systems are described by a two-dimensional, nonlinear mapping that preserves the area in…

Chaotic Dynamics · Physics 2025-04-09 Edson D. Leonel

We consider the problem of detecting the dimensionality of entanglement with the use of correlations between measurements in randomized directions. First, exploiting the recently derived covariance matrix criterion for the entanglement…

Quantum Physics · Physics 2023-07-20 Shuheng Liu , Qiongyi He , Marcus Huber , Otfried Gühne , Giuseppe Vitagliano

We study scaling laws for singular perturbation problems associated with a class of two-dimensional martensitic phase transformations and deduce a domain dependence of the scaling law in the singular perturbation parameter. In these…

Analysis of PDEs · Mathematics 2024-05-10 Janusz Ginster , Angkana Rüland , Antonio Tribuzio , Barbara Zwicknagl

When data is plentiful, the loss achieved by well-trained neural networks scales as a power-law $L \propto N^{-\alpha}$ in the number of network parameters $N$. This empirical scaling law holds for a wide variety of data modalities, and may…

Machine Learning · Computer Science 2020-04-24 Utkarsh Sharma , Jared Kaplan

Size varies. Small things are typically more frequent than large things. The logarithm of frequency often declines linearly with the logarithm of size. That power law relation forms one of the common patterns of nature. Why does the…

Populations and Evolution · Quantitative Biology 2016-11-08 Steven A. Frank

The purpose of the present work is twofold. First, we develop the theory of general self-similar growth-fragmentation processes by focusing on martingales which appear naturally in this setting and by recasting classical results for…

Probability · Mathematics 2017-12-13 Jean Bertoin , Timothy Budd , Nicolas Curien , Igor Kortchemski

Abstract. The purpose of this paper is twofold. We introduce the theory of random tensors, which naturally extends the method of random averaging operators in our earlier work arXiv:1910.08492, to study the propagation of randomness under…

Analysis of PDEs · Mathematics 2020-06-17 Yu Deng , Andrea R. Nahmod , Haitian Yue

In cluster analysis, a common first step is to scale the data aiming to better partition them into clusters. Even though many different techniques have throughout many years been introduced to this end, it is probably fair to say that the…

Machine Learning · Computer Science 2023-05-30 Eduardo J. Aguilar , Valmir C. Barbosa

Scaling laws aim to accurately predict model performance across different scales. Existing scaling-law studies almost exclusively rely on cross-entropy as the evaluation metric. However, cross-entropy provides only a partial view of…

Machine Learning · Computer Science 2025-10-24 Baoqing Yue , Jinyuan Zhou , Zixi Wei , Jingtao Zhan , Qingyao Ai , Yiqun Liu

An intrinsic branching structure within the transient random walk on a strip in a random environment is revealed. As applications, which enables us to express the hitting time explicitly, and specifies the density of the absolutely…

Probability · Mathematics 2012-04-06 Wenming Hong , Meijuan Zhang

The scaling law, a cornerstone of Large Language Model (LLM) development, predicts improvements in model performance with increasing computational resources. Yet, while empirically validated, its theoretical underpinnings remain poorly…

Machine Learning · Computer Science 2026-02-03 Chiwun Yang

The alternate row and column scaling algorithm applied to a positive $n\times n$ matrix $A$ converges to a doubly stochastic matrix $S(A)$, sometimes called the \emph{Sinkhorn limit} of $A$. For every positive integer $n$, a two parameter…

Number Theory · Mathematics 2020-04-17 Melvyn B. Nathanson

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

We investigate the diffusion limited aggregation of particles executing persistent random walks. The scaling properties of both random walks and large aggregates are presented. The aggregates exhibit a crossover between ballistic and…

Statistical Mechanics · Physics 2011-07-28 Isadora R. Nogueira , Sidiney G. Alves , Silvio C. Ferreira

Very often, when studying topological or dynamical properties of random scale-free networks, it is tacitly assumed that degree-degree correlations are not present. However, simple constraints, such as the absence of multiple edges and…

Physics and Society · Physics 2016-03-23 J. B. de Brito , C. I. N. Sampaio Filho , A. A. Moreira , J. S. Andrade

We discuss the universal scaling laws of order parameter fluctuations in any system in which the second-order critical behavior can be identified. These scaling laws can be derived rigorously for equilibrium systems when combined with the…

Nuclear Theory · Physics 2007-05-23 R. Botet , M. Ploszajczak

We present an orthogonal expansion for real, function-regulated, second-order random measures over $\mathbb{R}^{d}$ with measure covariance. Such a expansion, which can be seen as a Karhunen-Lo\`eve decomposition, consists in a series of…

Probability · Mathematics 2025-06-23 Ricardo Carrizo Vergara

Longitudinal studies are often conducted to explore the cohort and age effects in many scientific areas. The within cluster correlation structure plays a very important role in longitudinal data analysis. This is because not only can an…

Statistics Theory · Mathematics 2008-12-18 Yan Sun , Wenyang Zhang , Howell Tong

Extensive Monte Carlo simulations are performed on a two-dimensional random field Ising model. The purpose of the present work is to study the disorder-induced changes in the properties of disordered spin systems. The time evolution of the…

Statistical Mechanics · Physics 2013-02-22 Suman Sinha , Pradipta Kumar Mandal

Permanents of random matrices with independent and identically distributed (i.i.d.) entries have extensively studied in literature and convergence and concentration properties are known under varying assumptions on the distributions. In…

Probability · Mathematics 2021-12-13 Ghurumuruhan Ganesan