English
Related papers

Related papers: Wide stable neural networks: Sample regularity, fu…

200 papers

Heavy-tailed distributions naturally occur in many real life problems. Unfortunately, it is typically not possible to compute inference in closed-form in graphical models which involve such heavy-tailed distributions. In this work, we…

Machine Learning · Computer Science 2011-03-22 Danny Bickson , Carlos Guestrin

In this paper, we establish universal approximation theorems for neural networks applied to general nonlinear ill-posed operator equations. In addition to the approximation error, the measurement error is also taken into account in our…

Numerical Analysis · Mathematics 2025-11-21 Lan Wang , Qiao Zhu , Bangti Jin , Ye Zhang

In this paper, we investigate the approximation problem for functions in Gaussian Sobolev spaces $W^s_p(\mathbb{R}^d, \gamma)$ of smoothness $s > 0$, where the approximation error is measured in the Gaussian Lebesgue space…

Functional Analysis · Mathematics 2026-04-21 Van Kien Nguyen

This study aims to develop the limit theorems on the sample autocovariances and sample autocorrelations for certain stationary infinitely divisible processes. We consider the case where the infinitely divisible process has heavy tail…

Probability · Mathematics 2014-06-17 Takashi Owada

Weak convergence of maxima of dependent sequences of identically distributed continuous random variables is studied under normalizing sequences arising as subsequences of the normalizing sequences from an associated iid sequence. This…

Probability · Mathematics 2024-05-07 Klaus Herrmann , Marius Hofert , Johanna G. Neslehova

Recently the theory of widths of Kolmogorov-Gelfand has received a great deal of interest due to its close relationship with the newly born area of Compressive Sensing in Signal Processing. However fundamental problems of the theory of…

Numerical Analysis · Mathematics 2011-03-11 Ognyan Kounchev

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

We study the Finite-Dimensional Distributions (FDDs) of deep neural networks with randomly initialized weights that have finite-order moments. Specifically, we establish Gaussian approximation bounds in the Wasserstein-$1$ norm between the…

Machine Learning · Statistics 2026-03-05 Krishnakumar Balasubramanian , Nathan Ross

Although asymptotic analyses of undirected network models based on degree sequences have started to appear in recent literature, it remains an open problem to study statistical properties of directed network models. In this paper, we…

Statistics Theory · Mathematics 2016-01-13 Ting Yan , Chenlei Leng , Ji Zhu

The Bayesian perspective on inverse problems has attracted much mathematical attention in recent years. Particular attention has been paid to Bayesian inverse problems (BIPs) in which the parameter to be inferred lies in an…

Probability · Mathematics 2017-10-17 T. J. Sullivan

Scale-free networks play a fundamental role in the study of complex networks and various applied fields due to their ability to model a wide range of real-world systems. A key characteristic of these networks is their degree distribution,…

Physics and Society · Physics 2025-01-14 Nixon Jerez-Lillo , Francisco A. Rodrigues , Paulo H. Ferreira , Pedro L. Ramos

We consider the evolution of scale-free networks according to preferential attachment schemes and show the conditions for which the exponent characterizing the degree distribution is bounded by upper and lower values. Our framework is an…

Statistical Finance · Quantitative Finance 2013-01-07 João P. da Cruz , Pedro G. Lind

We study the asymptotic spectral distribution of the conjugate kernel random matrix $YY^\top$, where $Y= f(WX)$ arises from a two-layer neural network model. We consider the setting where $W$ and $X$ are random rectangular matrices with…

Probability · Mathematics 2026-01-07 Alice Guionnet , Vanessa Piccolo

In this paper, we develop a wavelet-based theoretical framework for analyzing the universal approximation capabilities of neural networks over a wide range of activation functions. Leveraging wavelet frame theory on the spaces of…

Machine Learning · Computer Science 2025-04-24 Youngmi Hur , Hyojae Lim , Mikyoung Lim

The remarkable successes of neural networks in a huge variety of inverse problems have fueled their adoption in disciplines ranging from medical imaging to seismic analysis over the past decade. However, the high dimensionality of such…

Machine Learning · Statistics 2023-10-11 Santhosh Karnik , Rongrong Wang , Mark Iwen

Recent work has shown that the prior over functions induced by a deep Bayesian neural network (BNN) behaves as a Gaussian process (GP) as the width of all layers becomes large. However, many BNN applications are concerned with the BNN…

Machine Learning · Statistics 2020-11-30 Jiri Hron , Yasaman Bahri , Roman Novak , Jeffrey Pennington , Jascha Sohl-Dickstein

This article studies the infinite-width limit of deep feedforward neural networks whose weights are dependent, and modelled via a mixture of Gaussian distributions. Each hidden node of the network is assigned a nonnegative random variable…

Machine Learning · Statistics 2025-02-06 Hoil Lee , Fadhel Ayed , Paul Jung , Juho Lee , Hongseok Yang , François Caron

This paper presents the asymptotic theory for nondegenerate $U$-statistics of high frequency observations of continuous It\^{o} semimartingales. We prove uniform convergence in probability and show a functional stable central limit theorem…

Probability · Mathematics 2014-09-10 Mark Podolskij , Christian Schmidt , Johanna F. Ziegel

We delve into the statistical properties of regions within complex networks that are distant from vertices with high centralities, such as hubs or highly connected clusters. These remote regions play a pivotal role in shaping the asymptotic…

Physics and Society · Physics 2023-10-23 J. G. Oliveira , S. N. Dorogovtsev , J. F. F. Mendes

This paper addresses inverse problems (in a broad sense) for two classes of multivariate neural network (NN) operators, with particular emphasis on saturation results, and both analytical and semi-analytical inverse theorems. One of the key…

Functional Analysis · Mathematics 2025-05-13 Danilo Costarelli