English
Related papers

Related papers: Bounds for Rademacher Processes via Chaining

200 papers

This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a…

Machine Learning · Computer Science 2022-11-04 Ruoxi Jiang , Rebecca Willett

We develop refinements of the Levenshtein bound in $q$-ary Hamming spaces by taking into account the discrete nature of the distances versus the continuous behavior of certain parameters used by Levenshtein. The first relevant cases are…

Information Theory · Computer Science 2018-01-09 Peter Boyvalenkov , Danyo Danev , Maya Stoyanova

Empirical processes for stationary, causal sequences are considered. We establish empirical central limit theorems for classes of indicators of left half lines, absolutely continuous functions and piecewise differentiable functions. Sample…

Statistics Theory · Mathematics 2007-06-13 Wei Biao Wu

We will consider multivariate stochastic processes indexed either by vertices or pairs of vertices of a dynamic network. Under a dynamic network we understand a network with a fixed vertex set and an edge set which changes randomly over…

Statistics Theory · Mathematics 2024-07-15 Alexander Kreiss

This paper considers the problem of testing whether there exists a non-negative solution to a possibly under-determined system of linear equations with known coefficients. This hypothesis testing problem arises naturally in a number of…

Econometrics · Economics 2021-09-16 Zheng Fang , Andres Santos , Azeem M. Shaikh , Alexander Torgovitsky

Deep neural networks generalize well despite being heavily overparameterized, in apparent contradiction with classical learning theory based on uniform convergence over fixed hypothesis spaces. Uniform bounds over the entire parameter space…

Machine Learning · Statistics 2026-05-15 Hubert Leroux , Jean Marcus , Julien Roger

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

Methodology · Statistics 2019-07-16 Darren Homrighausen , Daniel J. McDonald

We investigate approaches to regularisation during fine-tuning of deep neural networks. First we provide a neural network generalisation bound based on Rademacher complexity that uses the distance the weights have moved from their initial…

Machine Learning · Statistics 2021-01-18 Henry Gouk , Timothy M. Hospedales , Massimiliano Pontil

We consider stochastic processes with (or without) memory whose evolution is encoded by a finite or infinite rooted tree. The main goal is to compare the entropy rates of a given base process and a second one, to be considered as a…

Information Theory · Computer Science 2017-04-21 Thomas Hirschler , Wolfgang Woess

We show generalisation error bounds for deep learning with two main improvements over the state of the art. (1) Our bounds have no explicit dependence on the number of classes except for logarithmic factors. This holds even when formulating…

Machine Learning · Computer Science 2021-02-23 Antoine Ledent , Waleed Mustafa , Yunwen Lei , Marius Kloft

We establish strong invariance principles for sums of stationary and ergodic processes with nearly optimal bounds. Applications to linear and some nonlinear processes are discussed. Strong laws of large numbers and laws of the iterated…

Probability · Mathematics 2011-11-10 Wei Biao Wu

We extend the restrictiveness measure of Fudenberg, Gao & Liang (2026) to functional and structural econometric settings using Gaussian process priors. We find that models evaluated over continuum domains appear more restrictive than when…

General Economics · Economics 2026-03-10 Drew Fudenberg , Wayne Yuan Gao , Zhiheng You

We generalize the classical calculus rules satisfied by functions of bounded variation to the framework of RCD spaces. In the infinite dimensional setting we are able to define an analogue of the distributional differential and on finite…

Functional Analysis · Mathematics 2022-04-11 Camillo Brena , Nicola Gigli

The step-growth polymerisation of a mixture of arbitrary-functional monomers is viewed as a time-continuos random graph process with degree bounds that are not necessarily the same for different vertices. The sequence of degree bounds acts…

Combinatorics · Mathematics 2019-08-21 Ivan Kryven

Complex system design often proceeds in an iterative fashion, starting from a high-level model and adding detail as the design matures. This process can be assisted by metamodeling techniques that automate some model manipulations and check…

Systems and Control · Electrical Eng. & Systems 2019-10-10 Natasha Jarus , Sahra Sedigh Sarvestani , Ali R. Hurson

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed. In this paper, we examine the parameter identifiability of these models by investigating whether…

Machine Learning · Computer Science 2025-02-11 Xinshuai Dong , Ignavier Ng , Biwei Huang , Yuewen Sun , Songyao Jin , Roberto Legaspi , Peter Spirtes , Kun Zhang

We establish an $L_1$-bound between the coefficients of the optimal causal filter applied to the data-generating process and its finite sample approximation. Here, we assume that the data-generating process is a second-order stationary time…

Statistics Theory · Mathematics 2023-12-12 Junho Yang

The developments of Rademacher complexity and PAC-Bayesian theory have been largely independent. One exception is the PAC-Bayes theorem of Kakade, Sridharan, and Tewari (2008), which is established via Rademacher complexity theory by…

Machine Learning · Computer Science 2019-12-03 Jun Yang , Shengyang Sun , Daniel M. Roy

We develop a general framework for margin-based multicategory classification in metric spaces. The basic work-horse is a margin-regularized version of the nearest-neighbor classifier. We prove generalization bounds that match the state of…

Machine Learning · Computer Science 2014-01-31 Aryeh Kontorovich , Roi Weiss

We consider the problem of flexible modeling of higher order Markov chains when an upper bound on the order of the chain is known but the true order and nature of the serial dependence are unknown. We propose Bayesian nonparametric…

Methodology · Statistics 2015-10-21 Abhra Sarkar , David B. Dunson
‹ Prev 1 3 4 5 6 7 10 Next ›