English
Related papers

Related papers: Generalized bounds for active subspaces

200 papers

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

We analyze a dual mixed nonconforming discretization of a generalized Darcy-Forchheimer model. Compared to the analogous scheme proposed by Girault and Wheeler, we consider general, i.e., nonquadratic, Forchheimer nonlinearities; we admit…

Numerical Analysis · Mathematics 2026-04-24 Michele Botti , Lorenzo Mascotto , Marialetizia Mosconi

Generalization is a central concept in machine learning theory, yet for quantum models, it is predominantly analyzed through uniform bounds that depend on a model's overall capacity rather than the specific function learned. These…

There are many ways of establishing upper bounds on fluctuations of random variables, but there is no systematic approach for lower bounds. As a result, lower bounds are unknown in many important problems. This paper introduces a general…

Probability · Mathematics 2018-07-30 Sourav Chatterjee

We consider a generalized method of moments framework in which a part of the data vector is missing for some units in a completely unrestricted, potentially endogenous way. In this setup, the parameters of interest are usually only…

Econometrics · Economics 2026-01-07 Grigory Franguridi , Hyungsik Roger Moon

Contribution of this paper lies in the formulation and estimation of a generalized model for stochastic frontier analysis (SFA) that nests virtually all forms used and includes some that have not been considered so far. The model is based…

Econometrics · Economics 2020-10-13 Kamil Makieła , Błażej Mazur

In the context of one-dimensional diffusions, we present basic estimates (having the same lower and upper bounds with a factor of 4 only) for four Poincar\'e-type (or Hardy-type) inequalities. The derivation of two estimates have been open…

Probability · Mathematics 2011-11-30 Mu-Fa Chen

A pair of lower and upper cumulative distribution functions, also called probability box or p-box, is among the most popular models used in imprecise probability theory. They arise naturally in expert elicitation, for instance in cases…

Probability · Mathematics 2018-08-10 Matthias C. M. Troffaes , Sebastien Destercke

Robust estimation of location is a fundamental problem in statistics, particularly in scenarios where data contamination by outliers or model misspecification is a concern. In univariate settings, methods such as the sample median and…

Statistics Theory · Mathematics 2025-05-07 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Gonzalo Perera

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

Our main result is an abstract good-$\lambda$ inequality that allows us to consider three self-improving properties related to oscillation estimates in a very general context. The novelty of our approach is that there is one principle…

Classical Analysis and ODEs · Mathematics 2018-10-10 Lauri Berkovits , Juha Kinnunen , José María Martell

Random systems of curves exhibiting fluctuating features on arbitrarily small scales ($\delta$) are often encountered in critical models. For such systems it is shown that scale-invariant bounds on the probabilities of crossing events imply…

Functional Analysis · Mathematics 2007-05-23 Michael Aizenman , Almut Burchard

We study the Multiple-try Metropolis algorithm using the framework of Poincar\'e inequalities. We describe the Multiple-try Metropolis as an auxiliary variable implementation of a resampling approximation to an ideal Metropolis--Hastings…

Computation · Statistics 2025-11-18 Rocco Caprio , Sam Power , Andi Q. Wang

Necessary and sufficient criteria for metric subregularity (or calmness) of set-valued mappings between general metric or Banach spaces are treated in the framework of the theory of error bounds for a special family of extended real-valued…

Optimization and Control · Mathematics 2015-01-20 Alexander Y. Kruger

We investigate discrete Poincar\'e inequalities on piecewise polynomial subspaces of the Sobolev spaces H(curl) and H(div) in three space dimensions. We characterize the dependence of the constants on the continuous-level constants, the…

Numerical Analysis · Mathematics 2025-11-06 Alexandre Ern , Johnny Guzmán , Pratyush Potu , Martin Vohralík

Probabilities of causation (PoCs), such as the probability of necessity and sufficiency (PNS), are important tools for decision making but are generally not point identifiable. Existing work has derived bounds for these quantities using…

Methodology · Statistics 2026-02-20 Tianyuan Cheng , Ruirui Mao , Judea Pearl , Ang Li

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Linear statistics of eigenvalues in many familiar classes of random matrices are known to obey gaussian central limit theorems. The proofs of such results are usually rather difficult, involving hard computations specific to the model in…

Probability · Mathematics 2007-11-25 Sourav Chatterjee

This paper explores the generalization characteristics of iterative learning algorithms with bounded updates for non-convex loss functions, employing information-theoretic techniques. Our key contribution is a novel bound for the…

Machine Learning · Computer Science 2023-10-17 Jingwen Fu , Nanning Zheng

Equivalence of the spectral gap, exponential integrability of hitting times and Lyapunov conditions are well known. We give here the correspondance (with quantitative results) for reversible diffusion processes. As a consequence, we…

Probability · Mathematics 2010-12-24 Patrick Cattiaux , Arnaud Guillin , Pierre-André Zitt