English
Related papers

Related papers: Generalized bounds for active subspaces

200 papers

Generalization bounds which assess the difference between the true risk and the empirical risk, have been studied extensively. However, to obtain bounds, current techniques use strict assumptions such as a uniformly bounded or a Lipschitz…

Machine Learning · Computer Science 2022-11-03 Itai Gat , Yossi Adi , Alexander Schwing , Tamir Hazan

We use Lyapunov-like functions and convex optimization to propagate uncertainty in the initial condition of nonlinear systems governed by ordinary differential equations. We consider the full nonlinear dynamics without approximation,…

Optimization and Control · Mathematics 2023-08-04 Francesca Covella , Giovanni Fantuzzi

Deep neural networks often contain far more parameters than training examples, yet they still manage to generalize well in practice. Classical complexity measures such as VC-dimension or PAC-Bayes bounds usually become vacuous in this…

Machine Learning · Computer Science 2025-08-26 Aviral Dhingra

Function approximation and recovery via some sampled data have long been studied in a wide array of applied mathematics and statistics fields. Analytic tools, such as the Poincar\'e inequality, have been handy for estimating the…

Numerical Analysis · Mathematics 2020-07-16 Yifan Chen , Thomas Y. Hou

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

Variational inference has become an increasingly attractive fast alternative to Markov chain Monte Carlo methods for approximate Bayesian inference. However, a major obstacle to the widespread use of variational methods is the lack of…

Machine Learning · Statistics 2020-03-03 Jonathan H. Huggins , Mikołaj Kasprzak , Trevor Campbell , Tamara Broderick

We introduce and explore a new concept of evasive subspace with respect to a collection of subspaces sharing a common dimension, most notably partial spreads. We show that this concept generalises known notions of subspace scatteredness and…

Combinatorics · Mathematics 2023-10-17 Anina Gruica , Alberto Ravagnani , John Sheekey , Ferdinando Zullo

A seminal open question of Pisier and Mendel--Naor asks whether every degree-regular graph which satisfies the classical discrete Poincar\'e inequality for scalar functions, also satisfies an analogous inequality for functions taking values…

Metric Geometry · Mathematics 2025-05-30 Dylan J. Altschuler , Pandelis Dodos , Konstantin Tikhomirov , Konstantinos Tyros

We prove a sharp upper bound on convex domains, in terms of the diameter alone, of the best constant in a class of weighted Poincar\'e inequalities. The key point is the study of an optimal weighted Wirtinger inequality.

Optimization and Control · Mathematics 2012-11-07 Vincenzo Ferone , Carlo Nitsch , Cristina Trombetti

Multiple importance sampling estimators are widely used for computing intractable constants due to its reliability and robustness. The celebrated balance heuristic estimator belongs to this class of methods and has proved very successful in…

Computation · Statistics 2019-09-05 Felipe J Medina-Aguayo , Richard G Everitt

We establish the existence of weak solutions of a nonlinear radiation-type boundary value problem for elliptic equation on divergence form with discontinuous leading coefficient. Quantitative estimates play a crucial role on the real…

Analysis of PDEs · Mathematics 2015-07-23 Luisa Consiglieri

In this paper, we address the probabilistic error quantification of a general class of prediction methods. We consider a given prediction model and show how to obtain, through a sample-based approach, a probabilistic upper bound on the…

Statistics Theory · Mathematics 2021-06-07 Victor Mirasierra , Martina Mammarella , Fabrizio Dabbene , Teodoro Alamo

Understanding generalization is crucial to confidently engineer and deploy machine learning models, especially when deployment implies a shift in the data domain. For such domain adaptation problems, we seek generalization bounds which are…

Machine Learning · Computer Science 2023-03-16 Adam Breitholtz , Fredrik D. Johansson

We consider the problem of parameter estimation in dynamic systems described by ordinary differential equations. A review of the existing literature emphasizes the need for deterministic global optimization methods due to the nonconvex…

Optimization and Control · Mathematics 2025-06-16 M. Fernández de Dios , Ángel M. González-Rueda , Julio R. Banga , Julio González-Díaz , David R. Penas

Nonlinear Poincar\'e inequalities are indispensable tools in the study of dimension reduction and low-distortion embeddings of graphs into metric spaces, and have found remarkable algorithmic applications. A basic open problem, posed by Jon…

Metric Geometry · Mathematics 2025-07-31 Dylan J. Altschuler , Pandelis Dodos , Konstantin Tikhomirov , Konstantinos Tyros

We show that the Ornstein-Uhlenbeck semigroup associated with a general Poisson random measure is hypercontractive, whenever it is restricted to non-increasing mappings on configuration spaces. We deduce from this result some versions of…

Probability · Mathematics 2019-04-18 Ivan Nourdin , Giovanni Peccati , Xiaochuan Yang

In applied probability, the normal approximation is often used for the distribution of data with assumed additive structure. This tradition is based on the central limit theorem for sums of (independent) random variables. However, it is…

Probability · Mathematics 2020-10-27 Alexandra Dorofeeva , Victor Korolev , Alexander Zeifman

This paper extends the idea of a generalized estimator for a scalar parameter (Vos, 2022) to multi-dimensional parameters both with and without nuisance parameters. The title reflects the fact that generalized estimators provide more than…

Statistics Theory · Mathematics 2024-08-26 Paul Vos , Qiang Wu

We generalize Minami's estimate for the Anderson model and its extensions to $n$ eigenvalues, allowing for $n$ arbitrary intervals and arbitrary single-site probability measures with no atoms. As an application, we derive new results about…

Mathematical Physics · Physics 2009-11-13 Jean-Michel Combes , François Germinet , Abel Klein
‹ Prev 1 3 4 5 6 7 10 Next ›