English
Related papers

Related papers: Empirical measures: regularity is a counter-curse …

200 papers

Concentration of measure has been argued to be the fundamental cause of adversarial vulnerability. Mahloujifar et al. presented an empirical way to measure the concentration of a data distribution using samples, and employed it to find…

Machine Learning · Computer Science 2021-03-25 Jack Prescott , Xiao Zhang , David Evans

Block-coordinate descent (BCD) is a popular framework for large-scale regularized optimization problems with block-separable structure. Existing methods have several limitations. They often assume that subproblems can be solved exactly at…

Optimization and Control · Mathematics 2019-11-05 Ching-pei Lee , Stephen J. Wright

Non-Gaussian concentration estimates are obtained for invariant probability measures of reversible Markov processes. We show that the functional inequalities approach combined with a suitable Lyapunov condition allows us to circumvent the…

Probability · Mathematics 2012-02-13 Arnaud Guillin , Aldéric Joulin

A key observation underlying this paper is the fact that the range invariance condition for convergence of regularization methods for nonlinear ill-posed operator equations -- such as coefficient identification in partial differential…

Numerical Analysis · Mathematics 2023-07-26 Barbara Kaltenbacher

The paper develops new methods of non-parametric estimation a compound Poisson distribution. Such a problem arise, in particular, in the inference of a Levy process recorded at equidistant time intervals. Our key estimator is based on…

Statistics Theory · Mathematics 2015-10-19 Alexey Lindo , Sergei Zuyev , Serik Sagitov

Selecting appropriate regularization coefficients is critical to performance with respect to regularized empirical risk minimization problems. Existing theoretical approaches attempt to determine the coefficients in order for regularized…

Machine Learning · Computer Science 2019-09-05 Akihiro Yabe , Takanori Maehara

Shape restrictions such as monotonicity on functions often arise naturally in statistical modeling. We consider a Bayesian approach to the problem of estimation of a monotone regression function and testing for monotonicity. We construct a…

Statistics Theory · Mathematics 2020-08-05 Moumita Chakraborty , Subhashis Ghosal

This paper is aimed to study the ergodic short-term behaviour of discretizations of circle expanding maps. More precisely, we prove some asymptotics of the distance between the $t$-th iterate of Lebesgue measure by the dynamics $f$ and the…

Dynamical Systems · Mathematics 2023-08-09 Pierre-Antoine Guihéneuf , Maurizio Monge

We introduce estimation and test procedures through divergence optimization for discrete or continuous parametric models. This approach is based on a new dual representation for divergences. We treat point estimation and tests for simple…

Statistics Theory · Mathematics 2008-12-02 Michel Broniatowski , Amor Keziou

In some recent papers the classical `splitting necklace theorem' is linked in an interesting way with a geometric `pattern avoidance problem'. We explore the topological constraints on the existence of a (relaxed) measurable coloring of R^d…

Combinatorics · Mathematics 2013-06-03 Sinisa Vrecica , Rade Zivaljevic

The paper addresses the problem of sampling discretization of integral norms of elements of finite-dimensional subspaces satisfying some conditions. We prove sampling discretization results under two standard kinds of assumptions --…

Numerical Analysis · Mathematics 2021-09-21 F. Dai , V. Temlyakov

We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction,…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal

This paper presents and philosophically assesses three types of results on the observational equivalence of continuous-time measure-theoretic deterministic and indeterministic descriptions. The first results establish observational…

Dynamical Systems · Mathematics 2013-10-08 Charlotte Werndl

Mode separation, namely how sharply a distribution fragments into barrier-separated clusters, is a fundamental geometric property of densities, difficult to quantify in high dimensions. It is structurally distinct from dispersion, yet…

Machine Learning · Statistics 2026-05-12 Shaul Tolkovsky , Ori Meidler , Or Zuk

This paper derives the rate of convergence and asymptotic distribution for a class of Kolmogorov-Smirnov style test statistics for conditional moment inequality models for parameters on the boundary of the identified set under general…

Applications · Statistics 2011-12-06 Timothy B. Armstrong

We study the convergence of a discrete Luenberger observer for the barotropic Euler equations in one dimension, for measurements of the velocity only. We use a mixed finite element method in space and implicit Euler integration in time. We…

Numerical Analysis · Mathematics 2026-03-13 Aidan Chaumet , Jan Giesselmann

By using the spectrum of the underlying symmetric diffusion operator, the convergence in $L^p$-Wasserstein distance $\mathbb W_p (p\ge 1)$ is characterized for the empirical measure $\mu_t$ of non-symmetric subordinated diffusion processes…

Probability · Mathematics 2023-02-28 Feng-Yu Wang

We consider a composite convex minimization problem associated with regularized empirical risk minimization, which often arises in machine learning. We propose two new stochastic gradient methods that are based on stochastic dual averaging…

Optimization and Control · Mathematics 2016-03-09 Tomoya Murata , Taiji Suzuki

The error exponent in lossy source coding characterizes the asymptotic decay rate of error probability with respect to blocklength. The Marton's error exponent provides the theoretically optimal bound on this rate. However, computation…

Information Theory · Computer Science 2025-07-29 Jiachuan Ye , Shitong Wu , Lingyi Chen , Wenyi Zhang , Huihui Wu , Hao Wu

We propose a two-sample extended empirical likelihood for inference on the difference between two p-dimensional parameters defined by estimating equations. The standard two-sample empirical likelihood for the difference is Bartlett…

Statistics Theory · Mathematics 2014-12-24 Min Tsao , Fan Wu