English
Related papers

Related papers: Entropy and Learning of Lipschitz Functions under …

200 papers

Let $n\geq 1$, $K>0$, and let $X=(X_1,X_2,\dots,X_n)$ be a random vector in $\mathbb{R}^n$ with independent $K$--subgaussian components. We show that for every $1$--Lipschitz convex function $f$ in $\mathbb{R}^n$ (the Lipschitzness with…

Probability · Mathematics 2023-05-02 Han Huang , Konstantin Tikhomirov

In this work, we introduce new families of nonconforming approximation methods for reconstructing functions on general polygonal meshes. These methods are defined using degrees of freedom based on weighted moments of orthogonal polynomials…

Numerical Analysis · Mathematics 2025-08-12 Francesco Dell'Accio , Allal Guessab , Gradimir V. Milovanović , Federico Nudo

The paper is devoted to new modifications of recently proposed adaptive methods of Mirror Descent for convex minimization problems in the case of several convex functional constraints. Methods for problems of two classes are considered. The…

Optimization and Control · Mathematics 2018-05-29 Fedor S. Stonyakin , Mohammad S. Alkousa , Alexey N. Stepanov , Maxim A. Barinov

Tackling semi-supervised learning problems with graph-based methods has become a trend in recent years since graphs can represent all kinds of data and provide a suitable framework for studying continuum limits, e.g., of differential…

Machine Learning · Computer Science 2022-02-07 Tim Roith , Leon Bungert

This article considers the Lipschitz space with mixed logarithmic smoothness of $2\pi$ periodic functions of several variables. We obtain equivalent descriptions of the norm of the Lipschitz space and prove embedding theorems between Besov…

Classical Analysis and ODEs · Mathematics 2025-11-19 Gabdolla Akishev

We study the functional linear regression model with a scalar response and a Hilbert space-valued predictor, a canonical example of an ill-posed inverse problem. We show that the functional partial least squares (PLS) estimator attains…

Statistics Theory · Mathematics 2025-05-08 Andrii Babii , Marine Carrasco , Idriss Tsafack

Convergence properties of empirical risk minimizers can be conveniently expressed in terms of the associated population risk. To derive bounds for the performance of the estimator under covariate shift, however, pointwise convergence rates…

Statistics Theory · Mathematics 2024-01-01 Johannes Schmidt-Hieber , Petr Zamolodtchikov

We study $L_p$ polynomial regression. Given query access to a function $f:[-1,1] \rightarrow \mathbb{R}$, the goal is to find a degree $d$ polynomial $\hat{q}$ such that, for a given parameter $\varepsilon > 0$, $$ \|\hat{q}-f\|_p\le…

Data Structures and Algorithms · Computer Science 2022-11-15 Raphael A. Meyer , Cameron Musco , Christopher Musco , David P. Woodruff , Samson Zhou

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis…

Data Structures and Algorithms · Computer Science 2016-06-10 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We give the first fully polynomial-time algorithm for learning halfspaces with respect to the uniform distribution on the hypercube in the presence of contamination, where an adversary may corrupt some fraction of examples and labels…

Data Structures and Algorithms · Computer Science 2025-11-11 Gautam Chandrasekaran , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

In this paper, for $\mu$ and $\nu$ two probability measures on $\mathbb{R}^d$ with finite moments of order $\rho\ge 1$, we define the respective projections for the $W_\rho$-Wasserstein distance of $\mu$ and $\nu$ on the sets of probability…

Probability · Mathematics 2019-02-11 Aurélien Alfonsi , Jacopo Corbetta , Benjamin Jourdain

We consider the problem of nonparametric estimation of a convex regression function $\phi_0$. We study the risk of the least squares estimator (LSE) under the natural squared error loss. We show that the risk is always bounded from above by…

Statistics Theory · Mathematics 2014-12-10 Adityanand Guntuboyina , Bodhisattva Sen

We develop a principled approach to obtain exact computer-aided worst-case guarantees on the performance of second-order optimization methods on classes of univariate functions. We first present a generic technique to derive interpolation…

Optimization and Control · Mathematics 2025-07-01 Anne Rubbens , Nizar Bousselmi , Julien M. Hendrickx , François Glineur

We study the nonparametric least squares estimator (LSE) of a multivariate convex regression function. The LSE, given as the solution to a quadratic program with $O(n^2)$ linear constraints ($n$ being the sample size), is difficult to…

Computation · Statistics 2015-09-29 Rahul Mazumder , Arkopal Choudhury , Garud Iyengar , Bodhisattva Sen

We study the problem of estimating a multivariate convex function defined on a convex body in a regression setting with random design. We are interested in optimal rates of convergence under a squared global continuous $l_2$ loss in the…

Statistics Theory · Mathematics 2016-01-27 Qiyang Han , Jon A. Wellner

We consider the estimation of the value of a linear functional of the slope parameter in functional linear regression, where scalar responses are modeled in dependence of random functions. The theory in this paper covers in particular…

Statistics Theory · Mathematics 2011-12-19 J. Johannes , R. Schenk

There has been substantial recent work on methods for estimating the slope function in linear regression for functional data analysis. However, as in the case of more conventional finite-dimensional regression, much of the practical…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Peter Hall

We consider elliptic second order partial differential operators with Lipschitz continuous leading order coefficients on finite cubes and the whole Euclidean space. We prove quantitative sampling and equidistribution theorems for…

Analysis of PDEs · Mathematics 2025-05-23 Martin Tautenhahn , Ivan Veselic

The local Lipschitz constant of a neural network is a useful metric with applications in robustness, generalization, and fairness evaluation. We provide novel analytic results relating the local Lipschitz constant of nonsmooth vector-valued…

Machine Learning · Statistics 2021-01-12 Matt Jordan , Alexandros G. Dimakis

We develop and analyze a single-loop algorithm for minimizing the sum of a Lipschitz differentiable function $f$, a prox-friendly proper closed function $g$ (with a closed domain on which $g$ is continuous) and the composition of another…

Optimization and Control · Mathematics 2026-01-01 Hao Zhang , Naoki Marumo , Ting Kei Pong , Akiko Takeda