English
Related papers

Related papers: Structural Risk Minimization for $C^{1,1}(\mathbb{…

200 papers

We discuss Meyers-Serrin's type results for smooth approximations of functions $b=b(t,x):\mathbb{R}\times\mathbb{R}^n\to\mathbb{R}^m$, with convergence of an energy of the form \[ \int_{\mathbb{R}}\int_{\mathbb{R}^n} w(t,x)…

Classical Analysis and ODEs · Mathematics 2022-08-03 Luigi Ambrosio , Sebastiano Nicolussi Golo , Francesco Serra Cassano

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

Machine Learning · Statistics 2021-09-23 Antoine Dedieu

This paper deals with the approximation of discrete real-valued functions by first-degree splines (broken lines) with free knots for arbitrary $L_p$-norms ($1 \leq p \leq \infty)$. We prove the existence of best approximations und derive…

Numerical Analysis · Mathematics 2017-04-20 Ludwig J. Cromme , Jens Kunath

We study Regularized Empirical Risk Minimizers (RERM) and minmax Median-Of-Means (MOM) estimators where the regularization function $\phi(\cdot)$ is an even convex function. We obtain bounds on the $L_2$-estimation error and the excess risk…

Statistics Theory · Mathematics 2019-10-16 Geoffrey Chinot

The art of analysis involves the subtle combination of approximation, inequalities, and geometric intuition as well as being able to work at different scales. With this subtlety in mind, we present this paper in a manner designed for wide…

Classical Analysis and ODEs · Mathematics 2018-09-13 Laramie Paxton , Kevin R. Vixie

We prove that, for any closed semialgebraic subset $W$ of $\mathbb{R}^n$ and for any positive integer $p$, there exists a Nash function $f:\mathbb{R}^n\setminus W\longrightarrow (0, \infty)$ which is equivalent to the distance function from…

Classical Analysis and ODEs · Mathematics 2024-04-22 Beata Kocel-Cynk , Wiesław Pawłucki , Anna Valette

It is known by a formula of Hasse-Sondow that the Riemann zeta function is given, for any $ s=\sigma+it \in \mathbb{C}$, by $ \sum_{n=0}^{\infty} \widetilde{A}(n,s)$ where $$ \widetilde{A}(n,s):=\frac{1}{2^{n+1}(1-2^{1-s})} \sum_{k=0}^n…

Number Theory · Mathematics 2020-02-10 Yochay Jerby

Composite optimization problems, where the sum of a smooth and a merely lower semicontinuous function has to be minimized, are often tackled numerically by means of proximal gradient methods as soon as the lower semicontinuous part of the…

Optimization and Control · Mathematics 2022-07-05 Christian Kanzow , Patrick Mehlitz

Our note is a complement to recent articles \cite{JS1} (2011) and \cite{JS2} (2013) by M. Jim\'enez-Sevilla and L. S\'anchez-Gonz\'alez which generalise (the basic statement of) the classical Whitney extension theorem for $C^1$-smooth real…

Functional Analysis · Mathematics 2024-04-05 Michal Johanis , Luděk Zajíček

We study the class of functions $f$ on $\mathbb{R}$ satisfying a Lipschitz estimate in the Schatten ideal $\mathcal{L}_p$ for $0 < p \leq 1$. The corresponding problem with $p\geq 1$ has been extensively studied, but the quasi-Banach range…

Functional Analysis · Mathematics 2021-07-27 Edward McDonald , Fedor Sukochev

Submodular functions are a fundamental object of study in combinatorial optimization, economics, machine learning, etc. and exhibit a rich combinatorial structure. Many subclasses of submodular functions have also been well studied and…

Data Structures and Algorithms · Computer Science 2013-04-19 Nikhil R. Devanur , Shaddin Dughmi , Roy Schwartz , Ankit Sharma , Mohit Singh

Many applications, such as system identification, classification of time series, direct and inverse problems in partial differential equations, and uncertainty quantification lead to the question of approximation of a non-linear operator…

Numerical Analysis · Mathematics 2022-12-05 Hrushikesh Mhaskar

Given an arbitrary $1$-Lipschitz function $f$ on the torus $\mathbb{T}^n $, we find a $k$-dimensional subtorus $M \subseteq \mathbb{T}^n$, parallel to the axes, such that the restriction of $f$ to the subtorus $M$ is nearly a constant…

Functional Analysis · Mathematics 2014-02-25 Dmitry Faifman , Bo'az Klartag , Vitali Milman

This work concerns the study of the subdifferential of the integral functional $$ E_f(x)=\int_{T} f(t,x)d\mu(t), $$ where $f$ is a (not necessarily convex) normal integrand, $({T},\mathcal{A},\mu)$ is a $\sigma$-finite measure space, while…

Optimization and Control · Mathematics 2019-02-19 Rafael Correa , Abderrahim Hantoute , Pedro Pérez-Aros

This paper studies the estimation of smooth functionals $f(\theta)$ of a mean parameter $\theta = \mathbb{E}_P[W]$ for a distribution $P$ on a general Banach space. We propose a cross-fitted estimator based on a single sample splitting and…

Statistics Theory · Mathematics 2026-04-03 Woonyoung Chang , Arun Kumar Kuchibhotla

Population risk is always of primary interest in machine learning; however, learning algorithms only have access to the empirical risk. Even for applications with nonconvex nonsmooth losses (such as modern deep networks), the population…

Machine Learning · Computer Science 2018-10-19 Chi Jin , Lydia T. Liu , Rong Ge , Michael I. Jordan

Let $E$ be a separable Banach space and let $X, X_1,\dots, X_n, \dots$ be i.i.d. Gaussian random variables taking values in $E$ with mean zero and unknown covariance operator $\Sigma: E^{\ast}\mapsto E.$ The complexity of estimation of…

Statistics Theory · Mathematics 2023-09-11 Vladimir Koltchinskii

The quantization problem aims to find the best possible approximation of probability measures on ${\mathbb{R}}^d$ using finite, discrete measures. The Wasserstein distance is a typical choice to measure the quality of the approximation.…

Probability · Mathematics 2023-09-11 Rajmadan Lakshmanan , Alois Pichler

We study function estimation in the empirical Bayes setting for Poisson and normal means. Specifically, given observations $Y_i\sim f(\cdot; \theta_i)$ with latent parameters $\theta_i\sim \pi$, the goal is to estimate…

Statistics Theory · Mathematics 2026-01-27 Benjamin Kang , Yury Polyanskiy , Anzo Teh

In the last several years, the intimate connection between convex optimization and learning problems, in both statistical and sequential frameworks, has shifted the focus of algorithmic machine learning to examine this interplay. In…

Machine Learning · Computer Science 2014-07-23 Mehrdad Mahdavi