English
Related papers

Related papers: Sharp $L_p$-error estimates for sampling operators

200 papers

The paper considers functional linear regression, where scalar responses $Y_1,...,Y_n$ are modeled in dependence of random functions $X_1,...,X_n$. We propose a smoothing splines estimator for the functional slope parameter based on a…

Statistics Theory · Mathematics 2009-02-26 Christophe Crambes , Alois Kneip , Pascal Sarda

This paper considers stochastic optimization problems whose objective functions involve powers of random variables. For example, consider the classic Stochastic lp Load Balancing Problem (SLBp): There are $m$ machines and $n$ jobs, and…

Data Structures and Algorithms · Computer Science 2018-10-15 Marco Molinaro

We give a survey of classical and recent results on sharp constants and symmetry/asymmetry of extremal functions in $1$-dimensional functional inequalities.

Classical Analysis and ODEs · Mathematics 2026-03-26 Alexander I. Nazarov , Alexandra P. Shcheglova

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

In this paper we consider the $L_q$-approximation of multivariate periodic functions $f$ with $L_p$-bounded mixed derivative (difference). The (possibly non-linear) reconstruction algorithm is supposed to recover the function from function…

Numerical Analysis · Mathematics 2017-03-02 Glenn Byrenheid , Tino Ullrich

Stochastic proximal point methods have recently garnered renewed attention within the optimization community, primarily due to their desirable theoretical properties. Notably, these methods exhibit a convergence rate that is independent of…

Optimization and Control · Mathematics 2024-12-19 Elnur Gasanov , Peter Richtárik

We consider neural network approximation spaces that classify functions according to the rate at which they can be approximated (with error measured in $L^p$) by ReLU neural networks with an increasing number of coefficients, subject to…

Functional Analysis · Mathematics 2021-10-29 Philipp Grohs , Felix Voigtlaender

In this work, we develop $L^p$ boundedness theory for pseudodifferential operators with rough (not even continuous in general) symbols in the $x$ variable. Moreover, the $B(L^p)$ operator norms are estimated explicitly in terms of scale…

Classical Analysis and ODEs · Mathematics 2007-05-23 Atanas Stefanov

We study $L^p$-Sobolev improving for averaging operators $A_{\gamma}$ given by convolution with a compactly supported smooth density $\mu_{\gamma}$ on a non-degenerate curve. In particular, in 4 dimensions we show that $A_{\gamma}$ maps…

Classical Analysis and ODEs · Mathematics 2021-10-26 David Beltran , Shaoming Guo , Jonathan Hickman , Andreas Seeger

We consider the space of functions almost in $L_p$ and endow it with the topology of asymptotic $L_p$-convergence. This yields a completely metrizable topological vector space which, on finite measure spaces, coincides with the space of…

Functional Analysis · Mathematics 2025-12-01 Nuno J. Alves

This paper focuses on solving a stochastic variational inequality (SVI) problem under relaxed smoothness assumption for a class of structured non-monotone operators. The SVI problem has attracted significant interest in the machine learning…

Optimization and Control · Mathematics 2025-10-02 Daniil Vankov , Angelia Nedich , Lalitha Sankar

We provide strong $L_p$-rates of approximation of nonsmooth integral-type functionals of Markov processes by integral sums. Our approach is, in a sense, process insensitive and is based on a modification of some well-developed estimates…

Probability · Mathematics 2015-03-19 Iu. Ganychenko , A. Kulik

In this paper, we study the order of approximation for max-product Kantorovich sampling operators based upon generalized kernels in the setting of Orlicz spaces. We establish a quantitative estimate for the considered family of…

Functional Analysis · Mathematics 2025-02-25 Lorenzo Boccali , Danilo Costarelli , Gianluca Vinti

Due to the non-smoothness of optimization problems in Machine Learning, generalized smoothness assumptions have been gaining a lot of attention in recent years. One of the most popular assumptions of this type is $(L_0,L_1)$-smoothness…

Optimization and Control · Mathematics 2024-12-30 Eduard Gorbunov , Nazarii Tupitsa , Sayantan Choudhury , Alen Aliev , Peter Richtárik , Samuel Horváth , Martin Takáč

We investigate the asymptotic behavior of the $L_p$-distance between a monotone function on a compact interval and a smooth estimator of this function. Our main result is a central limit theorem for the $L_p$-error of smooth isotonic…

Statistics Theory · Mathematics 2018-06-01 Hendrik P. Lopuhaä , Eni Musta

Classical convergence analyses for optimization algorithms rely on the widely-adopted uniform smoothness assumption. However, recent experimental studies have demonstrated that many machine learning problems exhibit non-uniform smoothness,…

Machine Learning · Computer Science 2024-09-27 Zhenyu Sun , Ermin Wei

In this paper, we consider the estimation of a change-point for possibly high-dimensional data in a Gaussian model, using a k-means method. We prove that, up to a logarithmic term, this change-point estimator has a minimax rate of…

Statistics Theory · Mathematics 2018-02-22 Aurélie Fischer , Dominique Picard

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Computation · Statistics 2016-12-06 Arnak S. Dalalyan

Approximation of high-dimensional functions is a problem in many scientific fields that is only feasible if advantageous structural properties, such as sparsity in a given basis, can be exploited. A relevant tool for analysing sparse…

Numerical Analysis · Mathematics 2023-10-16 Philipp Trunschke , Anthony Nouy , Martin Eigel

The generalized smooth condition, $(L_{0},L_{1})$-smoothness, has triggered people's interest since it is more realistic in many optimization problems shown by both empirical and theoretical evidence. Two recent works established the…

Machine Learning · Computer Science 2023-10-31 Zijian Liu , Srikanth Jagabathula , Zhengyuan Zhou