English
Related papers

Related papers: Estimating the Average of a Lipschitz-Continuous F…

200 papers

We initiate a program of average smoothness analysis for efficiently learning real-valued functions on metric spaces. Rather than using the Lipschitz constant as the regularizer, we define a local slope at each point and gauge the function…

Statistics Theory · Mathematics 2020-11-10 Yair Ashlagi , Lee-Ad Gottlieb , Aryeh Kontorovich

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

Let us assume that $f$ is a continuous function defined on the unit ball of $\mathbb R^d$, of the form $f(x) = g (A x)$, where $A$ is a $k \times d$ matrix and $g$ is a function of $k$ variables for $k \ll d$. We are given a budget $m \in…

Numerical Analysis · Mathematics 2012-01-18 Massimo Fornasier , Karin Schnass , Jan Vybiral

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

Machine Learning · Statistics 2025-11-20 Gábor Balázs

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms,…

Numerical Analysis · Mathematics 2018-02-15 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

We describe a procedure based on the iteration of an initial function by an appropriated operator, acting on continuous functions, in order to get a fixed point. This fixed point will be a calibrated subaction for the doubling map on the…

Dynamical Systems · Mathematics 2020-10-26 Hermes H. Ferreira , Artur O. Lopes , Elismar R. Oliveira

We introduce the Lipschitz matrix: a generalization of the scalar Lipschitz constant for functions with many inputs. Among the Lipschitz matrices compatible a particular function, we choose the smallest such matrix in the Frobenius norm to…

Numerical Analysis · Mathematics 2023-03-24 Jeffrey M. Hokanson , Paul G. Constantine

This paper deals with two kinds of the one-dimensional global optimization problems over a closed finite interval: (i) the objective function $f(x)$ satisfies the Lipschitz condition with a constant $L$; (ii) the first derivative of $f(x)$…

Optimization and Control · Mathematics 2013-07-15 Daniela Lera , Yaroslav D. Sergeyev

Graph algorithms are widely used for decision making and knowledge discovery. To ensure their effectiveness, it is essential that their output remains stable even when subjected to small perturbations to the input because frequent output…

Data Structures and Algorithms · Computer Science 2023-09-15 Soh Kumabe , Yuichi Yoshida

Let g : $\Omega$ = [0, 1] d $\rightarrow$ R denote a Lipschitz function that can be evaluated at each point, but at the price of a heavy computational time. Let X stand for a random variable with values in $\Omega$ such that one is able to…

Probability · Mathematics 2021-07-29 Lucie Bernard , Albert Cohen , Arnaud Guyader , Florent Malrieu

We consider the problems of \emph{learning} and \emph{testing} real-valued convex functions over Gaussian space. Despite the extensive study of function convexity across mathematics, statistics, and computer science, its learnability and…

Data Structures and Algorithms · Computer Science 2025-11-17 Renato Ferreira Pinto , Cassandra Marcussen , Elchanan Mossel , Shivam Nadimpalli

The approximation ratio has become one of the dominant measures in mechanism design problems. In light of analysis of algorithms, we define the \emph{smoothed approximation ratio} to compare the performance of the optimal mechanism and a…

Computer Science and Game Theory · Computer Science 2017-06-23 Xiaotie Deng , Yansong Gao , Jie Zhang

In binary classification and regression problems, it is well understood that Lipschitz continuity and smoothness of the loss function play key roles in governing generalization error bounds for empirical risk minimization algorithms. In…

Machine Learning · Computer Science 2016-09-14 Ambuj Tewari , Sougata Chaudhuri

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

The problem of estimating the mean of random functions based on discretely sampled data arises naturally in functional data analysis. In this paper, we study optimal estimation of the mean function under both common and independent designs.…

Statistics Theory · Mathematics 2012-02-24 T. Tony Cai , Ming Yuan

A regularization algorithm allowing random noise in derivatives and inexact function values is proposed for computing approximate local critical points of any order for smooth unconstrained optimization problems. For an objective function…

Optimization and Control · Mathematics 2021-04-07 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

Under general assumptions on the target distribution $p^\star$, we establish a sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores, with optimal dependence on time and dimension. As applications, we…

Statistics Theory · Mathematics 2026-04-08 Arthur Stéphanovitch
‹ Prev 1 2 3 10 Next ›