English
Related papers

Related papers: Optimal sampling rates for approximating analytic …

200 papers

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

We study Krasnoselskii-Mann style iterative algorithms for approximating fixpoints of asymptotically weakly contractive mappings, with a focus on providing generalised convergence proofs along with explicit rates of convergence. More…

Functional Analysis · Mathematics 2021-04-30 Thomas Powell , Franziskus Wiesnet

We develop a constructive piecewise polynomial approximation theory in weighted Sobolev spaces with Muckenhoupt weights for any polynomial degree. The main ingredients to derive optimal error estimates for an averaged Taylor polynomial are…

Numerical Analysis · Mathematics 2014-11-27 Ricardo H. Nochetto , Enrique Otarola , Abner J. Salgado

We study the problem of minimizing a $m$-weakly convex and possibly nonsmooth function. Weak convexity provides a broad framework that subsumes convex, smooth, and many composite nonconvex functions. In this work, we propose a…

Optimization and Control · Mathematics 2025-09-04 Feng-Yi Liao , Yang Zheng

We study the approximation of a square-integrable function from a finite number of evaluations on a random set of nodes according to a well-chosen distribution. This is particularly relevant when the function is assumed to belong to a…

Machine Learning · Statistics 2024-11-13 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Weighting methods are widely used to adjust for covariates in observational studies, sample surveys, and regression settings. In this paper, we study a class of recently proposed weighting methods which find the weights of minimum…

Methodology · Statistics 2019-10-29 Yixin Wang , José R. Zubizarreta

This paper develops a new direct approach to approximating suprema of general empirical processes by a sequence of suprema of Gaussian processes, without taking the route of approximating whole empirical processes in the sup-norm. We prove…

Probability · Mathematics 2014-08-19 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

A key problem in approximation theory is the recovery of high-dimensional functions from samples. In many cases, the functions of interest exhibit anisotropic smoothness, and, in many practical settings, the nature of this anisotropy may be…

Numerical Analysis · Mathematics 2026-04-10 Ben Adcock , Avi Gupta

We study the approximability of two related problems on graphs with $n$ nodes and $m$ edges: $n$-Pairs Shortest Paths ($n$-PSP), where the goal is to find a shortest path between $O(n)$ prespecified pairs, and All Node Shortest Cycles…

Data Structures and Algorithms · Computer Science 2022-09-21 Mina Dalirrooyfard , Ce Jin , Virginia Vassilevska Williams , Nicole Wein

Matrix completion has been well studied under the uniform sampling model and the trace-norm regularized methods perform well both theoretically and numerically in such a setting. However, the uniform sampling model is unrealistic for a…

Machine Learning · Computer Science 2017-05-01 T. Tony Cai , Wen-Xin Zhou

The Expectation-Maximization (EM) algorithm is an iterative method to maximize the log-likelihood function for parameter estimation. Previous works on the convergence analysis of the EM algorithm have established results on the asymptotic…

Statistics Theory · Mathematics 2017-05-31 Chong Wu , Can Yang , Hongyu Zhao , Ji Zhu

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

We present improved deterministic algorithms for approximating shortest paths in the Congested Clique model of distributed computing. We obtain $poly(\log\log n)$-round algorithms for the following problems in unweighted undirected…

Data Structures and Algorithms · Computer Science 2020-03-09 Michal Dory , Merav Parter

We consider a hierarchy of upper approximations for the minimization of a polynomial $f$ over a compact set $K \subseteq \mathbb{R}^n$ proposed recently by Lasserre (arXiv:1907.097784, 2019). This hierarchy relies on using the push-forward…

Optimization and Control · Mathematics 2020-12-04 Lucas Slot , Monique Laurent

In this paper we present a first-order method that admits near-optimal convergence rates for convex/concave min-max problems while requiring a simple and intuitive analysis. Similarly to the seminal work of Nemirovski and the recent…

Computer Science and Game Theory · Computer Science 2023-01-18 Volkan Cevher , Georgios Piliouras , Ryann Sim , Stratis Skoulakis

We study strong (pathwise) approximation of Cox-Ingersoll-Ross processes. We propose a Milstein-type scheme that is suitably truncated close to zero, where the diffusion coefficient fails to be locally Lipschitz continuous. For this scheme…

Numerical Analysis · Mathematics 2016-08-02 Mario Hefter , André Herzwurm

In this paper, we derive optimality conditions (Chebyshev approximation) for multivariate functions. The theory of Chebyshev (uniform) approximation for univariate functions is very elegant. The optimality conditions are based on the notion…

Optimization and Control · Mathematics 2015-10-22 Nadezda Sukhorukova , Julien Ugon , David Yost

The best polynomial approximation and Chebyshev approximation are both important in numerical analysis. In tradition, the best approximation is regarded as more better than the Chebyshev approximation, because it is usually considered in…

Numerical Analysis · Mathematics 2021-11-17 Xiaolong Zhang

We make two closely related theoretical contributions to the use of importance sampling schemes. First, for independent sampling, we prove that the minimax optimal trial distribution coincides with the target if and only if the target…

Computation · Statistics 2025-06-25 Quan Zhou