English
Related papers

Related papers: Convergence bounds for empirical nonlinear least-s…

200 papers

Estimation of convex functions finds broad applications in engineering and science, while convex shape constraint gives rise to numerous challenges in asymptotic performance analysis. This paper is devoted to minimax optimal estimation of…

Statistics Theory · Mathematics 2013-06-11 Teresa M. Lebair , Jinglai Shen , Xiao Wang

In this paper, we consider the problem of minimizing a difference-of-convex objective over a nonlinear conic constraint, where the cone is closed, convex, pointed and has a nonempty interior. We assume that the support function of a compact…

Optimization and Control · Mathematics 2026-04-13 Jiefeng Xu , Ting Kei Pong , Nung-sing Sze

Proximal gradient methods are a popular tool for the solution of structured, nonsmooth minimization problems. In this work, we investigate an extension of the former to general Banach spaces and provide worst-case convergence rates for,…

Optimization and Control · Mathematics 2025-09-30 Gerd Wachsmuth , Daniel Walter

A linear functional of an object from a convex symmetric set can be optimally estimated, in a worst-case sense, by a linear functional of observations made on the object. This well-known fact is extended here to a nonlinear setting: other…

Functional Analysis · Mathematics 2025-12-25 Simon Foucart

We study the optimal rectangular-discrepancy approximation of permutons by finite permutations. We transfer bounds from discrepancy theory to this more restricted setup. Moreover, we show that superlinear approximation can occur only for…

Combinatorics · Mathematics 2026-05-05 Balázs Maga

We investigate the space of bounded linear operators on a Banach space equipped with a norm which is equivalent to the operator norm such that the subspace of compact operators is an M-ideal. In particular, we observe that the space of…

Functional Analysis · Mathematics 2025-02-19 Manwook Han , Sun Kwang Kim

In this paper we address the convergence of stochastic approximation when the functions to be minimized are not convex and nonsmooth. We show that the "mean-limit" approach to the convergence which leads, for smooth problems, to the ODE…

Optimization and Control · Mathematics 2018-05-08 Szymon Majewski , Błażej Miasojedow , Eric Moulines

Approximate Bayesian computation (ABC) is a widely used inference method in Bayesian statistics to bypass the point-wise computation of the likelihood. In this paper we develop theoretical bounds for the distance between the statistics used…

Statistics Theory · Mathematics 2019-01-03 James Ridgway

This paper studies approximation properties of linear sampling operators in general Banach lattices $X$. We obtain matching direct and inverse approximation estimates, convergence criteria, equivalence results involving special…

Functional Analysis · Mathematics 2026-01-28 Yurii Kolomoitsev

Fixed point iterations are a fundamental tool in numerical analysis and scientific computing for the approximation of solutions to nonlinear problems. Their convergence is often established via the Banach fixed point theorem, provided that…

Numerical Analysis · Mathematics 2026-04-29 Thomas P. Wihler

Computing the probability of evidence even with known error bounds is NP-hard. In this paper we address this hard problem by settling on an easier problem. We propose an approximation which provides high confidence lower bounds on…

Artificial Intelligence · Computer Science 2012-06-26 Vibhav Gogate , Bozhena Bidyuk , Rina Dechter

We present a framework to calculate large deviations for nonlinear functions of independent random variables supported on compact sets in Banach spaces, by extending the result in Chatterjee and Dembo [6]. Previous research on nonlinear…

Probability · Mathematics 2018-07-12 Jun Yan

We characterize the solution of a broad class of convex optimization problems that address the reconstruction of a function from a finite number of linear measurements. The underlying hypothesis is that the solution is decomposable as a…

Optimization and Control · Mathematics 2021-07-26 Michael Unser , Shayan Aziznejad

We consider the problem of approximating an unknown function $u\in L^2(D,\rho)$ from its evaluations at given sampling points $x^1,\dots,x^n\in D$, where $D\subset \mathbb{R}^d$ is a general domain and $\rho$ is a probability measure. The…

Numerical Analysis · Mathematics 2018-05-29 Benjamin Arras , Markus Bachmayr , Albert Cohen

Recently, there was a substantial progress in the problem of sampling recovery on function classes with mixed smoothness. Mostly, it has been done by proving new and sometimes optimal upper bounds for both linear sampling recovery and for…

Numerical Analysis · Mathematics 2025-05-29 A. Gasnikov , V. Temlyakov

While the theory of operator approximation with any given accuracy is well elaborated, the theory of {best constrained} constructive operator approximation is still not so well developed. Despite increasing demands from applications this…

Optimization and Control · Mathematics 2018-11-09 Anatoli Torokhti , Pablo Soto-Quiros

Importance sampling is a popular variance reduction method for Monte Carlo estimation, where a notorious question is how to design good proposal distributions. While in most cases optimal (zero-variance) estimators are theoretically…

Statistics Theory · Mathematics 2021-02-22 Carsten Hartmann , Lorenz Richter

We address the problem of producing a lower bound for the mean of a discrete probability distribution, with known support over a finite set of real numbers, from an iid sample of that distribution. Up to a constant, this is equivalent to…

Statistics Theory · Mathematics 2025-02-25 Erik Learned-Miller

In this paper we study best \(m\)-term trigonometric approximation in weighted Wiener spaces and its consequences for Besov and Sobolev spaces with bounded mixed derivative/difference. We obtain several sharp asymptotic bounds for weighted…

Functional Analysis · Mathematics 2025-11-21 Moritz Moeller , Serhii Stasyuk , Tino Ullrich

We analyze statistical features of the ``optimization landscape'' in a random version of one of the simplest constrained optimization problems of the least-square type: finding the best approximation for the solution of an overcomplete…

Mathematical Physics · Physics 2022-06-08 Yan V. Fyodorov , Rashel Tublin