English
Related papers

Related papers: Minimax Optimal Estimators for Additive Scalar Fun…

200 papers

We consider the problem of optimal linear estimation of the functional $A \xi~=~\sum_{j = 0}^{\infty} a_j \xi_j$ that depends on the unknown values $\xi_j,j=0,1,\dots, $ of a random sequence $\{\xi_j,j\in\mathbb Z\}$ from observations of…

Probability · Mathematics 2024-01-30 Mikhail Moklyachuk , Vitalii Ostapenko

We present a stochastic optimization method that uses a fourth-order regularized model to find local minima of smooth and potentially non-convex objective functions with a finite-sum structure. This algorithm uses sub-sampled derivatives…

Optimization and Control · Mathematics 2023-07-18 Aurelien Lucchi , Jonas Kohler

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen

Accurate rational approximations of the Fermi-Dirac distribution are a useful component in many numerical algorithms for electronic structure calculations. The best known approximations use $O( \log (\beta \Delta) \log (\epsilon^{-1}))$…

Computational Physics · Physics 2016-11-11 Jonathan E. Moussa

In the framework of scalar-on-function regression models, in which several functional variables are employed to predict a scalar response, we propose a methodology for selecting relevant functional predictors while simultaneously providing…

Methodology · Statistics 2026-02-19 Hedayat Fathi , Marzia A. Cremona , Federico Severino

In this work, we study the task of distributed optimization over a network of learners in which each learner possesses a convex cost function, a set of affine equality constraints, and a set of convex inequality constraints. We propose a…

Optimization and Control · Mathematics 2015-06-18 Zaid J. Towfic , Ali H. Sayed

We study the problem of estimating the joint probability mass function (pmf) over two random variables. In particular, the estimation is based on the observation of $m$ samples containing both variables and $n$ samples missing one fixed…

Statistics Theory · Mathematics 2023-05-17 H. S. Melihcan Erol , Erixhen Sula , Lizhong Zheng

Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two…

Statistics Theory · Mathematics 2025-12-10 Karthik Bharath , Alexander Lewis , Akash Sharma , Michael V Tretyakov

Consider the communication-constrained estimation of discrete distributions under $\ell^p$ losses, where each distributed terminal holds multiple independent samples and uses limited number of bits to describe the samples. We obtain the…

Machine Learning · Computer Science 2024-11-11 Deheng Yuan , Tao Guo , Zhongyi Huang

We give a new explicitly invertible approximation of the normal cumulative distribution function: $\Phi(x) \simeq 1/2 + 1/2 \sqrt{1-{e}^{-x^2\frac{17+{x}^{2}}{26.694+2x^2}}}$, $\forall x \ge 0$, with absolute error $<4.00\cdot 10^{-5}$,…

Statistics Theory · Mathematics 2012-11-28 Alessandro Soranzo , Emanuela Epure

We consider the advection-diffusion equation \[ \phi_t + Au \cdot \nabla \phi = \Delta \phi, \qquad \phi(0,x)=\phi_0(x) \] on $\bbR^2$, with $u$ a periodic incompressible flow and $A\gg 1$ its amplitude. We provide a sharp characterization…

Analysis of PDEs · Mathematics 2007-05-23 Andrej Zlatos

Estimation of convex functions finds broad applications in engineering and science, while convex shape constraint gives rise to numerous challenges in asymptotic performance analysis. This paper is devoted to minimax optimal estimation of…

Statistics Theory · Mathematics 2013-06-11 Teresa M. Lebair , Jinglai Shen , Xiao Wang

This paper studies high-dimensional additive regression under the transfer learning framework, where one observes samples from a target population together with auxiliary samples from different but potentially related regression models. We…

Machine Learning · Statistics 2025-09-17 Seung Hyun Moon

We determine optimal designs for some regression models which are frequently used for describing three-dimensional shapes. These models are based on a Fourier expansion of a function defined on the unit sphere in terms of spherical harmonic…

Statistics Theory · Mathematics 2007-06-13 Holger Dette , Viatcheslav B. Melas , Andrey Pepelyshev

The well-known Schwarz-Pick lemma states that any analytic mapping $\phi$ of the unit disk $U$ into itself satisfies the inequality $$|\phi'(z)|\leq \frac{1-|\phi(z)|^2}{1-|z|^2}, \quad z\in U.$$ This estimate remains the same if we…

Complex Variables · Mathematics 2007-05-23 J. Milne Anderson , Alexander Vasil'ev

The aim of this article is to overview the problem of mean square optimal estimation of linear functionals which depend on unknown values of periodically correlated stochastic process. Estimates are based on observations of this process and…

Statistics Theory · Mathematics 2025-11-24 Iryna Dubovets'ka , Mykhailo Moklyachuk

We define two minimum distance estimators for dependent data by minimizing some approximated Maximum Mean Discrepancy distances between the true empirical distribution of observations and their assumed (parametric) model distribution. When…

Methodology · Statistics 2026-01-19 Pierre Alquier , Jean-David Fermanian , Benjamin Poignard

So-called functional error estimators provide a valuable tool for reliably estimating the discretization error for a sum of two convex functions. We apply this concept to Tikhonov regularization for the solution of inverse problems for…

Numerical Analysis · Mathematics 2017-02-13 Christian Clason , Barbara Kaltenbacher , Daniel Wachsmuth

The approximation of a general $d$-variate function $f$ by the shifts $\phi(\cdot-\xi)$, $\xi\in\Xi\subset \Rd$, of a fixed function $\phi$ occurs in many applications such as data fitting, neural networks, and learning theory. When…

Classical Analysis and ODEs · Mathematics 2008-02-19 Ronald DeVore , Amos Ron

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez