English
Related papers

Related papers: Convergence of Hessian estimator from random sampl…

200 papers

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

Machine Learning · Computer Science 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper, 2007, for estimating a unknown nonparametric regression. We prove that this procedure is asymptotically efficient for a quadratic risk, i.e.…

Statistics Theory · Mathematics 2008-10-08 Leonid Galtchouk , Serguey Pergamenshchikov

This paper considers the problem of approximating the inverse of the wave-equation Hessian, also called normal operator, in seismology and other types of wave-based imaging. An expansion scheme for the pseudodifferential symbol of the…

Numerical Analysis · Mathematics 2015-03-17 Laurent Demanet , Pierre-David Létourneau , Nicolas Boumal , Henri Calandra , Jiawei Chiu , Stanley Snelson

We study Hessian estimators for functions defined over an $n$-dimensional complete analytic Riemannian manifold. We introduce new stochastic zeroth-order Hessian estimators using $O (1)$ function evaluations. We show that, for an analytic…

Machine Learning · Statistics 2022-09-28 Tianyu Wang

Grey-scale local algorithms have been suggested as a fast way of estimating surface area from grey-scale digital images. Their asymptotic mean has already been described. In this paper, the asymptotic behaviour of the variance is studied in…

Probability · Mathematics 2016-02-24 Anne Marie Svane

Many statistical applications involve models for which it is difficult to evaluate the likelihood, but from which it is relatively easy to sample. Approximate Bayesian computation is a likelihood-free method for implementing Bayesian…

Methodology · Statistics 2017-11-29 Wentao Li , Paul Fearnhead

We present a family of generalized Hessian estimators of the objective using random direction stochastic approximation (RDSA) by utilizing only noisy function measurements. The form of each estimator and the order of the bias depend on the…

Machine Learning · Computer Science 2026-02-24 Soumen Pachal , Prashanth L. A. , Shalabh Bhatnagar , Avinash Achar

A variance reduction technique in nonparametric smoothing is proposed: at each point of estimation, form a linear combination of a preliminary estimator evaluated at nearby points with the coefficients specified so that the asymptotic bias…

Statistics Theory · Mathematics 2007-08-22 Ming-Yen Cheng , Liang Peng , Jyh-Shyang Wu

Bayesian methods are developed for the multivariate nonparametric regression problem where the domain is taken to be a compact Riemannian manifold. In terms of the latter, the underlying geometry of the manifold induces certain symmetries…

Statistics Theory · Mathematics 2007-06-13 Jean-François Angers , Peter T. Kim

We propose an iterative estimating equations procedure for analysis of longitudinal data. We show that, under very mild conditions, the probability that the procedure converges at an exponential rate tends to one as the sample size…

Statistics Theory · Mathematics 2007-12-18 Jiming Jiang , Yihui Luan , You-Gan Wang

We give curvature-dependant convergence rates for the optimization of weakly convex functions defined on a manifold of 1-bounded geometry via Riemannian gradient descent and via the dynamic trivialization algorithm. In order to do this, we…

Optimization and Control · Mathematics 2020-08-07 Mario Lezcano-Casado

In this work we develop a Hessian-based sampling method for the construction of goal-oriented reduced order models with high-dimensional parameter inputs. Model reduction is known very challenging for high-dimensional parametric problems…

Numerical Analysis · Mathematics 2018-09-28 Peng Chen , Omar Ghattas

The Gaussian integral operator arises naturally as a local Euclidean approximation of the heat semigroup on a Riemannian manifold and plays a pivotal role in the analysis of graph Laplacians, particularly within the frameworks of manifold…

Differential Geometry · Mathematics 2025-06-17 Jia-Ming , Liou , Chi-Chien Lu

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. This problem is magnified in high-dimensional settings where the number of variables $p$ diverges with the sample size $n$, as well…

Statistics Theory · Mathematics 2020-02-21 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

The asymptotic concentration of the Fr{\'e}chet mean of IID random variables on a Rieman-nian manifold was established with a central limit theorem by Bhattacharya \& Patrangenaru (BP-CLT) [6]. This asymptotic result shows that the…

Differential Geometry · Mathematics 2019-06-19 Xavier Pennec

We consider the semi-parametric estimation of a scale parameter of a one-dimensional Gaussian process with known smoothness. We suggest an estimator based on quadratic variations and on the moment method. We provide asymptotic…

Statistics Theory · Mathematics 2020-01-22 Jean-Marc Azaïs , François Bachoc , Agnès Lagnoux , Thi Mong Ngoc Nguyen

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper, 2007, for estimating an unknown nonparametric regression. %\cite{GaPe1}. We prove that this procedure is asymptotically efficient for a…

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov

We study the properties of variational Bayes approximations for exponential family models with missing values. It is shown that the iterative algorithm for obtaining the variational Bayesian estimator converges locally to the true value…

Statistics Theory · Mathematics 2012-07-19 Bo Wang , D. Titterington

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper (2007) for estimation of unknown nonparametric regression. We prove that this procedure is asymptotically efficient for a quadratic risk. It…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

We define a stochastic variant of the proximal point algorithm in the general setting of nonlinear (separable) Hadamard spaces for approximating zeros of the mean of a stochastically perturbed monotone vector field and prove its convergence…

Optimization and Control · Mathematics 2025-10-14 Nicholas Pischke
‹ Prev 1 2 3 10 Next ›