English
Related papers

Related papers: A Robbins-Monro procedure for the estimation of pa…

200 papers

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Here we present a new non-parametric approach to density estimation and classification derived from theory in Radon transforms and image reconstruction. We start by constructing a "forward problem" in which the unknown density is mapped to…

Numerical Analysis · Mathematics 2024-12-20 James Webber , Erika Hussey , Eric Miller , Shuchin Aeron

The Box-Cox transformation is applied to the linear mixed models for analyzing positive and grouped data. The problem in using Box Cox transformation is that the maximum likelihood estimator of the transformation parameter is generally…

Methodology · Statistics 2016-09-07 Shonosuke Sugasawa , Tatsuya Kubokawa

Divergence estimators based on direct approximation of density-ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution…

Machine Learning · Statistics 2011-06-24 Makoto Yamada , Taiji Suzuki , Takafumi Kanamori , Hirotaka Hachiya , Masashi Sugiyama

In a parametric framework, the paper is devoted to the study of a new estimation procedure for the inverse filter and the level noise in a complex noisy blind discrete deconvolution model. Our estimation method is a consequence of the sharp…

Statistics Theory · Mathematics 2007-11-06 Emmanuelle Gautherat , Ghislaine Gayraud

In this work, we derive a $\gamma$-robust a posteriori error estimator for finite element approximations of the Allen-Cahn equation with variable non-degenerate mobility. The estimator utilizes spectral estimates for the linearized steady…

Numerical Analysis · Mathematics 2024-03-15 Aaron Brunk , Jan Giesselmann , Maria Lukacova-Medvidova

We study the problem of parameter estimation for a univariate discretely observed ergodic diffusion process given as a solution to a stochastic differential equation. The estimation procedure we propose consists of two steps. In the first…

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Peter Spreij

This article deals with the numerical resolution of backward stochastic differential equations. Firstly, we consider a rather general case where the filtration is generated by a Brownian motion and a Poisson random measure. We provide a…

Probability · Mathematics 2008-12-18 Emmanuel Gobet , Jean-Philippe Lemor

In this article we recover the distribution function (and possible density) of an arbitrary random variable that is subject to an additive measurement error. This problem is also known as deconvolution and has a long tradition in…

Statistics Theory · Mathematics 2025-10-07 Henrik Kaiser

Procedural material models have been gaining traction in many applications thanks to their flexibility, compactness, and easy editability. We explore the inverse rendering problem of procedural material parameter estimation from…

Graphics · Computer Science 2025-04-22 Yu Guo , Milos Hasan , Lingqi Yan , Shuang Zhao

Restricted Boltzmann machines (RBMs) are energy-based models analogous to the Ising model and are widely applied in statistical machine learning. The standard inverse Ising problem with a complete dataset requires computing both data and…

Machine Learning · Statistics 2025-09-01 Kaiji Sekimoto , Muneki Yasuda

Density Ratio Estimation has attracted attention from the machine learning community due to its ability to compare the underlying distributions of two datasets. However, in some applications, we want to compare distributions of random…

Machine Learning · Statistics 2020-06-26 Song Liu , Yulong Zhang , Mingxuan Yi , Mladen Kolar

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

Many matching, tracking, sorting, and ranking problems require probabilistic reasoning about possible permutations, a set that grows factorially with dimension. Combinatorial optimization algorithms may enable efficient point estimation,…

Machine Learning · Statistics 2017-10-27 Scott W. Linderman , Gonzalo E. Mena , Hal Cooper , Liam Paninski , John P. Cunningham

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

This study introduces an iterative Bayesian Robbins--Monro (IBRM) sequence, which unites the classical Robbins--Monro sequence with statistical estimation for faster root-finding under noisy observations. Although the standard…

Optimization and Control · Mathematics 2025-08-19 Siwei Liu , Ke Ma , Stephan M. Goetz

Computational difficulty of quadratic matching and the Gromov-Wasserstein distance has led to various approximation and relaxation schemes. One of such methods, relying on the notion of distance profiles, has been widely used in practice,…

Methodology · Statistics 2025-12-30 YoonHaeng Hur , Yuehaw Khoo

In this article, we provide an extension of the Chen-Stein inequality for Poisson approximation in the total variation distance for sums of independent Bernoulli random variables in two ways. We prove that we can improve the rate of…

Probability · Mathematics 2022-10-26 Pierre-Loïc Méliot , Ashkan Nikeghbali , Gabriele Visentin

Convergence rates of kernel density estimators for stationary time series are well studied. For invertible linear processes, we construct a new density estimator that converges, in the supremum norm, at the better, parametric, rate…

Statistics Theory · Mathematics 2009-09-29 Anton Schick , Wolfgang Wefelmeyer

For calculating large deformations in finite elasticity, we have proposed a method of successive linear approximation, by considering the relative descriptional formulation. In this article we briefly describe this method and we prove the…

Analysis of PDEs · Mathematics 2011-07-15 Rolci Cipolatti , I-Shih Liu , Mauro A. Rincon