English
Related papers

Related papers: A Robbins-Monro algorithm for non-parametric estim…

200 papers

In many learning problems, the training and testing data follow different distributions and a particularly common situation is the \textit{covariate shift}. To correct for sampling biases, most approaches, including the popular kernel mean…

Machine Learning · Computer Science 2020-03-13 Henry Lam , Fengpei Li , Siddharth Prusty

In this article, we consider the estimation of the structural change point in the nonparametric model with dependent observations. We introduce a maximum-CUSUM-estimation procedure, where the CUSUM statistic is constructed based on the…

Applications · Statistics 2020-12-03 Q. Yang , Y. Li , Y. Zhang

In this paper, we present the asymptotic properties of the moment estimator for autoregressive (AR for short) models subject to Markovian changes in regime under the assumption that the errors are uncorrelated but not necessarily…

Statistics Theory · Mathematics 2025-03-06 Yacouba Boubacar Mainassara , Landy Rabehasaina , Armel Bra

This paper investigates the nonparametric estimation of a circular regression function in an errors-in-variables framework. Two settings are studied, depending on whether the covariates are circular or linear. Adaptive estimators are…

Statistics Theory · Mathematics 2025-08-27 Tien Dat Nguyen , Thanh Mai Pham Ngoc

We propose some backward-forward martingale decompositions for functions of reversible Markov chains. These decompositions are used to prove the functional CLT for reversible Markov chains with asymptotically linear variance of partial…

Probability · Mathematics 2018-01-16 Martial Longla

This paper is devoted to two different two-time-scale stochastic approximation algorithms for superquantile estimation. We shall investigate the asymptotic behavior of a Robbins-Monro estimator and its convexified version. Our main…

Statistics Theory · Mathematics 2020-07-30 Bernard Bercu , Manon Costa , Sébastien Gadat

The semimartingale stochastic approximation procedure, namely, the Robbins-Monro type SDE is introduced which naturally includes both generalized stochastic approximation algorithms with martingale noises and recursive parameter estimation…

Probability · Mathematics 2007-05-23 N. Lazrieva , T. Sharia , T. Toronjadze

A biomechanical model often requires parameter estimation and selection in a known but complicated nonlinear function. Motivated by observing that data from a head-neck position tracking system, one of biomechanical models, show…

Methodology · Statistics 2024-02-13 Hojun You , Kyubaek Yoon , Wei-Ying Wu , Jongeun Choi , Chae Young Lim

This work concerns estimation of linear autoregressive models with Markov-switching using expectation maximisation (E.M.) algorithm. Our method generalise the method introduced by Elliot for general hidden Markov models and avoid to use…

Methodology · Statistics 2008-02-22 Joseph Rynkiewicz

We present a fully nonparametric method to estimate the value function, via simulation, in the context of expected infinite-horizon discounted rewards for Markov chains. Estimating such value functions plays an important role in approximate…

Probability · Mathematics 2013-12-30 Mohammad Mousavi , Peter W. Glynn

In a recent paper Birke and Bissantz (2008) considered the problem of nonparametric estimation in inverse regression models with convolution-type operators. For multivariate predictors nonparametric methods suffer from the curse of…

Statistics Theory · Mathematics 2013-03-19 T. Hildebrandt , N. Bissantz , H. Dette

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron

In this paper, we will outline a novel data-driven method for estimating functions in a multivariate nonparametric regression model based on an adaptive knot selection for B-splines. The underlying idea of our approach for selecting knots…

Methodology · Statistics 2024-01-26 Mary E. Savino , Céline Lévy-Leduc

We investigate the parameter recovery of Markov-switching ordinary differential processes from discrete observations, where the differential equations are nonlinear additive models. This framework has been widely applied in biological…

Methodology · Statistics 2025-01-03 Katherine Tsai , Mladen Kolar , Sanmi Koyejo

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

In this paper, we consider the alleviation of the boundary problem when the probability density function has bounded support. We apply Robbins-Monro's algorithm and Bernstein polynomials to construct a recursive density estimator. We study…

Statistics Theory · Mathematics 2019-04-16 Yousri SLAOUI , Asma JMAEI

For the class of Gauss-Markov processes we study the problem of asymptotic equivalence of the nonparametric regression model with errors given by the increments of the process and the continuous time model, where a whole path of a sum of a…

Statistics Theory · Mathematics 2021-10-26 Holger Dette , Martin Kroll

This article studies identification and estimation for the network vector autoregressive model with nonstationary regressors. In particular, network dependence is characterized by a nonstochastic adjacency matrix. The information set…

Econometrics · Economics 2024-01-09 Christis Katsouris

This paper is concerned with general nonlinear regression models where the predictor variables are subject to Berkson-type measurement errors. The measurement errors are assumed to have a general parametric distribution, which is not…

Statistics Theory · Mathematics 2009-08-21 Liqun Wang

In a first part, we prove Bernstein-type deviation inequalities for bifurcating Markov chains (BMC) under a geometric ergodicity assumption, completing former results of Guyon and Bitseki Penda, Djellout and Guillin. These preliminary…

Statistics Theory · Mathematics 2015-09-11 S. Valère Bitseki Penda , Marc Hoffmann , Adélaïde Olivier
‹ Prev 1 3 4 5 6 7 10 Next ›