English
Related papers

Related papers: A Simple Online Parameter Estimation Technique wit…

200 papers

The paper proposes a formal estimation procedure for parameters of the fractional Poisson process (fPp). Such procedures are needed to make the fPp model usable in applied situations. The basic idea of fPp, motivated by experimental data…

Methodology · Statistics 2018-06-08 Dexter Cahoy , Vladimir V. Uchaikin , Wojbor A. Woyczynski

Conformal prediction provides a principled framework for uncertainty quantification with finite-sample coverage guarantees. While recent work has extended conformal prediction to online and sequential settings, existing methods typically…

Machine Learning · Statistics 2026-05-14 Eduardo Ochoa Rivera , Ambuj Tewari

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

The utilization of online stochastic algorithms is popular in large-scale learning settings due to their ability to compute updates on the fly, without the need to store and process data in large batches. When a constant step-size is used,…

Optimization and Control · Mathematics 2023-07-19 Stefan Vlaski , Elsa Rizk , Ali H. Sayed

We propose a novel nonparametric online predictor for discrete labels conditioned on multivariate continuous features. The predictor is based on a feature space discretization induced by a full-fledged k-d tree with randomly picked…

Machine Learning · Computer Science 2020-02-03 Alix Lhéritier , Frédéric Cazals

Additive models and generalized additive models are effective semiparametric tools for multidimensional data. In this article we propose an online smoothing backfitting method for generalized additive models with local polynomial smoothers.…

Statistics Theory · Mathematics 2021-12-20 Ying Yang , Fang Yao

We consider nonparametric estimation of a regression curve when the data are observed with multiplicative distortion which depends on an observed confounding variable. We suggest several estimators, ranging from a relatively simple one that…

Statistics Theory · Mathematics 2016-01-13 Aurore Delaigle , Peter Hall , Wen-Xin Zhou

The emerging field of learning-augmented online algorithms uses ML techniques to predict future input parameters and thereby improve the performance of online algorithms. Since these parameters are, in general, real-valued functions, a…

Machine Learning · Computer Science 2022-05-26 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

This paper obtains asymptotic results for parametric inference using prediction-based estimating functions when the data are high frequency observations of a diffusion process with an infinite time horizon. Specifically, the data are…

Statistics Theory · Mathematics 2020-07-27 Emil S. Jørgensen , Michael Sørensen

Statistical models incorporating change points are common in practice, especially in the area of biomedicine. This approach is appealing in that a specific parameter is introduced to account for the abrupt change in the response variable…

Statistics Theory · Mathematics 2008-12-18 Hongling Zhou , Kung-Yee Liang

We propose estimators for the parameters of the Linnik L$(\alpha,\gamma)$ distribution. The estimators are derived from the moments of the log-transformed Linnik distributed random variable, and are shown to be asymptotically unbiased. The…

Methodology · Statistics 2017-03-27 Dexter Cahoy

This paper proposes Partially Observable Reference Policy Programming, a novel anytime online approximate POMDP solver which samples meaningful future histories very deeply while simultaneously forcing a gradual policy update. We provide…

Artificial Intelligence · Computer Science 2025-07-17 Edward Kim , Hanna Kurniawati

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

In this paper, we consider the problem of estimating parameters in a linear regression model. We propose a sequential learning procedure to determine the sample size for achieving a given small estimation risk, under the widely used…

Methodology · Statistics 2023-11-07 Jun Hu , Yan Zhuang , Shunan Zhao

Streaming data often exhibit heterogeneity due to heteroscedastic variances or inhomogeneous covariate effects. Online renewable quantile and expectile regression methods provide valuable tools for detecting such heteroscedasticity by…

Methodology · Statistics 2026-02-27 Wei Cao , Shanshan Wanga , Xiaoxue Hua

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer

Optimistic Online Learning aims to exploit experts conveying reliable information to predict the future. However, such implicit optimism may be challenged when it comes to practical crafting of such experts. A fundamental example consists…

Machine Learning · Computer Science 2025-10-29 Maxime Haddouche , Olivier Wintenberger , Benjamin Guedj

We propose a general procedure for estimating the variance-covariance matrix of two-step estimates of structural parameters in latent variable models. The method is partially simulation-based, in that it includes drawing simulated values of…

Methodology · Statistics 2025-07-23 Roberto Di Mari , Jouni Kuha

We investigate the reconstruction of the transmission matrix of a time-evolving atmospheric channel with an online recursive optimization routine, using wave-optics simulations. We demonstrate that this estimation technique is able to keep…

Optics · Physics 2025-04-02 Giacomo Sorelli , Douglas McDonald , Szymon Gladysz