English
Related papers

Related papers: Minimum $L^q$-distance estimators for non-normaliz…

200 papers

We consider the question of learning the natural parameters of a $k$ parameter minimal exponential family from i.i.d. samples in a computationally and statistically efficient manner. We focus on the setting where the support as well as the…

Machine Learning · Computer Science 2021-11-01 Abhin Shah , Devavrat Shah , Gregory W. Wornell

We study the problem of parameters estimation in Indirect Observability contexts, where $X_t \in R^r$ is an unobservable stationary process parametrized by a vector of unknown parameters and all observable data are generated by an…

Probability · Mathematics 2016-01-20 Robert Azencott , Peng Ren , Ilya Timofeyev

We consider the fundamental learning problem of estimating properties of distributions over large domains. Using a novel piecewise-polynomial approximation technique, we derive the first unified methodology for constructing sample- and…

Machine Learning · Computer Science 2020-03-18 Yi Hao , Alon Orlitsky

The present paper considers modified extension of the exponential distribution with three parameters. We study the main properties of this new distribution, with special emphasis on its median, mode and moments function and some…

Other Statistics · Statistics 2015-10-28 M. A. El-Damcese , Dina. A. Ramadan

The subject of robust estimation in time series is widely discussed in literature. One of the approaches is to use GM-estimation. This method incorporates a broad class of nonparametric estimators which under suitable conditions includes…

Statistics Theory · Mathematics 2007-06-13 Alexander Alekseev

This paper is concerned with model averaging estimation for partially linear functional score models. These models predict a scalar response using both parametric effect of scalar predictors and non-parametric effect of a functional…

Methodology · Statistics 2021-05-04 Shishi Liu , Hao Zhang , Jingxiao Zhang

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Statistics Theory · Mathematics 2025-07-24 Claudio Agostinelli , Ayanendranath Basu , Giulia Bertagnolli , Arun Kumar Kuchibhotla

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

This paper is concerned with the least squares estimator for a basic class of nonlinear autoregressive models, whose outputs are not necessarily to be ergodic. Several asymptotic properties of the least squares estimator have been…

Probability · Mathematics 2019-09-17 Zhaobo Liu , Chanying Li

Given a statistical model, we propose a novel estimation method that yields randomised estimators for the unknown distribution of an observed random variable. We establish non-asymptotic bounds for the performance of these estimators and…

Statistics Theory · Mathematics 2026-05-06 Yannick Baraud

Linear regression with normally distributed errors - including particular cases such as ANOVA, Student's t-test or location-scale inference - is a widely used statistical procedure. In this case the ordinary least squares estimator…

Methodology · Statistics 2019-09-18 Alain Desgagné

In this paper, we study the estimation of partially linear models for spatial data distributed over complex domains. We use bivariate splines over triangulations to represent the nonparametric component on an irregular two-dimensional…

Statistics Theory · Mathematics 2021-06-03 Li Wang , Guannan Wang , Min-Jun Lai , Lei Gao

Generalized linear models and the quasi-likelihood method extend the ordinary regression models to accommodate more general conditional distributions of the response. Nonparametric methods need no explicit parametric specification, and the…

Statistics Theory · Mathematics 2009-11-23 Jianqing Fan , Yichao Wu , Yang Feng

In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed, where the defining convex function has an exponential nature. These estimators avoid the necessity of using an intermediate kernel…

Methodology · Statistics 2019-11-25 Taranga Mukherjee , Abhijit Mandal , Ayanendranath Basu

This paper introduces two new robust methods for estimation of parameters in a given parametric family. The first method is that of `minimum weighted L2', effectively minimising an estimate of the integrated (and possibly weighted) squared…

Methodology · Statistics 2026-02-23 Nils Lid Hjort

The parameter estimation of unnormalized models is a challenging problem. The maximum likelihood estimation (MLE) is computationally infeasible for these models since normalizing constants are not explicitly calculated. Although some…

Machine Learning · Statistics 2020-06-09 Masatoshi Uehara , Takafumi Kanamori , Takashi Takenouchi , Takeru Matsuda

In this article, we study the limit distribution of the least square estimator, properly normalized, from a regression model in which observations are assumed to be finite ($\alpha N$) and sampled under two different random times. Based on…

Statistics Theory · Mathematics 2020-12-17 Tania Roa , Soledad Torres , Ciprian tudor

We investigate nonparametric estimation of a monotone baseline hazard and a decreasing baseline density within the Cox model. Two estimators of a nondecreasing baseline hazard function are proposed. We derive the nonparametric maximum…

Statistics Theory · Mathematics 2013-01-10 Hendrik P. Lopuhaä , Gabriela F. Nane

Several statistical models are given in the form of unnormalized densities, and calculation of the normalization constant is intractable. We propose estimation methods for such unnormalized models with missing data. The key concept is to…

Machine Learning · Statistics 2020-06-11 Masatoshi Uehara , Takeru Matsuda , Jae Kwang Kim

We consider a one-dimensional diffusion process $(X_t)$ which is observed at $n+1$ discrete times with regular sampling interval $\Delta$. Assuming that $(X_t)$ is strictly stationary, we propose nonparametric estimators of the drift and…

Statistics Theory · Mathematics 2009-09-29 Fabienne Comte , Valentine Genon-Catalot , Yves Rozenholc