English
Related papers

Related papers: Estimation in functional regression for general ex…

200 papers

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

In applications it is common that the exact form of a conditional expectation is unknown and having flexible functional forms can lead to improvements. Series method offers that by approximating the unknown function based on $k$ basis…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Denis Chetverikov , Kengo Kato

A finite sum of exponential functions may be expressed by a linear combination of powers of the independent variable and by successive integrals of the sum. This is proved for the general case and the connection between the parameters in…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Bernhard Kaufmann

We consider a high-dimensional linear regression problem. Unlike many papers on the topic, we do not require sparsity of the regression coefficients; instead, our main structural assumption is a decay of eigenvalues of the covariance matrix…

Statistics Theory · Mathematics 2021-10-01 Igor Silin , Jianqing Fan

We study the minimax rate of estimation in nonparametric exponential family regression under star-shaped constraints. Specifically, the parameter space $K$ is a star-shaped set contained within a bounded box $[-M, M]^n$, where $M$ is a…

Statistics Theory · Mathematics 2025-03-17 Guanghong Yi , Matey Neykov

The paper discusses inference techniques for semiparametric models based on suitable versions of inference functions. The text contains two parts. In the first part, we review the optimality theory for non-parametric models based on the…

Statistics Theory · Mathematics 2020-11-17 Rodrigo Labouriau

We consider the parameter estimation of Markov chain when the unknown transition matrix belongs to an exponential family of transition matrices. Then, we show that the sample mean of the generator of the exponential family is an…

Statistics Theory · Mathematics 2016-09-28 Masahito Hayashi , Shun Watanabe

We study optimal procedures for estimating a linear functional based on observational data. In many problems of this kind, a widely used assumption is strict overlap, i.e., uniform boundedness of the importance ratio, which measures how…

Statistics Theory · Mathematics 2023-01-18 Wenlong Mou , Peng Ding , Martin J. Wainwright , Peter L. Bartlett

Semiparametric exponential family proposed by Ning et al. (2017) is an extension of the parametric exponential family to the case with a nonparametric base measure function. Such a distribution family has potential application in some areas…

Methodology · Statistics 2017-12-01 Lu Lin , Lili Liu , Xia Cui

Most results in nonparametric regression theory are developed only for the case of additive noise. In such a setting many smoothing techniques including wavelet thresholding methods have been developed and shown to be highly adaptive. In…

Statistics Theory · Mathematics 2010-10-20 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

In the present work, we have investigated the problem of estimating parameters of several exponential distributions with ordered scale parameters under the linex loss function. We have considered estimating ordered scale parameters when the…

Statistics Theory · Mathematics 2023-02-08 Suchandan Kayal , Lakshmi Kanta Patra

Classical mathematical statistics deals with models that are parametrized by a Euclidean, i.e. finite dimensional, parameter. Quite often such models have been and still are chosen in practical situations for their mathematical simplicity…

Statistics Theory · Mathematics 2023-12-25 Chris A. J. Klaassen

In this paper, we consider the problem of parameter estimating for a family of exponential distributions. We develop the improved estimation method, which generalized the James--Stein approach for a wide class of distributions. The proposed…

Statistics Theory · Mathematics 2023-08-08 S. B. Kologrivova , E. A. Pchelintsev

In the nonparametric regression setting, we construct an estimator which is a continuous function interpolating the data points with high probability, while attaining minimax optimal rates under mean squared risk on the scale of H\"older…

Statistics Theory · Mathematics 2022-06-28 Julien Chhor , Suzanne Sigalla , Alexandre B. Tsybakov

We consider the question of learning the natural parameters of a $k$ parameter minimal exponential family from i.i.d. samples in a computationally and statistically efficient manner. We focus on the setting where the support as well as the…

Machine Learning · Computer Science 2021-11-01 Abhin Shah , Devavrat Shah , Gregory W. Wornell

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

This paper studies an approximation method for the log-likelihood function of a nonlinear diffusion process using the bridge of the diffusion. The main result (Theorem \refthm:approx) shows that this approximation converges uniformly to the…

Statistics Theory · Mathematics 2010-01-11 Aleksandar Mijatović , Paul Schneider

We propose an estimation procedure for linear functionals based on Gaussian model selection techniques. We show that the procedure is adaptive, and we give a non asymptotic oracle inequality for the risk of the selected estimator with…

Statistics Theory · Mathematics 2008-10-27 Béatrice Laurent , Carenne Ludeña , Clémentine Prieur

Reduced-rank regression is a dimensionality reduction method with many applications. The asymptotic theory for reduced rank estimators of parameter matrices in multivariate linear models has been studied extensively. In contrast, few…

Statistics Theory · Mathematics 2017-10-13 Efstathia Bura , Sabrina Duarte , Liliana Forzani , Ezequiel Smucler , Mariela Sued

Using the asymptotical minimax framework, we examine convergence rates equivalency between a continuous functional deconvolution model and its real-life discrete counterpart over a wide range of Besov balls and for the $L^2$-risk. For this…

Statistics Theory · Mathematics 2010-10-06 Marianna Pensky , Theofanis Sapatinas