English
Related papers

Related papers: Estimation in the convolution structure density mo…

200 papers

We study optimal procedures for estimating a linear functional based on observational data. In many problems of this kind, a widely used assumption is strict overlap, i.e., uniform boundedness of the importance ratio, which measures how…

Statistics Theory · Mathematics 2023-01-18 Wenlong Mou , Peng Ding , Martin J. Wainwright , Peter L. Bartlett

This paper applies the recently axiomatized Optimum Information Principle (minimize the Kullback-Leibler information subject to all relevant information) to nonparametric density estimation, which provides a theoretical foundation as well…

Statistics Theory · Mathematics 2011-03-28 Alexis Akira Toda

Motivated by applications in statistics and machine learning, we consider a problem of unmixing convex combinations of nonparametric densities. Suppose we observe $n$ groups of samples, where the $i$th group consists of $N_i$ independent…

Statistics Theory · Mathematics 2026-03-31 Jianqing Fan , Zheng Tracy Ke , Zhaoyang Shi

We consider a linear model where the coefficients - intercept and slopes - are random with a law in a nonparametric class and independent from the regressors. Identification often requires the regressors to have a support which is the whole…

Statistics Theory · Mathematics 2020-06-22 Christophe Gaillac , Eric Gautier

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

We consider the estimation of two-sample integral functionals, of the type that occur naturally, for example, when the object of interest is a divergence between unknown probability densities. Our first main result is that, in wide…

Statistics Theory · Mathematics 2023-01-31 Thomas B. Berrett , Richard J. Samworth

In this paper, we consider a high-dimensional quantile regression model where the sparsity structure may differ between two sub-populations. We develop $\ell_1$-penalized estimators of both regression coefficients and the threshold…

Methodology · Statistics 2018-12-07 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

This paper is concerned with general nonlinear regression models where the predictor variables are subject to Berkson-type measurement errors. The measurement errors are assumed to have a general parametric distribution, which is not…

Statistics Theory · Mathematics 2009-08-21 Liqun Wang

Several new estimation methods have been recently proposed for the linear regression model with observation error in the design. Different assumptions on the data generating process have motivated different estimators and analysis. In…

Statistics Theory · Mathematics 2014-12-24 Alexandre Belloni , Mathieu Rosenbaum , Alexandre B. Tsybakov

Variable selection for models including interactions between explanatory variables often needs to obey certain hierarchical constraints. The weak or strong structural hierarchy requires that the existence of an interaction term implies at…

Statistics Theory · Mathematics 2016-11-10 Yiyuan She , Zhifeng Wang , He Jiang

In this paper,we consider a high-dimensional statistical estimation problem in which the the number of parameters is comparable or larger than the sample size. We present a unified analysis of the performance guarantees of exponential…

Statistics Theory · Mathematics 2017-10-04 Tung Duy Luu , Jalal Fadili , Christophe Chesneau

In this paper, we introduce a new estimator for the emission densities of a nonparametric hidden Markov model. It is adaptive and minimax with respect to each state's regularity--as opposed to globally minimax estimators, which adapt to the…

Statistics Theory · Mathematics 2018-07-17 Luc Lehéricy

We consider estimation of the common probability density $f$ of i.i.d. random variables $X_i$ that are observed with an additive i.i.d. noise. We assume that the unknown density $f$ belongs to a class $\mathcal{A}$ of densities whose…

Statistics Theory · Mathematics 2007-06-13 Cristina Butucea , Alexandre B. Tsybakov

In this paper, we introduce a general theoretical framework for nonparametric hazard rate estimation using associated kernels, whose shapes depend on the point of estimation. Within this framework, we establish rigorous asymptotic results,…

Statistics Theory · Mathematics 2025-10-07 Luce Breuil , Sarah Kaakaï

A general many quantiles + noise model is studied in the robust formulation (allowing non-normal, non-independent observations), where the identifiability requirement for the noise is formulated in terms of quantiles rather than the…

Statistics Theory · Mathematics 2022-11-21 Eduard Belitser , Paulo Serra , Alexandra Vegelien

We define a general method for finding a quasi-best approximant in sup-norm to a target density belonging to a given model, based on independent samples drawn from distributions which average to the target (which does not necessarily belong…

Statistics Theory · Mathematics 2025-06-26 Guillaume Maillard

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

Inhomogeneous random graph models encompass many network models such as stochastic block models and latent position models. We consider the problem of statistical estimation of the matrix of connection probabilities based on the…

Statistics Theory · Mathematics 2017-09-14 Olga Klopp , Alexandre B. Tsybakov , Nicolas Verzelen

In this paper, we investigate the almost sure convergence, in supremum norm, of the rank-based linear wavelet estimator for a multivariate copula density. Based on empirical process tools, we prove a uniform limit law for the deviation,…

Statistics Theory · Mathematics 2023-03-13 Cheikh Tidiane Seck , Salha Mamane