English
Related papers

Related papers: Estimation adaptative dans le mod\`ele single-inde…

200 papers

This paper deals with the nonparametric estimation in heteroscedastic regression $ Y_i=f(X_i)+\xi_i, \: i=1,...,n $, with incomplete information, i.e. each real random variable $ \xi_i $ has a density $ g_{i} $ which is unknown to the…

Statistics Theory · Mathematics 2011-05-10 Michaël Chichignoud

We consider the non-parametric Poisson regression problem where the integer valued response $Y$ is the realization of a Poisson random variable with parameter $\lambda(X)$. The aim is to estimate the functional parameter $\lambda$ from…

Statistics Theory · Mathematics 2018-05-14 Martin Kroll

We propose an active-learning method for nonlinear minimax regression. Given a nonlinear function that can be arbitrarily evaluated over a compact set, we fit a surrogate model, such as a feedforward neural network, by minimizing the…

Systems and Control · Electrical Eng. & Systems 2026-04-24 Alberto Bemporad

Inhomogeneous random graph models encompass many network models such as stochastic block models and latent position models. We consider the problem of statistical estimation of the matrix of connection probabilities based on the…

Statistics Theory · Mathematics 2017-09-14 Olga Klopp , Alexandre B. Tsybakov , Nicolas Verzelen

The distributional single index model is a semiparametric regression model in which the conditional distribution functions $P(Y \leq y | X = x) = F_0(\theta_0(x), y)$ of a real-valued outcome variable $Y$ depend on $d$-dimensional…

Statistics Theory · Mathematics 2024-01-23 Fadoua Balabdaoui , Alexander Henzi , Lukas Looser

We consider the problem of adaptive estimation of the functional component in a multivariate partial linear model where the argument of the function is defined on a $q$-dimensional grid. Obtaining an adaptive estimator of this functional…

Statistics Theory · Mathematics 2017-12-27 Michael Levine

This paper considers adaptive, minimax estimation of a quadratic functional in a nonparametric instrumental variables (NPIV) model, which is an important problem in optimal estimation of a nonlinear functional of an ill-posed inverse…

Statistics Theory · Mathematics 2022-02-10 Christoph Breunig , Xiaohong Chen

In this paper, we consider adaptive estimation of an unknown planar compact, convex set from noisy measurements of its support function on a uniform grid. Both the problem of estimating the support function at a point and that of estimating…

Statistics Theory · Mathematics 2015-08-18 Tony Cai , Adityanand Guntuboyina , Yuting Wei

In this paper, we analyze the behavior of various non-parametric local regression estimators, i.e. estimators that are based on local averaging, for estimating a Lipschitz regression function at a fixed point, or in sup-norm. We first prove…

Statistics Theory · Mathematics 2025-07-11 Jérémy Bettinger , François Portier , Adrien Saumard

In one-dimensional density estimation on i.i.d. observations we suggest an adaptive cross-validation technique for the selection of a kernel estimator. This estimator is both asymptotic MISE-efficient with respect to the monotone oracle,…

Statistics Theory · Mathematics 2007-06-13 Clementine Dalelane

An adaptive regularization algorithm using inexact function and derivatives evaluations is proposed for the solution of composite nonsmooth nonconvex optimization. It is shown that this algorithm needs at most…

Optimization and Control · Mathematics 2019-02-28 S. Gratton , E. Simon , Ph. L. Toint

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

Machine Learning · Statistics 2025-11-20 Gábor Balázs

We propose a model selection approach for covariance estimation of a multi-dimensional stochastic process. Under very general assumptions, observing i.i.d replications of the process at fixed observation points, we construct an estimator of…

Statistics Theory · Mathematics 2009-09-29 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

We investigate whether in a distributed setting, adaptive estimation of a smooth function at the optimal rate is possible under minimal communication. It turns out that the answer depends on the risk considered and on the number of servers…

Statistics Theory · Mathematics 2020-03-31 Botond Szabo , Harry van Zanten

This paper describes an estimator of the additive components of a nonparametric additive model with a known link function. When the additive components are twice continuously differentiable, the estimator is asymptotically normally…

Statistics Theory · Mathematics 2007-06-13 Joel L. Horowitz , Enno Mammen

We consider the problem of model selection type aggregation in the context of density estimation. We first show that empirical risk minimization is sub-optimal for this problem and it shares this property with the exponential weights…

Statistics Theory · Mathematics 2016-09-29 Pierre C. Bellec

We study the problem of learning Single-Index Models under the $L_2^2$ loss in the agnostic model. We give an efficient learning algorithm, achieving a constant factor approximation to the optimal loss, that succeeds under a range of…

Machine Learning · Computer Science 2024-02-28 Nikos Zarifis , Puqian Wang , Ilias Diakonikolas , Jelena Diakonikolas

We consider estimation in the single index model where the link function is monotone. For this model a profile least squares estimator has been proposed to estimate the unknown link function and index. Although it is natural to propose this…

Statistics Theory · Mathematics 2018-10-24 Fadoua Balabdaoui , Piet Groeneboom , Kim Hendrickx

Distributed minimax estimation and distributed adaptive estimation under communication constraints for Gaussian sequence model and white noise model are studied. The minimax rate of convergence for distributed estimation over a given Besov…

Statistics Theory · Mathematics 2021-07-02 T. Tony Cai , Hongji Wei