English
Related papers

Related papers: Adaptive Inference in Multivariate Nonparametric R…

200 papers

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

This paper considers nonparametric estimation and inference in first-order autoregressive (AR(1)) models with deterministically time-varying parameters. A key feature of the proposed approach is to allow for time-varying stationarity in…

Econometrics · Economics 2024-11-04 Donald W. K. Andrews , Ming Li

Modal regression has emerged as a flexible alternative to classical regression models when the conditional mean or median are unable to adequately capture the underlying relation between a response and a predictor variable. This approach is…

Methodology · Statistics 2025-04-08 Ana Pérez-González , Tomás R. Cotos-Yáñez , Rosa M. Crujeiras

Statistical inference for high dimensional parameters (HDPs) can be based on their intrinsic correlation; that is, parameters that are close spatially or temporally tend to have more similar values. This is why nonlinear mixed-effects…

Methodology · Statistics 2024-01-30 Nan Zheng , Noel Cadigan

We want to reconstruct a signal based on inhomogeneous data (the amount of data can vary strongly), using the model of regression with a random design. Our aim is to understand the consequences of inhomogeneity on the accuracy of estimation…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas

The objective of the present paper is to develop a minimax theory for the varying coefficient model in a non-asymptotic setting. We consider a high-dimensional sparse varying coefficient model where only few of the covariates are present…

Statistics Theory · Mathematics 2014-05-16 Olga Klopp , Marianna Pensky

We consider the model $Z_i=X_i+\varepsilon_i$, for i.i.d. $X_i$'s and $\varepsilon_i$'s and independent sequences $(X_i)_{i\in{\mathbb{N}}}$ and $(\varepsilon_i)_{i\in{\mathbb{N}}}$. The density $f_{\varepsilon}$ of $\varepsilon_1$ is…

Statistics Theory · Mathematics 2009-02-10 C. Butucea , F. Comte

Consider a nonparametric regression model with one-sided errors and regression function in a general H\"older class. We estimate the regression function via minimization of the local integral of a polynomial approximation. We show uniform…

Methodology · Statistics 2016-10-12 Holger Drees , Natalie Neumeyer , Leonie Selk

In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods…

Statistics Theory · Mathematics 2009-08-14 Xia Cui , Wensheng Guo , Lu Lin , Lixing Zhu

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

We construct efficient robust truncated sequential estimators for the pointwise estimation problem in nonparametric autoregression models with smooth coefficients. For Gaussian models we propose an adaptive procedure based on the…

Statistics Theory · Mathematics 2013-04-18 Ouerdia Arkoun , Serguei Pergamenchtchikov

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

This paper explores adaptive variance reduction methods for stochastic optimization based on the STORM technique. Existing adaptive extensions of STORM rely on strong assumptions like bounded gradients and bounded function values, or suffer…

Optimization and Control · Mathematics 2024-10-24 Wei Jiang , Sifan Yang , Yibo Wang , Lijun Zhang

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis,…

Statistics Theory · Mathematics 2012-05-02 Xiao Wang , Jinglai Shen

Isotonic regression provides a flexible, tuning-free approach to estimating monotonic functions without imposing global curvature constraints, yet the estimated regression function is inherently a step function. This paper addresses a key…

Methodology · Statistics 2026-05-19 Timo Kuosmanen , Juan F. Monge , José L. Ruiz , Xun Zhou

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics,…

Statistics Theory · Mathematics 2023-12-27 Akifumi Okuno , Masaaki Imaizumi

In this paper, we discuss the use of $\varepsilon$-admissibility for estimation in high-dimensional and nonparametric statistical models. The minimax rate of convergence is widely used to compare the performance of estimators in…

Statistics Theory · Mathematics 2017-08-15 Keisuke Yano , Fumiyasu Komaki

We study online adversarial regression with convex losses against a rich class of continuous yet highly irregular prediction rules, modeled by Besov spaces $B\_{pq}^s$ with general parameters $1 \leq p,q \leq \infty$ and smoothness $s >…

Statistics Theory · Mathematics 2025-09-23 Paul Liautaud , Pierre Gaillard , Olivier Wintenberger

We propose simple active sampling and reweighting strategies for optimizing min-max fairness that can be applied to any classification or regression model learned via loss minimization. The key intuition behind our approach is to use at…

We develop a version of variational inference for Bayesian count response regression-type models that possesses attractive attributes such as convexity and closed form updates. The convex solution aspect entails numerically stable fitting…

Methodology · Statistics 2026-02-25 Virginia Murru , Matt P. Wand