English
Related papers

Related papers: Minimax Risk in Estimating Kink Threshold and Test…

200 papers

We provide new theoretical results in the field of inverse regression methods for dimension reduction. Our approach is based on the study of some empirical processes that lie close to a certain dimension reduction subspace, called the…

Statistics Theory · Mathematics 2015-06-02 François Portier

We consider a linear regression model, with the parameter of interest a specified linear combination of the regression parameter vector. We suppose that, as a first step, a data-based model selection (e.g. by preliminary hypothesis tests or…

Statistics Theory · Mathematics 2011-09-27 Paul Kabaila , Khageswor Giri

We give improved constants for data dependent and variance sensitive confidence bounds, called empirical Bernstein bounds, and extend these inequalities to hold uniformly over classes of functionswhose growth function is polynomial in the…

Machine Learning · Statistics 2009-07-23 Andreas Maurer , Massimiliano Pontil

We consider the problem of estimating an unknown $\theta\in {\mathbb{R}}^n$ from noisy observations under the constraint that $\theta$ belongs to certain convex polyhedral cones in ${\mathbb{R}}^n$. Under this setting, we prove bounds for…

Statistics Theory · Mathematics 2015-07-31 Sabyasachi Chatterjee , Adityanand Guntuboyina , Bodhisattva Sen

We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where $p<n$ but $p/n$ is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist…

Methodology · Statistics 2016-08-03 Noureddine El Karoui , Elizabeth Purdom

We consider the issue of performing accurate small sample inference in beta autoregressive moving average model, which is useful for modeling and forecasting continuous variables that assumes values in the interval $(0,1)$. The inferences…

Computation · Statistics 2017-02-16 Bruna Gregory Palm , Fábio M. Bayer

We perform a study on kernel regression for large-dimensional data (where the sample size $n$ is polynomially depending on the dimension $d$ of the samples, i.e., $n\asymp d^{\gamma}$ for some $\gamma >0$ ). We first build a general tool to…

Machine Learning · Statistics 2024-07-01 Weihao Lu , Haobo Zhang , Yicheng Li , Manyun Xu , Qian Lin

In statistical exercises where there are several candidate models, the traditional approach is to select one model using some data driven criterion and use that model for estimation, testing and other purposes, ignoring the variability of…

Statistics Theory · Mathematics 2008-12-18 Snigdhansu Chatterjee , Nitai D. Mukhopadhyay

This paper examines the precision of estimators of Quantile-Based Risk Measures (Value at Risk, Expected Shortfall, Spectral Risk Measures). It first addresses the question of how to estimate the precision of these estimators, and proposes…

Risk Management · Quantitative Finance 2011-03-30 Kevin Dowd , John Cotter

This paper examines nonparametric regression with an exogenous threshold variable, allowing for an unknown number of thresholds. Given the number of thresholds and corresponding threshold values, we first establish the asymptotic properties…

Economics · Quantitative Finance 2018-02-26 Yan-Yu Chiou , Mei-Yuan Chen , Jau-er Chen

Sparse linear regression is one of the classical and extensively studied problems in high-dimensional statistics and compressed sensing. Despite the substantial body of literature dedicated to this problem, the precise determination of its…

Statistics Theory · Mathematics 2024-05-10 Yilin Guo , Shubhangi Ghosh , Haolei Weng , Arian Maleki

We investigate the stochastic Thresholding Bandit problem (TBP) under several shape constraints. On top of (i) the vanilla, unstructured TBP, we consider the case where (ii) the sequence of arm's means $(\mu_k)_k$ is monotonically…

Machine Learning · Computer Science 2021-02-24 James Cheshire , Pierre Menard , Alexandra Carpentier

In this paper we propose a new test of heteroscedasticity for parametric regression models and partial linear regression models in high dimensional settings. When the dimension of covariates is large, existing tests of heteroscedasticity…

Methodology · Statistics 2018-08-09 Falong Tan , Xuejun Jiang , Xu Guo , Lixing Zhu

We consider the problem of estimating the regression function in functional linear regression models by proposing a new type of projection estimators which combine dimension reduction and thresholding. The introduction of a threshold rule…

Methodology · Statistics 2009-12-19 Herve Cardot , Jan Johannes

Building on recent studies of large-dimensional kernel regression, particularly those involving inner product kernels on the sphere $\mathbb{S}^{d}$, we investigate the Pinsker bound for inner product kernel regression in such settings.…

Statistics Theory · Mathematics 2025-06-05 Weihao Lu , Jialin Ding , Haobo Zhang , Qian Lin

We consider a binary sequence generated by thresholding a hidden continuous sequence. The hidden variables are assumed to have a compound symmetry covariance structure with a single parameter characterizing the common correlation. We study…

Statistics Theory · Mathematics 2019-09-04 Haolei Weng , Yang Feng

For a regression model, we consider the risk of the maximum likelihood estimator with respect to $\alpha$-divergence, which includes the special cases of Kullback-Leibler divergence, Hellinger distance and $\chi^2$ divergence. The…

Statistics Theory · Mathematics 2017-09-12 Yo Sheena

The paper studies a problem of constructing simultaneous likelihood-based confidence sets. We consider a simultaneous multiplier bootstrap procedure for estimating the quantiles of the joint distribution of the likelihood ratio statistics,…

Statistics Theory · Mathematics 2015-06-19 Mayya Zhilova

One of the most commonly used methods for forming confidence intervals for statistical inference is the empirical bootstrap, which is especially expedient when the limiting distribution of the estimator is unknown. However, despite its…

Statistics Theory · Mathematics 2020-11-24 Morgane Austern , Vasilis Syrgkanis

The overwhelming majority of empirical research that uses cluster-robust inference assumes that the clustering structure is known, even though there are often several possible ways in which a dataset could be clustered. We propose two tests…

Econometrics · Economics 2023-03-14 James G. MacKinnon , Morten Ørregaard Nielsen , Matthew D. Webb