English
Related papers

Related papers: Optimal designs for estimating individual coeffici…

200 papers

In this paper we study the statistical properties of Principal Components Regression with Laplacian Eigenmaps (PCR-LE), a method for nonparametric regression based on Laplacian Eigenmaps (LE). PCR-LE works by projecting a vector of observed…

Statistics Theory · Mathematics 2021-11-16 Alden Green , Sivaraman Balakrishnan , Ryan J. Tibshirani

We establish minimax optimal rates of convergence for nonparametric estimation in functional ANOVA models when data from first-order partial derivatives are available. Our results reveal that partial derivatives can improve convergence…

Statistics Theory · Mathematics 2017-09-12 Xiaowu Dai , Peter Chien

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

The theory of Chebyshev (uniform) approximation for univariate polynomial and piecewise polynomial functions has been studied for decades. The optimality conditions are based on the notion of alternating sequence. However, the extension the…

Numerical Analysis · Mathematics 2017-09-01 Nadezda Sukhorukova , Julien Ugon , David Yost

The Chebyshev or $\ell_{\infty}$ estimator is an unconventional alternative to the ordinary least squares in solving linear regressions. It is defined as the minimizer of the $\ell_{\infty}$ objective function \begin{align*}…

Statistics Theory · Mathematics 2023-03-16 Yufei Yi , Matey Neykov

We consider the non-parametric Poisson regression problem where the integer valued response $Y$ is the realization of a Poisson random variable with parameter $\lambda(X)$. The aim is to estimate the functional parameter $\lambda$ from…

Statistics Theory · Mathematics 2018-05-14 Martin Kroll

To avoid multicollinearity in regression analysis, Ye and Zhou(2013) proposed $K-$optimality criterion. By far the most popular models for modeling the response of a mixture experiment are the Scheff\'{e} models. However, there have been no…

Statistics Theory · Mathematics 2022-10-17 Hao-sheng Jiang , Jia-li Chen , Chong-qi Zhang

We study regression discontinuity designs in which many predetermined covariates, possibly much more than the number of observations, can be used to increase the precision of treatment effect estimates. We consider a two-step estimator…

Econometrics · Economics 2022-05-06 Alexander Kreiß , Christoph Rothe

We present a new method for nonlinear prediction of discrete random sequences under minimal structural assumptions. We give a mathematical construction for optimal predictors of such processes, in the form of hidden Markov models. We then…

Machine Learning · Computer Science 2011-11-09 Cosma Rohilla Shalizi , Kristina Lisa Shalizi

In this paper we analyze the use of Chebyshev polynomials in distributed consensus applications. We study the properties of these polynomials to propose a distributed algorithm that reaches the consensus in a fast way. The algorithm is…

Systems and Control · Computer Science 2012-06-07 Eduardo Montijano , Juan I. Montijano , Carlos Sagues

Classical approximation bases such as Chebyshev polynomials provide principled and interpretable representations, but their multivariate tensor-product constructions scale exponentially with dimension and impose axis-aligned structure that…

Machine Learning · Computer Science 2026-04-07 Milo Coombs

We design a new algorithm on the best subset selection model in reduced rank regression.

Methodology · Statistics 2020-06-09 Canhong Wen , Weiyu Li , Junxian Zhu , Xueqin Wang

We extend the approach in [Ann. Statist. 38 (2010) 2499-2524] for identifying locally optimal designs for nonlinear models. Conceptually the extension is relatively simple, but the consequences in terms of applications are profound. As we…

Statistics Theory · Mathematics 2012-10-04 Min Yang , John Stufken

We consider the problem of designing experiments for the estimation of a target in regression analysis if there is uncertainty about the parametric form of the regression function. A new optimality criterion is proposed, which minimizes the…

Methodology · Statistics 2018-07-17 Kira Alhorn , Kirsten Schorning , Holger Dette

Best subset selection in linear regression is well known to be nonconvex and computationally challenging to solve, as the number of possible subsets grows rapidly with increasing dimensionality of the problem. As a result, finding the…

Machine Learning · Statistics 2025-04-01 Vikram Singh , Min Sun

In this paper we deal with the regression problem in a random design setting. We investigate asymptotic optimality under minimax point of view of various Bayesian rules based on warped wavelets and show that they nearly attain optimal…

Statistics Theory · Mathematics 2009-08-21 Thanh Mai Pham Ngoc

Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…

Statistics Theory · Mathematics 2015-07-28 Katarína Burclová , Andrej Pázman

This article is concerned with the fitting of multinomial regression models using the so-called "Poisson Trick". The work is motivated by Chen & Kuo (2001) and Malchow-M{\o}ller & Svarer (2003) which have been criticized for being…

Methodology · Statistics 2017-07-27 Jarod Y. L. Lee , Peter J. Green , Louise M. Ryan

Bayesian optimality criteria provide a robust design strategy to parameter misspecification. We develop an approximate design theory for Bayesian $D$-optimality for non-linear regression models with covariates subject to measurement errors.…

Methodology · Statistics 2016-05-16 Maria Konstantinou , Holger Dette

Many existing methods for constructing optimal split-plot designs, such as D-optimal designs, only focus on minimizing the variances and covariances of the estimation for the fitted model. However, the underlying true model is usually…

Computation · Statistics 2016-08-02 Chang-Yun Lin