English
Related papers

Related papers: Optimal designs for estimating individual coeffici…

200 papers

The generalized linear models (GLMs) are widely used in statistical analysis and the related design issues are undoubtedly challenging. The state-of-the-art works mostly apply to design criteria on the estimates of regression coefficients.…

Methodology · Statistics 2020-04-21 Yiou Li , Xinwei Deng

Selecting input variables or design points for statistical models has been of great interest in adaptive design and active learning. Motivated by two scientific examples, this paper presents a strategy of selecting the design points for a…

Machine Learning · Statistics 2021-02-12 Chiwoo Park , Peihua Qiu , Jennifer Carpena-Núñez , Rahul Rao , Michael Susner , Benji Maruyama

The constrained mock-Chebyshev least squares operator is a linear approximation operator based on an equispaced grid of points. Like other polynomial or rational approximation methods, it was recently introduced in order to defeat the Runge…

Numerical Analysis · Mathematics 2022-09-21 Francesco Dell'Accio , Federico Nudo

The algebraic polynomial interpolation on uniformly distributed nodes is affected by the Runge phenomenon, also when the function to be interpolated is analytic. Among all techniques that have been proposed to defeat this phenomenon, there…

Numerical Analysis · Mathematics 2014-07-10 Stefano De Marchi , Francesco Dell'Accio , Mariarosa Mazza

We investigate the feature compression of high-dimensional ridge regression using the optimal subsampling technique. Specifically, based on the basic framework of random sampling algorithm on feature for ridge regression and the A-optimal…

Computation · Statistics 2022-04-19 Hanyu Li , Chengmei Niu

We consider a nonparametric regression setup, where the covariate is a random element in a complete separable metric space, and the parameter of interest associated with the conditional distribution of the response lies in a separable…

Statistics Theory · Mathematics 2018-11-16 Joydeep Chowdhury , Probal Chaudhuri

This paper addresses the analysis and design of quadratic neural networks, which have been recently introduced in the literature, and their applications to regression, classification, system identification and control of dynamical systems.…

Machine Learning · Computer Science 2022-07-28 Luis Rodrigues , Sidney Givigi

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

In clinical trials and other applications, we often see regions of the feature space that appear to exhibit interesting behaviour, but it is unclear whether these observed phenomena are reflected at the population level. Focusing on a…

Statistics Theory · Mathematics 2023-09-21 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

This paper presents a new estimator of the intercept of a linear regression model in cases where the outcome varaible is observed subject to a selection rule. The intercept is often in this context of inherent interest; for example, in a…

Econometrics · Economics 2018-09-26 Chuan Goh

We consider the problem of deriving from experimental data an approximation of an unknown function, whose derivatives also approximate the unknown function derivatives. Solving this problem is useful, for instance, in the context of…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Carlo Novara , Angelo Nicolì , Giuseppe C. Calafiore

Let $(Y,X_1,...,X_m)$ be a random vector. It is desired to predict $Y$ based on $(X_1,...,X_m)$. Examples of prediction methods are regression, classification using logistic regression or separating hyperplanes, and so on. We consider the…

Statistics Theory · Mathematics 2007-06-13 Eitan Greenshtein

Polynomial regression is widely used and can help to express nonlinear patterns. However, considering very high polynomial orders may lead to overfitting and poor extrapolation ability for unseen data. The paper presents a method for…

Machine Learning · Computer Science 2023-08-01 Andrei Ivanov , Stefan Maria Ailuro

Trigonometric polynomials are usually defined on the lattice of integers.We consider the larger class of weight and root lattices with crystallographic symmetry.This article gives a new approach to minimize trigonometric polynomials, which…

Algebraic Geometry · Mathematics 2025-11-25 Evelyne Hubert , Tobias Metzlaff , Philippe Moustrou , Cordian Riener

Suppose that $n$ statistical units are observed, each following the model $Y(x_j)=m(x_j)+ \epsilon(x_j),\, j=1,...,N,$ where $m$ is a regression function, $0 \leq x_1 <...<x_N \leq 1$ are observation times spaced according to a sampling…

Statistics Theory · Mathematics 2011-07-21 Karim Benhenni , David Degras

The multivariate integer Chebyshev problem is to find polynomials with integer coefficients that minimize the supremum norm over a compact set in $\C^d.$ We study this problem on general sets, but devote special attention to product sets…

Number Theory · Mathematics 2013-07-23 P. B. Borwein , I. E. Pritsker

In this paper for the first time the nonparametric autoregression estimation problem for the quadratic risks is considered. To this end we develop a new adaptive sequential model selection method based on the efficient sequential kernel…

Statistics Theory · Mathematics 2018-09-10 Ouerdia Arkoun , Jean-Yves Brua , Serguei Pergamenshchikov

Analysis of high-dimensional data has led to increased interest in both single index models (SIMs) and the best-subset selection. SIMs provide an interpretable and flexible modeling framework for high-dimensional data, while the best-subset…

Machine Learning · Statistics 2025-08-19 Borui Tang , Jin Zhu , Junxian Zhu , Xueqin Wang , Heping Zhang

This paper is about optimal estimation of the additive components of a nonparametric, additive isotone regression model. It is shown that asymptotically up to first order, each additive component can be estimated as well as it could be by a…

Statistics Theory · Mathematics 2007-09-12 Enno Mammen , Kyusang Yu

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

Statistics Theory · Mathematics 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov