English
Related papers

Related papers: Minimax Robust Designs for M-Estimated Models

200 papers

The problem of prediction in functional linear regression is conventionally addressed by reducing dimension via the standard principal component basis. In this paper we show that an alternative basis chosen through weighted least-squares,…

Methodology · Statistics 2009-02-20 Aurore Delaigle , Peter Hall , Tatiyana V. Apanasovich

Robustness analyzes the impact of small perturbations in the semantics of a model. This allows to model hardware imprecision and therefore it has been applied to determine implementability of timed automata. In a recent paper, we extend…

Software Engineering · Computer Science 2012-07-19 Louis-Marie Traonouez

This paper discusses the problem of determining optimal designs for regression models, when the observations are dependent and taken on an interval. A complete solution of this challenging optimal design problem is given for a broad class…

Methodology · Statistics 2015-02-25 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

In this article we study the asymptotic behaviour of the least square estimator in a linear regression model based on random observation instances. We provide mild assumptions on the moments and dependence structure on the randomly spaced…

Statistics Theory · Mathematics 2021-10-07 Karine Bertin , Soledad Torres , Lauri Viitasaari

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

Statistics Theory · Mathematics 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

This paper is concerned with the design and analysis of least squares solvers for ill-posed PDEs that are conditionally stable. The norms and the regularization term used in the least squares functional are determined by the ingredients of…

Numerical Analysis · Mathematics 2023-06-02 Wolfgang Dahmen , Harald Monsuur , Rob Stevenson

We propose a new prediction method for multivariate linear regression problems where the number of features is less than the sample size but the number of outcomes is extremely large. Many popular procedures, such as penalized regression…

Methodology · Statistics 2021-04-20 Yihe Wang , Sihai Dave Zhao

Hierarchical random effect models are used for different purposes in clinical research and other areas. In general, the main focus is on population parameters related to the expected treatment effects or group differences among all units of…

Applications · Statistics 2021-04-07 Maryna Prus , Norbert Benda , Rainer Schwabe

The concept of a minimax classifier is well-established in statistical decision theory, but its implementation via neural networks remains challenging, particularly in scenarios with imbalanced training data having a limited number of…

Machine Learning · Computer Science 2026-01-07 Hansung Choi , Daewon Seo

The aim of this article is to overview the problem of mean square optimal estimation of linear functionals which depend on unknown values of periodically correlated stochastic process. Estimates are based on observations of this process and…

Statistics Theory · Mathematics 2025-11-24 Iryna Dubovets'ka , Mykhailo Moklyachuk

Robust estimators for generalized linear models (GLMs) are not easy to develop due to the nature of the distributions involved. Recently, there has been growing interest in robust estimation methods, particularly in contexts involving a…

Methodology · Statistics 2025-07-08 Marina Valdora , Claudio Agostinelli

We consider the problem of designing minimax estimators for estimating the parameters of a probability distribution. Unlike classical approaches such as the MLE and minimum distance estimators, we consider an algorithmic approach for…

Machine Learning · Statistics 2020-06-23 Kartik Gupta , Arun Sai Suggala , Adarsh Prasad , Praneeth Netrapalli , Pradeep Ravikumar

The robust stability problem involves designing a controlled system which remains stable in the presence of modeling uncertainty. In this context, results known as small gain theorems are used to quantify the maximum amount of uncertainty…

Optimization and Control · Mathematics 2026-04-01 Gavin Glenn , Emma J. Reid

Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…

Statistics Theory · Mathematics 2015-07-28 Katarína Burclová , Andrej Pázman

In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. Recently, many flexible machine learning methods have been developed for instrumental variable estimation. However, these methods have at least one…

Machine Learning · Statistics 2023-02-13 Andrew Bennett , Nathan Kallus , Xiaojie Mao , Whitney Newey , Vasilis Syrgkanis , Masatoshi Uehara

This paper continues the research started in \cite{LW16}. In the framework of the convolution structure density model on $\bR^d$, we address the problem of adaptive minimax estimation with $\bL_p$--loss over the scale of anisotropic…

Statistics Theory · Mathematics 2017-04-17 Oleg Lepski , Thomas Willer

We study the supervised clustering problem under the two-component anisotropic Gaussian mixture model in high dimensions and in the non-asymptotic setting. We first derive a lower and a matching upper bound for the minimax risk of…

Statistics Theory · Mathematics 2021-11-16 Stanislav Minsker , Mohamed Ndaoud , Yiqiu Shen

Standard optimality criteria (e.g. A-, D-optimality criterion, etc.) have been commonly used for obtaining optimal designs. For a given statistical model, standard criteria assume the error variance is known at the design stage. However, in…

Methodology · Statistics 2017-01-27 Md. Shaddam Hossain Bagmar , Wasimul Bari , A. H. M. Mahbub Latif

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

For linear systems, many data-driven control methods rely on the behavioral framework, using historical data of the system to predict the future trajectories. However, measurement noise introduces errors in predictions. When the noise is…

Optimization and Control · Mathematics 2023-08-29 Baiwei Guo , Yuning Jiang , Colin N. Jones , Giancarlo Ferrari-Trecate