English
Related papers

Related papers: Scale estimation and data-driven tuning constant s…

200 papers

We consider robust location-scale estimators under contamination. We show that commonly used robust estimators such as the median and the Huber estimator are inconsistent under asymmetric contamination, while the Tukey estimator is…

Statistics Theory · Mathematics 2025-02-14 Jens Klooster , Bent Nielsen

Dealing with distribution shifts is one of the central challenges for modern machine learning. One fundamental situation is the covariate shift, where the input distributions of data change from training to testing stages while the…

Machine Learning · Computer Science 2024-05-28 Yu-Jie Zhang , Zhen-Yu Zhang , Peng Zhao , Masashi Sugiyama

We propose a bivariate quantile regression method for the bivariate varying coefficient model through a directional approach. The varying coefficients are approximated by the B-spline basis and an $L_{2}$ type penalty is imposed to achieve…

Methodology · Statistics 2015-11-10 Linglong Kong , Haoxu Shu , Giseon Heo , Qianchuan Chad He

In this paper we propose and discuss variance reduction techniques for the estimation of quantiles of the output of a complex model with random input parameters. These techniques are based on the use of a reduced model, such as a metamodel…

Methodology · Statistics 2009-01-27 Claire Cannamela , Josselin Garnier , Bertrand Iooss

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

Statistical Finance · Quantitative Finance 2017-11-27 Joongyeub Yeo , George Papanicolaou

The method of stable random projections is a tool for efficiently computing the $l_\alpha$ distances using low memory, where $0<\alpha \leq 2$ is a tuning parameter. The method boils down to a statistical estimation task and various…

Machine Learning · Computer Science 2008-12-18 Ping Li

A main goal of regression is to derive statistical conclusions on the conditional distribution of the output variable Y given the input values x. Two of the most important characteristics of a single distribution are location and scale.…

Machine Learning · Statistics 2011-11-09 Robert Hable , Andreas Christmann

Linear regression estimators are known to be sensitive to outliers, and one alternative to obtain a robust and efficient estimator of the regression parameter is to model the error with Student's $t$ distribution. In this article, we…

Methodology · Statistics 2026-03-19 Amanda Ng , Shangkai Zhu , Archer Gong Zhang , Nancy Reid

We propose a novel sampling-based federated learning framework for statistical inference on M-estimators with non-smooth objective functions, which frequently arise in modern statistical applications such as quantile regression and AUC…

Methodology · Statistics 2025-05-06 Xiudi Li , Lu Tian , Tianxi Cai

This paper studies inference in predictive quantile regressions when the predictive regressor has a near-unit root. We derive asymptotic distributions for the quantile regression estimator and its heteroskedasticity and autocorrelation…

Econometrics · Economics 2024-05-07 Alex Maynard , Katsumi Shimotsu , Nina Kuriyama

In adaptive-sampling control, the control frequency can be adjusted during task execution. Ensuring that these changes do not jeopardize the safety of the system being controlled requires attention. We introduce robust M-step hold model…

Systems and Control · Electrical Eng. & Systems 2026-05-08 Spencer Schutz , Charlott Vallon , Francesco Borrelli

In this paper we propose a new parameter estimator that ensures global exponential convergence of linear regression models requiring only the necessary assumption of identifiability of the regression equation,which we show is equivalent to…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Lei Wang , Romeo Ortega , Alexey Bobtsov , Jose Guadalupe Romero , Bowen Yi

Fine-tuning pretrained models has become a standard approach to adapting pretrained knowledge to improve the accuracy on new sparse, imbalance datasets. However, issues arise when optimization falls into a collapsed state, where the model…

Machine Learning · Computer Science 2026-05-01 Nghia Bui , Lijing Wang

This paper considers an estimation of semiparametric functional (varying)-coefficient quantile regression with spatial data. A general robust framework is developed that treats quantile regression for spatial data in a natural…

Statistics Theory · Mathematics 2014-02-06 Zudi Lu , Qingguo Tang , Longsheng Cheng

We propose Multivariate Quantile Function Forecaster (MQF$^2$), a global probabilistic forecasting method constructed using a multivariate quantile function and investigate its application to multi-horizon forecasting. Prior approaches are…

Estimating causal effects from observational data informs us about which factors are important in an autonomous system, and enables us to take better decisions. This is important because it has applications in selecting a treatment in…

Machine Learning · Computer Science 2021-10-29 Plabon Shaha , Talha Islam Zadid , Ismat Rahman , Md. Mosaddek Khan

This paper deals with the nonparametric estimation in heteroscedastic regression $ Y_i=f(X_i)+\xi_i, \: i=1,...,n $, with incomplete information, i.e. each real random variable $ \xi_i $ has a density $ g_{i} $ which is unknown to the…

Statistics Theory · Mathematics 2011-05-10 Michaël Chichignoud

Cluster-randomized experiments are increasingly used to evaluate interventions in routine practice conditions, and researchers often adopt model-based methods with covariate adjustment in the statistical analyses. However, the validity of…

Methodology · Statistics 2023-12-08 Bingkai Wang , Chan Park , Dylan S. Small , Fan Li

In this paper we propose a solution to the problem of parameter estimation of nonlinearly parameterized regressions--continuous or discrete time--and apply it for system identification and adaptive control. We restrict our attention to…

Optimization and Control · Mathematics 2019-10-18 Romeo Ortega , Vladislav Gromov , Emmanuel Nuño , Anton Pyrkin , Jose Guadalupe Romero

We present a stochastic constrained output-feedback data-driven predictive control scheme for linear time-invariant systems subject to bounded additive disturbances. The approach uses data-driven predictors based on an extension of Willems'…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Johannes Teutsch , Sebastian Kerz , Dirk Wollherr , Marion Leibold