English
Related papers

Related papers: Experimental Designs for Heteroskedastic Variance

200 papers

In this paper, we develop new statistical theory for probabilistic principal component analysis models in high dimensions. The focus is the estimation of the noise variance, which is an important and unresolved issue when the number of…

Statistics Theory · Mathematics 2014-06-23 Damien Passemier , Zhaoyuan Li , Jian-Feng Yao

The development of nonlinear optimization algorithms capable of performing reliably in the presence of noise has garnered considerable attention lately. This paper advocates for strategies to create noise-tolerant nonlinear optimization…

Optimization and Control · Mathematics 2024-10-04 Yuchen Lou , Shigeng Sun , Jorge Nocedal

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

This paper is to study a signal-plus-noise model in high dimensional settings when the dimension and the sample size are comparable. Specifically, we assume that the noise has a general covariance matrix that allows for heteroskedasticity,…

Statistics Theory · Mathematics 2025-05-13 Xiaoyu Liu , Yiming Liu , Guangming Pan , Lingyue Zhang , Zhixiang Zhang

We consider the problem of designing experiments to detect the presence of a specified heteroscedastity in a non-linear Gaussian regression model. In this framework, we focus on the ${\rm D}_s$- and KL-criteria and study their relationship…

Statistics Theory · Mathematics 2022-07-01 Alessandro Lanteri , Samantha Leorato , Jesús López-Fidalgo , Chiara Tommasi

Bayesian optimisation is a sample-efficient search methodology that holds great promise for accelerating drug and materials discovery programs. A frequently-overlooked modelling consideration in Bayesian optimisation strategies however, is…

In this work, we consider the problem of optimal design of an acoustic cloak under uncertainty and develop scalable approximation and optimization methods to solve this problem. The design variable is taken as an infinite-dimensional…

Optimization and Control · Mathematics 2021-03-17 Peng Chen , Michael R. Haberman , Omar Ghattas

We propose a variance-penalized formulation of Bayesian optimal experimental design for nonlinear models that augments the classical expected utility criterion with a penalty on utility variability, yielding a mean--variance objective that…

Methodology · Statistics 2026-04-07 Wanggang Shen , Xun Huan

Heteroskedastic errors can lead to inaccurate statistical conclusions if they are not properly handled. We introduce a test for heteroskedasticity for the nonparametric regression model with multiple covariates. It is based on a suitable…

Methodology · Statistics 2018-02-21 Justin Chown , Ursula U. Müller

Horizontal line arrays are often employed in underwater environments to estimate the direction of arrival (DOA) of a weak signal. Conventional beamforming (CB) is robust but has wide beamwidths and high-level sidelobes. High-resolution…

Signal Processing · Electrical Eng. & Systems 2020-12-09 Qi Zhang , Jiang Zhu , Yuantao Gu , Zhiwei Xu

We study random designs that minimize the asymptotic variance of a de-biased lasso estimator when a large pool of unlabeled data is available but measuring the corresponding responses is costly. The optimal sampling distribution arises as…

Statistics Theory · Mathematics 2020-10-27 Hamid Eftekhari , Moulinath Banerjee , Ya'acov Ritov

Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery. In this work, we explore heteroscedastic symmetric noise models (HSNMs), where…

Machine Learning · Computer Science 2025-04-22 Yingyu Lin , Yuxing Huang , Wenqin Liu , Haoran Deng , Ignavier Ng , Kun Zhang , Mingming Gong , Yi-An Ma , Biwei Huang

We study the problem of testing $H_0: \xi^\top\beta=t_0$ in high-dimensional sparse linear regression with Gaussian random design and unknown design covariance. The loading vector $\xi$ is arbitrary, and the exact sparsity level $k$ is…

Statistics Theory · Mathematics 2026-05-21 Jie Xie , Dongming Huang

Pairwise Euclidean distance calculation is a fundamental step in many machine learning and data analysis algorithms. In real-world applications, however, these distances are frequently distorted by heteroskedastic noise$\unicode{x2014}$a…

Machine Learning · Statistics 2025-09-12 Keyi Li , Yuval Kluger , Boris Landa

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

Machine Learning · Statistics 2022-03-22 Joshua K. Behne , Galen Reeves

A new gradient-based adaptive sampling method is proposed for design of experiments applications which balances space filling, local refinement, and error minimization objectives while reducing reliance on delicate tuning parameters. High…

Methodology · Statistics 2024-05-09 Lucas Caparini , Gwynn J. Elfring , Mauricio Ponga

Regression discontinuity designs assess causal effects in settings where treatment is determined by whether an observed running variable crosses a pre-specified threshold. Here we propose a new approach to identification, estimation, and…

Methodology · Statistics 2025-04-01 Dean Eckles , Nikolaos Ignatiadis , Stefan Wager , Han Wu

This work studies an experimental design problem where {the values of a predictor variable, denoted by $x$}, are to be determined with the goal of estimating a function $m(x)$, which is observed with noise. A linear model is fitted to…

Statistics Theory · Mathematics 2023-05-03 David Azriel

Designs which are minimax in the presence of model misspecifications have been constructed so as to minimize the maximum, over classes of alternate response models, of the integrated mean squared error of the predicted values. This mean…

Statistics Theory · Mathematics 2026-03-05 Douglas P. Wiens

Many real-world experimental design problems (a) evaluate multiple experimental conditions in parallel and (b) replicate each condition multiple times due to large and heteroscedastic observation noise. Given a fixed total budget, this…