English
Related papers

Related papers: Experimental Designs for Heteroskedastic Variance

200 papers

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

Optimal experimental design provides a way of determining a-priori the best locations at which to place accelerometers in vibrations analysis experiments. However, in practice, sensors often fail during experimentation due high mechanical…

Computational Engineering, Finance, and Science · Computer Science 2026-04-17 Rebekah White , Chandler Smith , Drew Kouri , Jace Ritchie , Wilkins Aquino , Timothy Walsh

With an ever-expanding ecosystem of noisy and intermediate-scale quantum devices, exploring their possible applications is a rapidly growing field of quantum information science. In this work, we demonstrate that variational quantum…

Quantum Physics · Physics 2021-07-16 Johannes Jakob Meyer , Johannes Borregaard , Jens Eisert

Suppose that we observe $y \in \mathbb{R}^f$ and $X \in \mathbb{R}^{f \times m}$ in the following errors-in-variables model: \begin{eqnarray*} y & = & X_0 \beta^* + \epsilon \\ X & = & X_0 + W \end{eqnarray*} where $X_0$ is a $f \times m$…

Statistics Theory · Mathematics 2015-12-21 Mark Rudelson , Shuheng Zhou

Analysis of high-dimensional data, where the number of covariates is larger than the sample size, is a topic of current interest. In such settings, an important goal is to estimate the signal level $\tau^2$ and noise level $\sigma^2$, i.e.,…

Statistics Theory · Mathematics 2023-07-26 Ilan Livne

We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an $\varepsilon$-fraction of our samples were chosen by an adversary. We give robust estimators that achieve…

Data Structures and Algorithms · Computer Science 2017-11-07 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

We present a result according to which certain functions of covariance matrices are maximized at scalar multiples of the identity matrix. This is used to show that experimental designs that are optimal under an assumption of independent,…

Statistics Theory · Mathematics 2024-01-18 Douglas P. Wiens

Exploiting the information provided by the molecular noise of a biological process has proven to be valuable in extracting knowledge about the underlying kinetic parameters and sources of variability from single cell measurements. However,…

Quantitative Methods · Quantitative Biology 2013-08-30 Jakob Ruess , Andreas Milias-Argeitis , John Lygeros

In the standard Gaussian linear measurement model $Y=X\mu_0+\xi \in \mathbb{R}^m$ with a fixed noise level $\sigma>0$, we consider the problem of estimating the unknown signal $\mu_0$ under a convex constraint $\mu_0 \in K$, where $K$ is a…

Statistics Theory · Mathematics 2022-01-24 Qiyang Han

In this paper we study minimax and adaptation rates in general isotonic regression. For uniform deterministic and random designs in $[0,1]^d$ with $d\ge 2$ and $N(0,1)$ noise, the minimax rate for the $\ell_2$ risk is known to be bounded…

Statistics Theory · Mathematics 2020-01-13 Hang Deng , Cun-Hui Zhang

Optimal experimental design (OED) is the general formalism of sensor placement and decisions about the data collection strategy for engineered or natural experiments. This approach is prevalent in many critical fields such as battery…

Optimization and Control · Mathematics 2022-06-28 Ahmed Attia , Emil Constantinescu

In this paper we propose a new test of heteroscedasticity for parametric regression models and partial linear regression models in high dimensional settings. When the dimension of covariates is large, existing tests of heteroscedasticity…

Methodology · Statistics 2018-08-09 Falong Tan , Xuejun Jiang , Xu Guo , Lixing Zhu

We consider the estimation of a bounded regression function with nonparametric heteroscedastic noise and random design. We study the true and empirical excess risks of the least-squares estimator on finite-dimensional vector spaces. We give…

Statistics Theory · Mathematics 2015-06-29 Adrien Saumard

Multivariate linear regression models often face the problem of heteroscedasticity caused by multiple explanatory variables. The weighted least squares estimation with univariate-dependent weights has limitations in constructing weight…

Methodology · Statistics 2026-01-16 Lei Huang , Chengyue Liu , Li Wang

In this paper, we study the problem of optimal data collection for policy evaluation in linear bandits. In policy evaluation, we are given a target policy and asked to estimate the expected reward it will obtain when executed in a…

Machine Learning · Statistics 2024-03-04 Subhojyoti Mukherjee , Qiaomin Xie , Josiah Hanna , Robert Nowak

Learning or identifying dynamics from a sequence of high-dimensional observations is a difficult challenge in many domains, including reinforcement learning and control. The problem has recently been studied from a generative perspective…

Robotics · Computer Science 2022-07-12 Oliver Limoyo , Bryan Chan , Filip Marić , Brandon Wagstaff , Rupam Mahmood , Jonathan Kelly

This paper develops a design-first econometric framework for event-study and difference-in-differences estimands under staggered adoption with heterogeneous effects, emphasising (i) exact probability limits for conventional two-way fixed…

Econometrics · Economics 2026-01-28 Craig S Wright

The aim of this paper is to establish non-asymptotic minimax rates of testing for goodness-of-fit hypotheses in a heteroscedastic setting. More precisely, we deal with sequences $(Y_j)_{j\in J}$ of independent Gaussian random variables,…

Statistics Theory · Mathematics 2010-02-09 Béatrice Laurent , Jean-Michel Loubès , Clément Marteau

We consider the dynamic linear regression problem, where the predictor vector may vary with time. This problem can be modeled as a linear dynamical system, with non-constant observation operator, where the parameters that need to be learned…

Machine Learning · Computer Science 2022-10-13 Mark Kozdoba , Edward Moroshko , Shie Mannor , Koby Crammer