English
Related papers

Related papers: On Mean Estimation for Heteroscedastic Random Vari…

200 papers

The aim of the paper is to derive the numerical least-squares estimator for mean and variance of random variable. In order to do so the following questions have to be answered: (i) what is the statistical model for the estimation procedure?…

Numerical Analysis · Mathematics 2025-10-20 Tomasz Suslo

A standard approach to computing expectations with respect to a given target measure is to introduce an overdamped Langevin equation which is reversible with respect to the target distribution, and to approximate the expectation by a…

Numerical Analysis · Mathematics 2016-04-20 A. B. Duncan , T. Lelievre , G. A. Pavliotis

Consider the sample covariance matrix $$\Sigma^{1/2}XX^T\Sigma^{1/2}$$ where $X$ is an $M\times N$ random matrix with independent entries and $\Sigma$ is an $M\times M$ diagonal matrix. It is known that if $\Sigma$ is deterministic, then…

Probability · Mathematics 2023-02-27 Ji Oon Lee , Yiting Li

We establish some new non-asymptotical lower bounds for deviation of regular unbiased estimation of unknown parameter from its true value in different norms, alike the classical Rao-Kramer's inequality. We show that if the new norm is…

Statistics Theory · Mathematics 2014-07-17 E. Ostrovsky , L. Sirota

We consider the solution to a stochastic differential equation with a drift function which depends smoothly on some real parameter $\lambda$, and admitting a unique invariant measure for any value of $\lambda$ around $\lambda$ = 0. Our aim…

Probability · Mathematics 2015-09-07 Roland Assaraf , Benjamin Jourdain , Tony Lelièvre , Raphaël Roux

We give the first polynomial-time, polynomial-sample, differentially private estimator for the mean and covariance of an arbitrary Gaussian distribution $\mathcal{N}(\mu,\Sigma)$ in $\mathbb{R}^d$. All previous estimators are either…

Machine Learning · Statistics 2022-02-15 Gautam Kamath , Argyris Mouzakis , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

When the study variable is functional and storage capacities are limited or transmission costs are high, selecting with survey sampling techniques a small fraction of the observations is an interesting alternative to signal compression…

Statistics Theory · Mathematics 2013-02-15 Hervé Cardot , Camelia Goga , Pauline Lardin

This paper explores certain kinds of empirical process with respect to the components of multivariate Gaussian. We put forward some finite sample bounds which hold for multivariate Gaussian under general dependence. We give necessary and…

Probability · Mathematics 2020-07-03 Jikai Hou

A bias-reduced estimator is proposed for the mean absolute deviation parameter of a median regression model. A workaround is devised for the lack of smoothness in the sense conventionally required in general bias-reduced estimation. A local…

Methodology · Statistics 2023-05-04 Michele Lambardi di San Miniato

In this article we have suggested an improved estimator for estimating the population mean in simple random sampling using auxiliary information under the presence of measurement errors. The mean square error (MSE) of the proposed estimator…

Applications · Statistics 2013-12-05 Sachin Malik , Jayant Singh , Rajesh Singh

Researchers may perform regressions using a sketch of data of size $m$ instead of the full sample of size $n$ for a variety of reasons. This paper considers the case when the regression errors do not have constant variance and…

Machine Learning · Statistics 2022-06-23 Sokbae Lee , Serena Ng

A general family of estimators for estimating the population mean of the variable under study, which make use of known value of certain population parameter(s), is proposed. Under Simple Random Sampling Without Replacement (SRSWOR) scheme,…

Statistics Theory · Mathematics 2007-10-17 M. Khoshnevisan , Rajesh Singh , Pankaj Chauhan , Nirmala Sawan , Florentin Smarandache

Consider $N\times N$ Hermitian or symmetric random matrices $H$ where the distribution of the $(i,j)$ matrix element is given by a probability measure $\nu_{ij}$ with a subexponential decay. Let $\sigma_{ij}^2$ be the variance for the…

Mathematical Physics · Physics 2011-09-27 Laszlo Erdos , Horng-Tzer Yau , Jun Yin

This article presents maximum likelihood estimators (MLEs) and log-likelihood ratio (LLR) tests for the eigenvalues and eigenvectors of Gaussian random symmetric matrices of arbitrary dimension, where the observations are independent…

Statistics Theory · Mathematics 2009-01-22 Armin Schwartzman , Walter F. Mascarenhas , Jonathan E. Taylor

We study the problem of bivariate discrete or continuous probability density estimation under low-rank constraints.For discrete distributions, we assume that the two-dimensional array to estimate is a low-rank probability matrix. In the…

Statistics Theory · Mathematics 2024-10-23 Julien Chhor , Olga Klopp , Alexandre Tsybakov

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing…

Machine Learning · Computer Science 2022-12-20 Andrew Stirn , Hans-Hermann Wessels , Megan Schertzer , Laura Pereira , Neville E. Sanjana , David A. Knowles

We study the probabilistic sampling of a random variable, in which the variable is sampled only if it falls outside a given set, which is called the silence set. This helps us to understand optimal event-based sampling for the special case…

Optimization and Control · Mathematics 2023-03-17 Maben Rabi , Junfeng Wu , Vyoma Singh , Karl Henrik Johansson

Let $\varepsilon_1,\ldots,\varepsilon_n$ be independent identically distributed Rademacher random variables, that is $\mathbb{P}\{\varepsilon_i=\pm1\}=1/2$. Let $S_n=a_1\varepsilon_1+\cdots+a_n\varepsilon_n$, where…

Probability · Mathematics 2015-06-02 Vidmantas Kastytis Bentkus , Dainius Dzindzalieta

We provide a theoretical foundation for non-parametric estimation of functions of random variables using kernel mean embeddings. We show that for any continuous function $f$, consistent estimators of the mean embedding of a random variable…

Machine Learning · Statistics 2018-06-04 Carl-Johann Simon-Gabriel , Adam Ścibior , Ilya Tolstikhin , Bernhard Schölkopf

Consider a central problem in randomized approximation schemes that use a Monte Carlo approach. Given a sequence of independent, identically distributed random variables $X_1,X_2,\ldots$ with mean $\mu$ and standard deviation at most $c…

Statistics Theory · Mathematics 2014-11-18 Mark Huber