English
Related papers

Related papers: Central limit theorem for the robust log-regressio…

200 papers

Doubly robust estimators have gained widespread popularity in various fields due to their ability to provide unbiased estimates under model misspecification. However, the asymptotic theory for doubly robust estimators with continuous-time…

Statistics Theory · Mathematics 2024-04-23 Andrew Ying

We consider estimation of a sparse parameter vector that determines the covariance matrix of a Gaussian random vector via a sparse expansion into known "basis matrices". Using the theory of reproducing kernel Hilbert spaces, we derive lower…

Information Theory · Computer Science 2011-01-21 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Alfred O. Hero

The correlation length-scale next to the noise variance are the most used hyperparameters for the Gaussian processes. Typically, stationary covariance functions are used, which are only dependent on the distances between input points and…

Machine Learning · Computer Science 2017-10-30 Kevin Cremanns , Dirk Roos

Consider a Gaussian memoryless multiple source with $m$ components with joint probability distribution known only to lie in a given class of distributions. A subset of $k \leq m$ components are sampled and compressed with the objective of…

Information Theory · Computer Science 2018-03-16 Vinay Praneeth Boda

We study the algorithmic problem of estimating the mean of heavy-tailed random vector in $\mathbb{R}^d$, given $n$ i.i.d. samples. The goal is to design an efficient estimator that attains the optimal sub-gaussian error bound, only assuming…

Statistics Theory · Mathematics 2020-02-19 Zhixian Lei , Kyle Luh , Prayaag Venkat , Fred Zhang

Limit theorems are proved for quadratic forms of Gaussian random fields in presence of long memory. We obtain a non central limit theorem under a minimal integrability condition, which allows isotropic and anisotropic models. We apply our…

Statistics Theory · Mathematics 2010-01-08 Frédéric Lavancier , Anne Philippe

In this paper we propose and study a general class of Gaussian Semiparametric Estimators (GSE) of the fractional differencing parameter in the context of long-range dependent multivariate time series. We establish large sample properties of…

Statistics Theory · Mathematics 2022-11-16 Guilherme Pumi , Sílvia R. C. Lopes

We develop a generalized method of moments (GMM) approach for fast parameter estimation in a new class of Dirichlet latent variable models with mixed data types. Parameter estimation via GMM has been demonstrated to have computational and…

Statistics Theory · Mathematics 2016-03-24 Shiwen Zhao , Barbara E. Engelhardt , Sayan Mukherjee , David B. Dunson

Support vector data description (SVDD) is a popular technique for detecting anomalies. The SVDD classifier partitions the whole space into an inlier region, which consists of the region near the training data, and an outlier region, which…

Machine Learning · Computer Science 2018-07-23 Arin Chaudhuri , Deovrat Kakde , Carol Sadek , Laura Gonzalez , Seunghyun Kong

We observe the actions of a $K$ sub-sample of $N$ individuals up to time $t$ for some large $K\le N$. We model the relationships of individuals by i.i.d. Bernoulli($p$)-random variables, where $p\in (0,1]$ is an unknown parameter. The rate…

Statistics Theory · Mathematics 2019-06-20 Chenguang Liu

Experimental designs based on the classical D-optimal criterion minimize the volume of the linear-approximation inference regions for the parameters using local sensitivity coefficients. For nonlinear models, these designs can be unreliable…

Methodology · Statistics 2021-01-22 Hana Sulieman

We systematically study various network Expectation-Maximization (EM) algorithms for the Gaussian mixture model within the framework of decentralized federated learning. Our theoretical investigation reveals that directly extending the…

Machine Learning · Statistics 2024-11-11 Shuyuan Wu , Bin Du , Xuetong Li , Hansheng Wang

We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = \langle X,w^* \rangle + \epsilon$ (with $X \in \mathbb{R}^d$ and $\epsilon$ independent), in…

We consider two problems of estimation in high-dimensional Gaussian models. The first problem is that of estimating a linear functional of the means of $n$ independent $p$-dimensional Gaussian vectors, under the assumption that most of…

Statistics Theory · Mathematics 2018-11-12 Olivier Collier , Arnak S. Dalalyan

This paper investigates total variation minimization in one spatial dimension for the recovery of gradient-sparse signals from undersampled Gaussian measurements. Recently established bounds for the required sampling rate state that uniform…

Information Theory · Computer Science 2022-04-12 Martin Genzel , Maximilian März , Robert Seidel

The trimming scheme with a prefixed cutoff portion is known as a method of improving the robustness of statistical models such as multivariate Gaussian mixture models (MG- MMs) in small scale tests by alleviating the impacts of outliers.…

Computation and Language · Computer Science 2014-05-20 Dalei Wu , Haiqing Wu

Fix $d\in\{1,2\}$, we consider a $d$-dimensional stochastic wave equation driven by a Gaussian noise, which is temporally white and colored in space such that the spatial correlation function is integrable and satisfies Dalang's condition.…

Probability · Mathematics 2021-08-18 David Nualart , Guangqu Zheng

Robust estimation under Huber's $\epsilon$-contamination model has become an important topic in statistics and theoretical computer science. Statistically optimal procedures such as Tukey's median and other estimators based on depth…

Machine Learning · Statistics 2019-02-27 Chao Gao , Jiyi Liu , Yuan Yao , Weizhi Zhu

Let $B=(B_x)_{x\in\mathbb{R}^d}$ be a collection of $N(0,1)$ random variables forming a real-valued continuous stationary Gaussian field on $\mathbb{R}^d$, and set $C(x-y)=\mathbb{E}[B_xB_y]$. Let $\varphi:\mathbb{R}\to\mathbb{R}$ be such…

Probability · Mathematics 2023-08-29 Leonardo Maini , Ivan Nourdin

For temporal regularly spaced datasets, a lot of methods are available and the properties of these methods are extensively investigated. Less research has been performed on irregular temporal datasets subject to measurement error with…

Methodology · Statistics 2018-03-15 Haiyan Liu , Jeanine Houwing-Duistermaat