English
Related papers

Related papers: Extreme Compressive Sampling for Covariance Estima…

200 papers

Reducing acquisition time is a crucial challenge for many imaging techniques. Compressed Sensing (CS) theory offers an appealing framework to address this issue since it provides theoretical guarantees on the reconstruction of sparse…

Applications · Statistics 2014-07-17 Nicolas Chauffert , Philippe Ciuciu , Jonas Kahn , Pierre Weiss

Tensor-valued data are being encountered increasingly more commonly, in the biological, natural as well as the social sciences. The learning of the unknown model parameter vector given such data, involves covariance modelling of such data,…

Applications · Statistics 2015-06-19 Kangrui Wang , Dalia Chakrabarty

Models which include domain constraints occur in myriad contexts such as econometrics, genomics, and environmetrics, though simulating from constrained distributions can be computationally expensive. In particular, repeated sampling from…

Computation · Statistics 2020-03-03 Hillary Koch , Gregory P. Bopp

This paper addresses the fundamental question of when convex sets remain disjoint after random projection. We provide an analysis using ideas from high-dimensional convex geometry. For ellipsoids, we provide a bound in terms of the distance…

Machine Learning · Computer Science 2014-04-14 Afonso S. Bandeira , Dustin G. Mixon , Benjamin Recht

We present methods to rigorously extract parameter combinations that are constrained by data from posterior distributions. The standard approach uses linear methods that apply to Gaussian distributions. We show the limitations of the linear…

Cosmology and Nongalactic Astrophysics · Physics 2022-04-06 Tara Dacunha , Marco Raveri , Minsu Park , Cyrille Doux , Bhuvnesh Jain

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

We generalize the well-known mixtures of Gaussians approach to density estimation and the accompanying Expectation--Maximization technique for finding the maximum likelihood parameters of the mixture to the case where each data point…

Methodology · Statistics 2011-08-01 Jo Bovy , David W. Hogg , Sam T. Roweis

We develop a multi-level restricted Gaussian maximum likelihood method for estimating the covariance function parameters and computing the best unbiased predictor. Our approach produces a new set of multi-level contrasts where the…

Computation · Statistics 2016-03-29 Julio E. Castrillon-Candas , Marc G. Genton , Rio Yokota

A new nonparametric estimator of a convex regression function in any dimension is proposed and its convergence properties are studied. We start by using any estimator of the regression function and we \emph{convexify} it by taking the…

Statistics Theory · Mathematics 2010-06-16 Néstor E. Aguilera , Liliana Forzani , Pedro Morin

In its most elementary form, compressed sensing studies the design of decoding algorithms to recover a sufficiently sparse vector or code from a lower dimensional linear measurement vector. Typically it is assumed that the decoder has…

Machine Learning · Computer Science 2021-07-20 Michael Murray , Jared Tanner

In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both…

Methodology · Statistics 2011-02-14 Tony Cai , Weidong Liu

The coarse spatial resolution of gridded climate models, such as general circulation models, limits their direct use in projecting socially relevant variables like extreme precipitation. Most downscaling methods estimate the conditional…

Atmospheric and Oceanic Physics · Physics 2026-01-06 Louise Largeau , Tom Beucler , David Leutwyler , Gregoire Mariethoz , Valerie Chavez-Demoulin , Erwan Koch

We consider the problem of estimating the covariance structure of a random vector $Y\in \mathbb R^d$ from a sample $Y_1,\ldots,Y_n$. We are interested in the situation when $d$ is large compared to $n$ but the covariance matrix $\Sigma$ of…

Statistics Theory · Mathematics 2024-10-08 Stanislav Minsker , Lang Wang

This paper studies the quantization of heavy-tailed data in some fundamental statistical estimation problems, where the underlying distributions have bounded moments of some order. We propose to truncate and properly dither the data prior…

Statistics Theory · Mathematics 2023-07-27 Junren Chen , Michael K. Ng , Di Wang

Mixtures of Gaussian factors are powerful tools for modeling an unobserved heterogeneous population, offering - at the same time - dimension reduction and model-based clustering. Unfortunately, the high prevalence of spurious solutions and…

Methodology · Statistics 2016-08-08 L. A. García-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

We consider the $\mathcal{H}^2$-formatted compression and computational estimation of covariance functions on a compact set in $\mathbb{R}^d$. The classical sample covariance or Monte Carlo estimator is prohibitively expensive for many…

Numerical Analysis · Mathematics 2023-01-31 Jürgen Dölz

Multivariate time series anomaly detection is a crucial problem in many industrial and research applications. Timely detection of anomalies allows, for instance, to prevent defects in manufacturing processes and failures in cyberphysical…

Machine Learning · Computer Science 2024-03-06 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo

We study approaches for compressing the empirical measure in the context of finite dimensional reproducing kernel Hilbert spaces (RKHSs). In this context, the empirical measure is contained within a natural convex set and can be…

Machine Learning · Statistics 2024-08-29 Steffen Grünewälder

This paper introduces a subspace method for the estimation of an array covariance matrix. It is shown that when the received signals are uncorrelated, the true array covariance matrices lie in a specific subspace whose dimension is…

Numerical Analysis · Computer Science 2014-11-04 Mostafa Rahmani , George Atia

Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each…

Machine Learning · Statistics 2014-06-10 Rajarshi Guhaniyogi , David B. Dunson