English
Related papers

Related papers: Restricted eigenvalue property for corrupted Gauss…

200 papers

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

This paper investigates extreme value theory for processes obtained by applying transformations to stationary Gaussian processes, also called subordinated Gaussian processes. The main contributions are as follows. First, we refine the…

Probability · Mathematics 2026-05-29 Shuyang Bai , Marie-Christine Duker

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We show that density models describing multiple observables with (i) hard boundaries and (ii) dependence on external parameters may be created using an auto-regressive Gaussian mixture model. The model is designed to capture how observable…

Data Analysis, Statistics and Probability · Physics 2022-02-01 Stephen B. Menary , Darren D. Price

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

We revisit the sequential variants of linear regression with the squared loss, classification problems with hinge loss, and logistic regression, all characterized by unbounded losses in the setup where no assumptions are made on the…

Machine Learning · Statistics 2025-09-08 Jian Qian , Alexander Rakhlin , Nikita Zhivotovskiy

This paper studies the problem of robust signal detection in Gaussian noise under quadratically convex orthosymmetric (QCO) constraints. We consider a minimax testing framework where the signal belongs to a QCO set and is separated from…

Statistics Theory · Mathematics 2026-02-17 Yikun Li , Matey Neykov

In this paper, we consider the multicollinearity problem in the gamma regression model when model parameters are linearly restricted. The linear restrictions are available from prior information to ensure the validity of scientific theories…

Methodology · Statistics 2023-03-10 Solmaz Seifollahi , Hossein Bevrani , Kaniav Kamary

This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and…

Computation · Statistics 2011-05-31 F. Orieux , O. Féron , J. -F. Giovannelli

We consider the problem of robustly testing the norm of a high-dimensional sparse signal vector under two different observation models. In the first model, we are given $n$ i.i.d. samples from the distribution…

Information Theory · Computer Science 2022-11-08 Anand Jerry George , Clément L. Canonne

Gaussian graphical models (GGMs) are widely used for statistical modeling, because of ease of inference and the ubiquitous use of the normal distribution in practical approximations. However, they are also known for their limited modeling…

Machine Learning · Statistics 2016-11-22 Qinliang Su , Xuejun Liao , Chunyuan Li , Zhe Gan , Lawrence Carin

This paper studies the problem of accurately recovering a structured signal from a small number of corrupted sub-Gaussian measurements. We consider three different procedures to reconstruct signal and corruption when different kinds of…

Information Theory · Computer Science 2017-05-23 Jinchi Chen , Yulong Liu

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

We consider a robust linear regression model $y=X\beta^* + \eta$, where an adversary oblivious to the design $X\in \mathbb{R}^{n\times d}$ may choose $\eta$ to corrupt all but an $\alpha$ fraction of the observations $y$ in an arbitrary…

Machine Learning · Computer Science 2021-05-26 Tommaso d'Orsi , Gleb Novikov , David Steurer

We study the problem of detection of a p-dimensional sparse vector of parameters in the linear regression model with Gaussian noise. We establish the detection boundary, i.e., the necessary and sufficient conditions for the possibility of…

Statistics Theory · Mathematics 2010-09-13 Yuri I. Ingster , Alexandre B. Tsybakov , Nicolas Verzelen

We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze…

Information Theory · Computer Science 2017-04-05 Abbas Kazemipour , Sina Miran , Piya Pal , Behtash Babadi , Min Wu

We prove lower bounds on the number of samples needed to privately estimate the covariance matrix of a Gaussian distribution. Our bounds match existing upper bounds in the widest known setting of parameters. Our analysis relies on the…

Data Structures and Algorithms · Computer Science 2024-04-30 Victor S. Portella , Nick Harvey

Extremal graphical models encode the conditional independence structure of multivariate extremes and provide a powerful tool for quantifying the risk of rare events. Prior work on learning these graphs from data has focused on the setting…

Methodology · Statistics 2025-04-15 Sebastian Engelke , Armeen Taeb

In many applied fields, such as genomics, different types of data are collected on the same system, and it is not uncommon that some of these datasets are subject to censoring as a result of the measurement technologies used, such as data…

Methodology · Statistics 2020-05-04 Luigi Augugliaro , Gianluca Sottile , Veronica Vinciotti

Gaussian processes (GPs) provide a powerful framework for extrapolation, interpolation, and noise removal in regression and classification. This paper considers constraining GPs to arbitrarily-shaped domains with boundary conditions. We…

Machine Learning · Statistics 2019-04-11 Arno Solin , Manon Kok
‹ Prev 1 4 5 6 7 8 10 Next ›