English
Related papers

Related papers: Statistical Limits of Sparse Mixture Detection

200 papers

Motivated by cutting-edge applications like cryo-electron microscopy (cryo-EM), the Multi-Reference Alignment (MRA) model entails the learning of an unknown signal from repeated measurements of its images under the latent action of a group…

Statistics Theory · Mathematics 2022-03-11 Subhro Ghosh , Philippe Rigollet

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order and estimate the…

Optimization and Control · Mathematics 2025-09-30 Srećko Đurašinović , Jean-Bernard Lasserre , Victor Magron

Quadratic variations of Gaussian processes play important role in both stochastic analysis and in applications such as estimation of model parameters, and for this reason the topic has been extensively studied in the literature. In this…

Probability · Mathematics 2015-02-06 Lauri Viitasaari

Statistical matching is an effective method for estimating causal effects in which treated units are paired with control units with ``similar'' values of confounding covariates prior to performing estimation. In this way, matching helps…

Methodology · Statistics 2023-09-13 Sanjeewani Weerasingha , Michael J. Higgins

The article addresses a long-standing open problem on the justification of using variational Bayes methods for parameter estimation. We provide general conditions for obtaining optimal risk bounds for point estimates acquired from…

Statistics Theory · Mathematics 2017-12-27 Debdeep Pati , Anirban Bhattacharya , Yun Yang

In this article we consider the estimation of static parameters for partially observed diffusion process with discrete-time observations over a fixed time interval. In particular, we assume that one must time-discretize the partially…

Computation · Statistics 2023-09-20 Elsiddig Awadelkarim , Ajay Jasra , Hamza Ruzayqat

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

Regular variation provides a convenient theoretical framework to study large events. In the multivariate setting, the dependence structure of the positive extremes is characterized by a measure - the spectral measure - defined on the…

Machine Learning · Statistics 2021-02-24 Meyer Nicolas , Olivier Wintenberger

We study a statistical procedure based on higher criticism (HC) to address the sparse multi-stream quickest change-point detection problem. Namely, we aim to detect a potential change in the distribution of multiple data streams at some…

Methodology · Statistics 2025-04-22 Tingnan Gong , Alon Kipnis , Yao Xie

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

Score matching is an approach to learning probability distributions parametrized up to a constant of proportionality (e.g. Energy-Based Models). The idea is to fit the score of the distribution, rather than the likelihood, thus avoiding the…

Machine Learning · Computer Science 2024-01-31 Yilong Qin , Andrej Risteski

The purpose of this paper is to ensure the conditions of G\"artner-Ellis Theorem for evaluations of the empirical measure. We show that up-to-date conditions for ensuring the convergence to a quasi-stationary distribution can be applied…

Probability · Mathematics 2020-04-21 Aurélien Velleret

In this paper, we derive results about the limiting distribution of the empirical magnetization vector and the maximum likelihood (ML) estimates of the natural parameters in the tensor Curie-Weiss Potts model. Our results reveal…

Statistics Theory · Mathematics 2023-07-25 Sanchayan Bhowal , Somabha Mukherjee

We study optimal estimation for sparse principal component analysis when the number of non-zero elements is small but on the same order as the dimension of the data. We employ approximate message passing (AMP) algorithm and its state…

Information Theory · Computer Science 2020-01-22 Thibault Lesieur , Florent Krzakala , Lenka Zdeborova

We fully characterize the nonasymptotic minimax separation rate for sparse signal detection in the Gaussian sequence model with $p$ equicorrelated observations, generalizing a result of Collier, Comminges, and Tsybakov. As a consequence of…

Statistics Theory · Mathematics 2021-10-26 Subhodh Kotekal , Chao Gao

Large-scale multiple testing problems require the simultaneous assessment of many p-values. This paper compares several methods to assess the evidence in multiple binomial counts of p-values: the maximum of the binomial counts after…

Methodology · Statistics 2014-02-26 Guenther Walther

Invariance-based randomization tests -- such as permutation tests, rotation tests, or sign changes -- are an important and widely used class of statistical methods. They allow drawing inferences under weak assumptions on the data…

Statistics Theory · Mathematics 2022-05-31 Edgar Dobriban

We study the probability distribution of a current flowing through a diffusive system connected to a pair of reservoirs at its two ends. Sufficient conditions for the occurrence of a host of possible phase transitions both in and out of…

Statistical Mechanics · Physics 2017-01-25 Yongjoo Baek , Yariv Kafri , Vivien Lecomte

With the advent of massive data outputs at a regular rate, admittedly, signal processing technology plays an increasingly key role. Nowadays, signals are not merely restricted to physical sources, they have been extended to digital sources…

Information Theory · Computer Science 2015-07-28 Yi Lu

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

Statistics Theory · Mathematics 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron