English
Related papers

Related papers: Log-minor distributions and an application to esti…

200 papers

The von Neumann entropy of an $n$-partite system $A_1^n$ given a system $B$ can be written as the sum of the von Neumann entropies of the individual subsystems $A_k$ given $A_1^{k-1}$ and $B$. While it is known that such a chain rule does…

Quantum Physics · Physics 2024-12-10 Ashutosh Marwah , Frédéric Dupuis

Genomic evolution can be viewed as string-editing processes driven by mutations. An understanding of the statistical properties resulting from these mutation processes is of value in a variety of tasks related to biological sequence data,…

Information Theory · Computer Science 2018-12-07 Hao Lou , Farzad Farnoud , Moshe Schwartz , Jehoshua Bruck

The reduced density matrix of many-body systems possessing an additive conserved quantity can be decomposed in orthogonal sectors which can be independently analyzed. Recently, these have been proven to equally contribute to entanglement…

Statistical Mechanics · Physics 2020-08-05 Xhek Turkeshi , Paola Ruggiero , Vincenzo Alba , Pasquale Calabrese

In real-world applications, observations are often constrained to a small fraction of a system. Such spatial subsampling can be caused by the inaccessibility or the sheer size of the system, and cannot be overcome by longer sampling.…

Data Analysis, Statistics and Probability · Physics 2017-06-02 Anna Levina , Viola Priesemann

We define a notion of isotropy for discrete set distributions. If $\mu$ is a distribution over subsets $S$ of a ground set $[n]$, we say that $\mu$ is in isotropic position if $P[e \in S]$ is the same for all $e\in [n]$. We design a new…

Data Structures and Algorithms · Computer Science 2020-04-21 Nima Anari , Michał Dereziński

Concentration inequalities form an essential toolkit in the study of high dimensional (HD) statistical methods. Most of the relevant statistics literature in this regard is based on sub-Gaussian or sub-exponential tail assumptions. In this…

Statistics Theory · Mathematics 2023-01-09 Arun Kumar Kuchibhotla , Abhishek Chakrabortty

This paper derives exponential tail bounds and polynomial moment inequalities for the spectral norm deviation of a random matrix from its mean value. The argument depends on a matrix extension of Stein's method of exchangeable pairs for…

Probability · Mathematics 2013-05-06 Daniel Paulin , Lester Mackey , Joel A. Tropp

The density ratio is an important metric for evaluating the relative likelihood of two probability distributions, with extensive applications in statistics and machine learning. However, existing estimation theories for density ratios often…

Machine Learning · Statistics 2025-04-03 Shuntuo Xu , Zhou Yu , Jian Huang

Over the last two decades, many exciting variable selection methods have been developed for finding a small group of covariates that are associated with the response from a large pool. Can the discoveries from these data mining approaches…

Statistics Theory · Mathematics 2017-07-24 Jianqing Fan , Qi-Man Shao , Wen-Xin Zhou

Estimation of the mean and covariance parameters for functional data is a critical task, with local linear smoothing being a popular choice. In recent years, many scientific domains are producing multivariate functional data for which $p$,…

Statistics Theory · Mathematics 2024-09-24 Alexander Petersen

The inverse covariance matrix provides considerable insight for understanding statistical models in the multivariate setting. In particular, when the distribution over variables is assumed to be multivariate normal, the sparsity pattern in…

Machine Learning · Statistics 2017-10-20 Addison Hu , Sahand Negahban

We study the asymptotic distributions of the spiked eigenvalues and the largest nonspiked eigenvalue of the sample covariance matrix under a general covariance matrix model with divergent spiked eigenvalues, while the other eigenvalues are…

Statistics Theory · Mathematics 2017-11-07 Tony Cai , Xiao Han , Guangming Pan

Sufficient conditions are developed, under which the compound Poisson distribution has maximal entropy within a natural class of probability measures on the nonnegative integers. Recently, one of the authors [O. Johnson, {\em Stoch. Proc.…

Combinatorics · Mathematics 2013-03-20 Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

Problems of probabilistic inference and decision making under uncertainty commonly involve continuous random variables. Often these are discretized to a few points, to simplify assessments and computations. An alternative approximation is…

Artificial Intelligence · Computer Science 2013-03-08 William B. Poland , Ross D. Shachter

Bounds on the log partition function are important in a variety of contexts, including approximate inference, model fitting, decision theory, and large deviations analysis. We introduce a new class of upper bounds on the log partition…

Machine Learning · Computer Science 2013-01-07 Martin Wainwright , Tommi S. Jaakkola , Alan Willsky

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

In random matrix theory, the spectral distribution of the covariance matrix has been well studied under the large dimensional asymptotic regime when the dimensionality and the sample size tend to infinity at the same rate. However, most…

Statistics Theory · Mathematics 2026-03-17 Qiang Liu , Yiming Liu , Zhi Liu , Wang Zhou

The matrix-variate normal distribution is a popular model for high-dimensional transposable data because it decomposes the dependence structure of the random matrix into the Kronecker product of two covariance matrices: one for each of the…

Methodology · Statistics 2014-11-11 Anestis Touloumis , John Marioni , Simon Tavaré

Maximum entropy distributions with discrete support in $m$ dimensions arise in machine learning, statistics, information theory, and theoretical computer science. While structural and computational properties of max-entropy distributions…

Data Structures and Algorithms · Computer Science 2019-06-04 Damian Straszak , Nisheeth K. Vishnoi

When multiple investigators analyze a common dataset, the data reuse induces dependence across testing procedures, affecting the distribution of errors. Existing techniques of managing dependent tests require either cross-study coordination…

Statistics Theory · Mathematics 2026-04-10 Reid Dale , Jordan Rodu , Maria E. Currie , Mike Baiocchi