English
Related papers

Related papers: Approximate independence of permutation mixtures

200 papers

Mixtures of high dimensional Gaussian distributions have been studied extensively in statistics and learning theory. While the total variation distance appears naturally in the sample complexity of distribution learning, it is analytically…

Probability · Mathematics 2022-03-11 Sami Davies , Arya Mazumdar , Soumyabrata Pal , Cyrus Rashtchian

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

Data Structures and Algorithms · Computer Science 2017-11-21 Samuel B. Hopkins , Jerry Li

In this paper, a new technique is introduced to obtain non-uniform Berry-Esseen bounds of normal and nonnormal approximation for unbounded exchangeable pairs. This technique does not rely on the concentration inequalities developed by Chen…

Statistics Theory · Mathematics 2019-12-24 Dali Liu , Zheng Li , Hanchao Wang , Zengjing Chen

Differential privacy is increasingly formalized through the lens of hypothesis testing via the robust and interpretable $f$-DP framework, where privacy guarantees are encoded by a baseline Blackwell trade-off function $f_{\infty} =…

Statistics Theory · Mathematics 2025-12-02 Aaradhya Pandey , Arian Maleki , Sanjeev Kulkarni

We give a direct combinatorial proof of the equidistribution of two pairs of permutation statistics, (des, aid) and (lec, inv), which have been previously shown to have the same joint distribution as (exc, maj), the major index and the…

Combinatorics · Mathematics 2014-02-18 Alexander Burstein

We develop both theory and algorithms to analyze privatized data in unbounded differential privacy (DP), where even the sample size is considered a sensitive quantity that requires privacy protection. We show that the distance between the…

Statistics Theory · Mathematics 2026-04-24 Jordan Awan , Andres Felipe Barrientos , Nianqiao Ju

We revisit the method of mixture technique, also known as the Laplace method, to study the concentration phenomenon in generic exponential families. Combining the properties of Bregman divergence associated with log-partition function of…

Machine Learning · Computer Science 2023-07-14 Sayak Ray Chowdhury , Patrick Saux , Odalric-Ambrym Maillard , Aditya Gopalan

We study the characteristic polynomial of random permutation matrices following some measures which are invariant by conjugation, including Ewens' measures which are one-parameter deformations of the uniform distribution on the permutation…

Probability · Mathematics 2018-09-17 Valentin Bahier

This paper studies distributed binary test of statistical independence under communication (information bits) constraints. While testing independence is very relevant in various applications, distributed independence test is particularly…

Statistics Theory · Mathematics 2021-11-29 Sebastian Espinosa , Jorge F. Silva , Pablo Piantanida

We introduce a new natural notion of convergence for permutations at any specified scale, in terms of the density of patterns of restricted width. In this setting we prove that limits may be chosen independently at a countably infinite…

Combinatorics · Mathematics 2021-10-20 David Bevan

In recent years, differential privacy has emerged as the de facto standard for sharing statistics of datasets while limiting the disclosure of private information about the involved individuals. This is achieved by randomly perturbing the…

Cryptography and Security · Computer Science 2024-12-18 Aras Selvi , Huikang Liu , Wolfram Wiesemann

Mixtures of product distributions are a powerful device for learning about heterogeneity within data populations. In this class of latent structure models, de Finetti's mixing measure plays the central role for describing the uncertainty…

Statistics Theory · Mathematics 2021-09-27 Yun Wei , XuanLong Nguyen

Mixture distributions arise in many parametric and non-parametric settings -- for example, in Gaussian mixture models and in non-parametric estimation. It is often necessary to compute the entropy of a mixture, but, in most cases, this…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

Machine Learning · Statistics 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

In this work, we develop a novel Bayesian estimation method for the Dirichlet process (DP) mixture of the inverted Dirichlet distributions, which has been shown to be very flexible for modeling vectors with positive elements. The recently…

Machine Learning · Computer Science 2020-02-04 Zhanyu Ma , Yuping Lai

We study properties of two resampling scenarios: Conditional Randomisation and Conditional Permutation schemes, which are relevant for testing conditional independence of discrete random variables $X$ and $Y$ given a random variable $Z$.…

Statistics Theory · Mathematics 2023-04-14 Małgorzata Łazęcka , Bartosz Kołodziejek , Jan Mielniczuk

We propose a new nonparametric test for the supposition of independence between two continuous random variables. The test is based on the size of the longest increasing subsequence of a random permutation. We identified the independence…

Methodology · Statistics 2015-03-13 Jesus E. Garcia , Veronica A. Gonzalez-Lopez

We prove existence and uniqueness of the invariant measure and exponential mixing in the total-variation norm for a class of stochastic differential equations driven by degenerate compound Poisson processes. In addition to mild assumptions…

Probability · Mathematics 2022-09-21 Vahagn Nersesyan , Renaud Raquépas

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

We propose a general new method, the conditional permutation test, for testing the conditional independence of variables $X$ and $Y$ given a potentially high-dimensional random vector $Z$ that may contain confounding factors. The proposed…

Methodology · Statistics 2019-05-08 Thomas B. Berrett , Yi Wang , Rina Foygel Barber , Richard J. Samworth