English
Related papers

Related papers: Approximate independence of permutation mixtures

200 papers

In recent years, differential privacy has been adopted by tech-companies and governmental agencies as the standard for measuring privacy in algorithms. In this article, we study differential privacy in Bayesian posterior sampling settings.…

Statistics Theory · Mathematics 2026-02-13 Shenggang Hu , Louis Aslett , Hongsheng Dai , Murray Pollock , Gareth O. Roberts

Recent work in differential privacy has highlighted the shuffled model as a promising avenue to compute accurate statistics while keeping raw data in users' hands. We present a protocol in this model that estimates histograms with error…

Cryptography and Security · Computer Science 2020-04-15 Victor Balcer , Albert Cheu

Employing nonparametric methods for density estimation has become routine in Bayesian statistical practice. Models based on discrete nonparametric priors such as Dirichlet Process Mixture (DPM) models are very attractive choices due to…

Methodology · Statistics 2017-07-03 J. J. Quinlan , F. A. Quintana , G. L. Page

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data…

Machine Learning · Statistics 2016-03-11 Panagiotis Tsilifis , Roger G. Ghanem , Paris Hajali

Differentially private (DP) machine learning algorithms incur many sources of randomness, such as random initialization, random batch subsampling, and shuffling. However, such randomness is difficult to take into account when proving…

Machine Learning · Statistics 2023-11-02 Chendi Wang , Buxin Su , Jiayuan Ye , Reza Shokri , Weijie J. Su

We consider the problem of closeness testing for two discrete distributions in the practically relevant setting of \emph{unequal} sized samples drawn from each of them. Specifically, given a target error parameter $\varepsilon > 0$, $m_1$…

Machine Learning · Computer Science 2015-04-20 Bhaswar B. Bhattacharya , Gregory Valiant

Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federated learning does…

Machine Learning · Computer Science 2022-09-19 Qiongxiu Li , Jaron Skovsted Gundersen , Katrine Tjell , Rafal Wisniewski , Mads Græsbøll Christensen

A finite difference numerical method is investigated for fractional order diffusion problems in one space dimension. For this, a mathematical model is developed to incorporate homogeneous Dirichlet and Neumann type boundary conditions. The…

Numerical Analysis · Mathematics 2014-11-07 Béla J. Szekeres , Ferenc Izsák

We connect the power of Confidence Intervals in different Frequentist methods to their reliability. We show that in the case of a bounded parameter a biased method which near the boundary has large power in testing the parameter against…

High Energy Physics - Experiment · Physics 2007-05-23 C. Giunti , M. Laveder

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

Connecting optimal transport and variational inference, we present a principled and systematic framework for sampling and generative modelling centred around divergences on path space. Our work culminates in the development of the…

Machine Learning · Statistics 2025-05-08 Francisco Vargas , Shreyas Padhy , Denis Blessing , Nikolas Nüsken

Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology. Existing convergence theory, however, exhibits fundamental limitations. KL-based analyses diverge…

Machine Learning · Computer Science 2026-05-19 Kelvin Kan , Xingjian Li , Benjamin J. Zhang , Tuhin Sahai , Stanley Osher , Markos A. Katsoulakis

We study the problem of distinguishing between two symmetric probability distributions over $n$ bits by observing $k$ bits of a sample, subject to the constraint that all $k-1$-wise marginal distributions of the two distributions are…

Computational Complexity · Computer Science 2021-03-16 Christopher Williamson

Variational inequalities have gained significant attention in machine learning and optimization research. While stochastic methods for solving these problems typically assume independent data sampling, we investigate an alternative approach…

Optimization and Control · Mathematics 2025-10-22 Daniil Medyakov , Gleb Molodtsov , Grigoriy Evseev , Egor Petrov , Aleksandr Beznosikov

We quantify the parameter stability of a spherical Gaussian Mixture Model (sGMM) under small perturbations in distribution space. Namely, we derive the first explicit bound to show that for a mixture of spherical Gaussian $P$ (sGMM) in a…

Machine Learning · Statistics 2023-02-02 Hanyu Zhang , Marina Meila

One goal of statistical privacy research is to construct a data release mechanism that protects individual privacy while preserving information content. An example is a {\em random mechanism} that takes an input database $X$ and outputs a…

Statistics Theory · Mathematics 2012-01-11 Larry Wasserman , Shuheng Zhou

Distance-based regression model, as a nonparametric multivariate method, has been widely used to detect the association between variations in a distance or dissimilarity matrix for outcomes and predictor variables of interest in genetic…

Statistics Theory · Mathematics 2022-03-14 Yuke Shi , Wei Zhang , Aiyi Liu , Qizhai Li

A sequence of random variables is called exchangeable if the joint distribution of the sequence is unchanged by any permutation of the indices. De Finetti's theorem characterizes all $\{0,1\}$-valued exchangeable sequences as a "mixture" of…

Probability · Mathematics 2018-09-05 Werner Kirsch

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

The Podium mechanism guarantees ($\epsilon, 0$)-differential privacy by sampling noise from a \emph{finite} mixture of three uniform distributions. By carefully constructing such a mixture distribution, we trivially guarantee privacy…

Cryptography and Security · Computer Science 2019-08-05 Vasyl Pihur