English
Related papers

Related papers: On the equivalence between Stein and de Bruijn ide…

200 papers

This paper provides a general framework for Stein's density method for multivariate continuous distributions. The approach associates to any probability density function a canonical operator and Stein class, as well as an infinite…

Probability · Mathematics 2023-04-27 Guillaume Mijoule , Martin Raič , Gesine Reinert , Yvik Swan

This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that any balanced (with the sum of coefficients being zero)…

Information Theory · Computer Science 2016-09-12 Ashok Vardhan Makkuva , Yihong Wu

We present an asymptotically optimal $(\epsilon,\delta)$ differentially private mechanism for answering multiple, adaptively asked, $\Delta$-sensitive queries, settling the conjecture of Steinke and Ullman [2020]. Our algorithm has a…

Data Structures and Algorithms · Computer Science 2021-11-09 Yuval Dagan , Gil Kur

Anonymized data is highly valuable to both businesses and researchers. A large body of research has however shown the strong limits of the de-identification release-and-forget model, where data is anonymized and shared. This has led to the…

Cryptography and Security · Computer Science 2019-10-31 Andrea Gadotti , Florimond Houssiau , Luc Rocher , Benjamin Livshits , Yves-Alexandre de Montjoye

This monograph provides a rigorous overview of theoretical and methodological aspects of probabilistic inference and learning with Stein's method. Recipes are provided for constructing Stein discrepancies from Stein operators and Stein…

Machine Learning · Statistics 2026-03-10 Qiang Liu , Lester Mackey , Chris Oates

The variance and the entropy power of a continuous random variable are bounded from below by the reciprocal of its Fisher information through the Cram\'{e}r-Rao bound and the Stam's inequality respectively. In this note, we introduce the…

Statistics Theory · Mathematics 2019-05-21 Tomohiro Nishiyama

This paper considers the identification of FIR systems, where information about the inputs and outputs of the system undergoes quantization into binary values before transmission to the estimator. In the case where the thresholds of the…

Systems and Control · Computer Science 2018-09-20 Alex S. Leong , Erik Weyer , Girish N. Nair

For an absolutely continuous (integer-valued) r.v. $X$ of the Pearson (Ord) family, we show that, under natural moment conditions, a Stein-type covariance identity of order $k$ holds (cf. [Goldstein and Reinert, J. Theoret. Probab. 18…

Statistics Theory · Mathematics 2016-11-18 G. Afendras , N. Papadatos , V. Papathanasiou

The remarkable results for denoising in computer vision using diffusion models given in \cite{SDWMG,HJA,HHG} yield a robust mathematical justification for algorithms based on crucial properties of a sequence of Gaussian independent $N(0,1)$…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 F. Alberto Grünbaum , Tondgi Xu

We prove an exact relationship between the optimal denoising function and the data distribution in the case of additive Gaussian noise, showing that denoising implicitly models the structure of data allowing it to be exploited in the…

Neural and Evolutionary Computing · Computer Science 2017-09-11 Heikki Arponen , Matti Herranen , Harri Valpola

This paper develops a unified framework for partial identification and inference in stratified experiments with attrition, accommodating both equal and heterogeneous treatment shares across strata. For equal-share designs, we apply recent…

Econometrics · Economics 2026-01-21 Bruno Ferman , Davi Siqueira , Vitor Possebom

Differential privacy is a notion that has emerged in the community of statistical databases, as a response to the problem of protecting the privacy of the database's participants when performing statistical queries. The idea is that a…

Logic in Computer Science · Computer Science 2012-01-04 Mário S. Alvim , Miguel E. Andrés , Konstantinos Chatzikokolakis , Catuscia Palamidessi

We reexamine the Israel-type proof of the uniqueness theorem of the static spacetime outside the photon surface in the Einstein-conformal scalar system. We derive in a systematic fashion a new divergence identity which plays a key role in…

High Energy Physics - Theory · Physics 2021-09-15 Takeshi Shinohara , Yoshimune Tomikawa , Keisuke Izumi , Tetsuya Shiromizu

We present a de Bruijn type approximation for quantifying the content of m smooth numbers, derived from samples obtained through a probability measure over the set of integers less than or equal to n, with point mass function at k inversely…

Probability · Mathematics 2025-03-04 Arturo Jaramillo , Xiaochuan Yang

We consider a Bayesian problem of estimating of probability of success in a series of conditionally independent trials with binary outcomes. We study the asymptotic behaviour of differential entropy for posterior probability density…

Information Theory · Computer Science 2015-07-30 Mark Kelbert , Pavel Mozgunov

An identity between two versions of the Chernoff bound on the probability a certain large deviations event, is established. This identity has an interpretation in statistical physics, namely, an isothermal equilibrium of a composite system…

Information Theory · Computer Science 2007-07-13 Neri Merhav

Asymptotically entropy of chaotic systems increases linearly and the sensitivity to initial conditions is exponential with time: these two behaviors are related. Such relationship is the analogous of and under specific conditions has been…

Statistical Mechanics · Physics 2011-01-04 Roberto Tonelli , Giuseppe Mezzorani , Franco Meloni , Marcello Lissia , Massimo Coraddu

Partition identities are often statements asserting that the set $\mathcal P_X$ of partitions of $n$ subject to condition $X$ is equinumerous to the set $\mathcal P_Y$ of partitions of $n$ subject to condition $Y$. A Beck-type identity is a…

Number Theory · Mathematics 2020-09-17 Cristina Ballantine , Amanda Welch

We provide a general result for finding Stein operators for the product of two independent random variables whose Stein operators satisfy a certain assumption, extending a recent result of Gaunt, Mijoule and Swan \cite{gms18}. This…

Probability · Mathematics 2020-09-28 Robert E. Gaunt , Guillaume Mijoule , Yvik Swan

The first part of this work considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of…

Information Theory · Computer Science 2013-04-30 Igal Sason