Related papers: An Information-Theoretic Proof of the Kac--Bernste…

We present a short proof of a celebrated result of G\'acs and K\"orner giving sufficient and necessary condition on the joint distribution of two discrete random variables $X$ and $Y$ for the case when their mutual information matches the…

We propose a simple multivariate normality test based on Kac-Bernstein's characterization, which can be conducted by utilising existing statistical independence tests for sums and differences of data samples. We also perform its empirical…

In $1946$, Mark Kac proved a Central Limit type theorem for a sequence of random variables that were not independent. The random variables under consideration were obtained from the angle-doubling map. The idea behind Kac's proof was to…

For two independent, almost surely finite random variables, independence of their minimum (time) and the event that one of them is either greater, equal or less than the other (cause) is completely characterized. It is shown that, other…

We introduce a test for the conditional independence of random variables $X$ and $Y$ given a random variable $Z$, specifically by sampling from the joint distribution $(X,Y,Z)$, binning the support of the distribution of $Z$, and conducting…

This paper proves the Baum--Katz theorem for sequences of pairwise independent identically distributed random variables with general norming constants under optimal moment conditions. The proof exploits some properties of slowly varying…

One of the main notions of information theory is the notion of mutual information in two messages (two random variables in Shannon information theory or two binary strings in algorithmic information theory). The mutual information in $x$…

Let $X$ be a second countable locally compact Abelian group. We prove some group analogues of the Skitovich--Darmois, Heyde and Kac--Bernstein characterisation theorems for $Q$-independent random variables taking values in the group $X$.…

We consider a pair of causally independent processes, modelled as the tensor product of two channels, acting on a possibly correlated input to produce random outputs X and Y. We show that, assuming the processes produce a sufficient amount…

In the paper we generalize the following characterization of beta distribution to the symmetric cone setting: let $X$ and $Y$ be independent, non-degenerate random variables with values in $(0,1)$, then $U=1-XY$ and $V=\frac{1-X}{U}$ are…

In this article we show that the Erd\H{o}s-Kac theorem, which informally states that the number of prime divisors of very large integers converges to a normal distribution, has an elegant proof via Algorithmic Information Theory.

It is known that if X is uniformly distributed modulo 1 and Y is an arbitrary random variable independent of X then Y+X is also uniformly distributed modulo 1. We prove a converse for any continuous random variable Y (or a reasonable…

Let $X$ be a locally compact Abelian group, $Y$ be its character group. Following A. Kagan and G. Sz\'ekely we introduce a notion of $Q$-independence for random variables with values in $X$. We prove group analogues of the Cram\'er,…

Kagan and Shalaevski 1967 have shown that if the random variables $X_1,\dots,X_n$ are independent and identically distributed and the distribution of $\sum_{i=1}^n(X_i+a_i)^2$ $a_i\in \mathbb{R}$ depends only on $\sum_{i=1}^na_i^2$ , then…

We study a setting where Bayesian agents with a common prior have private information related to an event's outcome and sequentially make public announcements relating to their information. Our main result shows that when agents' private…

In this paper we discuss the following problem: given a random variable $Z=X+Y$ with Gamma law such that $X$ and $Y$ are independent, we want to understand if then $X$ and $Y$ {\it each} follow a Gamma law. This is related to Cram\'er's…

In the present paper we prove the following conjecture in Kingman, J.F.C., Random walks with spherical symmetry, Acta Math.,109, (1963), 11-53. concerning a famous Raikov's theorem of decomposition of Poisson random variables: "If a radial…

We adapt arguments concerning information-theoretic convergence in the Central Limit Theorem to the case of dependent random variables under Rosenblatt mixing conditions. The key is to work with random variables perturbed by the addition of…

This work investigates the intersection property of conditional independence. It states that for random variables $A,B,C$ and $X$ we have that $X$ independent of $A$ given $B,C$ and $X$ independent of $B$ given $A,C$ implies $X$ independent…

A popular approach for testing if two univariate random variables are statistically independent consists of partitioning the sample space into bins, and evaluating a test statistic on the binned data. The partition size matters, and the…