Related papers: The KLR-theorem revisited
Gaussian process models are flexible, Bayesian non-parametric approaches to regression. Properties of multivariate Gaussians mean that they can be combined linearly in the manner of additive models and via a link function (like in…
The problem is sequence prediction in the following setting. A sequence $x_1,...,x_n,...$ of discrete-valued observations is generated according to some unknown probabilistic law (measure) $\mu$. After observing each outcome, it is required…
Bayesian and frequentist criteria fundamentally differ, but often posterior and sampling distributions agree asymptotically (e.g., Gaussian with same covariance). For the corresponding single-draw experiment, we characterize the frequentist…
We study a system of $N$ qubits with a random Hamiltonian obtained by drawing coupling constants from Gaussian distributions in various ways. This results in a rich class of systems which include the GUE and the fixed $q$ SYK theories. Our…
This study explores the estimation of parameters in a matrix-valued linear regression model, where the $T$ responses $(Y_t)_{t=1}^T \in \mathbb{R}^{n \times p}$ and predictors $(X_t)_{t=1}^T \in \mathbb{R}^{m \times q}$ satisfy the…
Let $A$ be a, not necessarily closed, linear relation in a Hilbert space $\sH$ with a multivalued part $\mul A$. An operator $B$ in $\sH$ with $\ran B\perp\mul A^{**}$ is said to be an operator part of $A$ when $A=B \hplus (\{0\}\times \mul…
By the well-known I.Kotlarski lemma, if $\xi_1$, $\xi_2$, and $\xi_3$ are independent real-valued random variables with nonvanishing characteristic functions, $L_1=\xi_1-\xi_3$ and $L_2=\xi_2-\xi_3$, then the distribution of the random…
We give counterexamples to a problem of M. Kac in the Scottish Book, which asks whether a certain nonlinear operation on two characteristic functions characterizes Laplace distributions, in analogy with the Cram\'er--L\'evy theorem for…
Let X be a second countable locally compact Abelian group. Let $\xi_1, \xi_2$ be independent random variables with values in the group X and distributions $\mu_1, \mu_2$ such that the sum $\xi_1+\xi_2$ and the difference $\xi_1-\xi_2$ are…
Kagan and Shalaevski 1967 have shown that if the random variables $X_1,\dots,X_n$ are independent and identically distributed and the distribution of $\sum_{i=1}^n(X_i+a_i)^2$ $a_i\in \mathbb{R}$ depends only on $\sum_{i=1}^na_i^2$ , then…
Let $X$ be an $n$-dimensional random centered Gaussian vector with independent but not identically distributed coordinates and let $T$ be an orthogonal trasformation of $\mathbb R^n$. We show that the random vector $Y=T(X)$ satisfies…
A tacit assumption in classical linear regression problems is the full knowledge of the existing link between the covariates and responses. In Unlinked Linear Regression (ULR) this link is either partially or completely missing. While the…
We prove that, for any jointly stable random variables $X_1, \dots, X_k$ with zero mean, any $m<k,$ and any even continuous positive definite functions $f$ and $g$ on $\Bbb R^m$ and $\Bbb R^{k-m},$ the random variables $f(X_1,\dots,X_m)$…
We study the characteristic polynomial of Haar distributed random unitary matrices. We show that after a suitable normalization, as one increases the size of the matrix, powers of the absolute value of the characteristic polynomial as well…
We present a short proof of a celebrated result of G\'acs and K\"orner giving sufficient and necessary condition on the joint distribution of two discrete random variables $X$ and $Y$ for the case when their mutual information matches the…
Via a covariance representation based on characteristic functions, a known elementary proof of the Gaussian concentration inequality is presented. A few other applications are briefly mentioned.
We investigate training and using Gaussian kernel SVMs by approximating the kernel with an explicit finite- dimensional polynomial feature representation based on the Taylor expansion of the exponential. Although not as efficient as the…
We consider structural equation models in which variables can be written as a function of their parents and noise terms, which are assumed to be jointly independent. Corresponding to each structural equation model, there is a directed…
Let $k$ be an uncountable algebraically closed field of positive characteristic and let $S$ be a smooth projective connected surface over $k$. We extend the theorem on the Gysin kernel from [20, Theorem 5.1] to also be true over $k$, where…
We analyze the distribution of $\sum_{i=1}^m v_i \bx_i$ where $\bx_1,...,\bx_m$ are fixed vectors from some lattice $\cL \subset \R^n$ (say $\Z^n$) and $v_1,...,v_m$ are chosen independently from a discrete Gaussian distribution over $\Z$.…