English
Related papers

Related papers: An Extremal Inequality for Long Markov Chains

200 papers

The classical Gray and Wyner source coding for a simple network for sources that generate a tuple of multivariate, correlated Gaussian random variables $(Y_1,Y_2)$ is re-examined using the geometric approach of Gaussian random variables,…

Information Theory · Computer Science 2021-02-16 Charalambos D. Charalambous , Jan H. van Schuppen

We derive novel upper and lower finite-length bounds of the error probability in joint source-channel coding when the source obeys an ergodic Markov process and the channel is a Markovian additive channel or a Markovian conditional additive…

Information Theory · Computer Science 2017-05-03 Ryo Yaguchi , Masahito Hayashi

We study extremal statistics and return intervals in stationary long-range correlated sequences for which the underlying probability density function is bounded and uniform. The extremal statistics we consider e.g., maximum relative to…

Statistical Mechanics · Physics 2015-05-13 N. R. Moloney , J. Davidsen

We show that on the curves y=e^{t(x)} where t(x) is a fixed polynomial, there holds a tangential Markov inequality of exponent four. Specifically, for the real interval [a,b] there is a constant C such that max_{x\in…

Complex Variables · Mathematics 2007-05-23 L. P. Bos , A. Brudnyi , N. Levenberg

This note presents sharp inequalities for deviation probability of a general quadratic form of a random vector \(\xiv\) with finite exponential moments. The obtained deviation bounds are similar to the case of a Gaussian random vector. The…

Probability · Mathematics 2013-02-08 Vladimir Spokoiny

We investigate distributed source coding of two correlated sources X and Y where messages are passed to a decoder in a cascade fashion. The encoder of X sends a message at rate R_1 to the encoder of Y. The encoder of Y then sends a message…

Information Theory · Computer Science 2009-05-13 Paul Cuff , Han-I Su , Abbas El Gamal

The seminal papers of Pickands [1,2] paved the way for a systematic study of high exceedance probabilities of both stationary and non-stationary Gaussian processes. Yet, in the vector-valued setting, due to the lack of key tools including…

Probability · Mathematics 2019-11-18 Krzysztof Dȩbicki , Enkelejd Hashorva , Longmin Wang

We calculate exact convergence times to reach random bipartite entanglement for various random protocols. The eigenproblem of a Markovian chain governing the process is mapped to a spin chain, thereby obtaining exact expression for the gap…

Quantum Physics · Physics 2008-09-26 Marko Znidaric

We study a distributed estimation problem in which two remotely located parties, Alice and Bob, observe an unlimited number of i.i.d. samples corresponding to two different parts of a random vector. Alice can send $k$ bits on average to…

Statistics Theory · Mathematics 2018-06-26 Uri Hadar , Ofer Shayevitz

In this paper, we consider the problem of secret key generation with one-way communication through both a rate-limited public channel and a rate-limited secure channels where the public channel is from Alice to Bob and Eve and the secure…

Information Theory · Computer Science 2020-04-13 Yinfei Xu , Daming Cao

There has been an increasing interest in testing the equality of large Pearson's correlation matrices. However, in many applications it is more important to test the equality of large rank-based correlation matrices since they are more…

Statistics Theory · Mathematics 2018-04-02 Cheng Zhou , Fang Han , Xinsheng Zhang , Han Liu

We establish a lower bound on the entropy of weighted sums of (possibly dependent) random variables $(X_1, X_2, \dots, X_n)$ possessing a symmetric joint distribution. Our lower bound is in terms of the joint entropy of $(X_1, X_2, \dots,…

Information Theory · Computer Science 2018-01-16 Jing Hao , Varun Jog

A pedagogical account of some aspects of Extreme Value Statistics (EVS) is presented from the somewhat non-standard viewpoint of Large Deviation Theory. We address the following problem: given a set of $N$ i.i.d. random variables…

Statistical Mechanics · Physics 2015-09-02 Pierpaolo Vivo

Given n (discrete or continuous) random variables X_i, the (2^n-1)-dimensional vector obtained by evaluating the joint entropy of all non-empty subsets of {X_1,...,X_n} is called an entropic vector. Determining the region of entropic…

Information Theory · Computer Science 2011-12-02 Sormeh Shadbakht , Babak Hassibi

We demonstrate the parallel between the properties of Gaussian vectors and the Euclidean geometry. In particular we study the Markov property and give various equivalent Euclidean and probabilistic characterizations. We also give a simple…

Probability · Mathematics 2020-09-16 Maciej P. Wojtkowski

Let $\mathbf{X}=\{X_{n}\}_{n\geq 1}$ be a sequence of stationary Gaussian variables and suppose that only some of the random variables from $\mathbf{X}$ can be observed. In this paper, by studying the limiting properties of multidimensional…

Probability · Mathematics 2024-06-06 Yuan Fang , Zhongquan Tan

In this paper, we derive non-asymptotic achievability and converse bounds on the random number generation with/without side-information. Our bounds are efficiently computable in the sense that the computational complexity does not depend on…

Information Theory · Computer Science 2016-09-28 Masahito Hayashi , Shun Watanabe

We consider sampling and enumeration problems for Markov equivalence classes. We create and analyze a Markov chain for uniform random sampling on the DAGs inside a Markov equivalence class. Though the worst case is exponentially slow…

Probability · Mathematics 2017-08-16 Megan Bernstein , Prasad Tetali

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

The optimal causal coding of a partially observed Markov process is studied, where the cost to be minimized is a bounded, non-negative, additive, measurable single-letter function of the source and the receiver output. A structural result…

Information Theory · Computer Science 2012-08-24 Serdar Yüksel