English
Related papers

Related papers: Second-Order Region for Gray-Wyner Network

200 papers

Second-order coding rate of channel coding is discussed for general sequence of channels. The optimum second-order transmission rate with a constant error constraint $\epsilon$ is obtained by using the information spectrum method. We apply…

Information Theory · Computer Science 2016-11-15 Masahito Hayashi

Higher (2nd)-order Wigner distribution function in quantum phase space for entangled bi-modal coherent states, a representative of higher (2nd)-order optical-polarization, is introduced by generalizing kernel (transiting) operator in…

Quantum Physics · Physics 2012-04-04 Ravi S. Singh , Sunil P. Singh , Lallan Yadava , Gyaneshwar K. Gupta

In this work, we establish a full single-letter characterization of the rate-distortion region of an instance of the Gray-Wyner model with side information at the decoders. Specifically, in this model an encoder observes a pair of…

Information Theory · Computer Science 2018-02-14 Meryem Benammar , Abdellatif Zaidi

Second-order pooling, a.k.a.~bilinear pooling, has proven effective for deep learning based visual recognition. However, the resulting second-order networks yield a final representation that is orders of magnitude larger than that of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Kaicheng Yu , Mathieu Salzmann

A stochastic second-order trust region method is proposed, which can be viewed as a second-order extension of the trust-region-ish (TRish) algorithm proposed by Curtis et al. (INFORMS J. Optim. 1(3) 200-220, 2019). In each iteration, a…

Optimization and Control · Mathematics 2019-11-19 Frank E. Curtis , Rui Shi

We consider lossy compression of an information source when the decoder has lossless access to a correlated one. This setup, also known as the Wyner-Ziv problem, is a special case of distributed source coding. To this day, practical…

Information Theory · Computer Science 2024-05-22 Ezgi Ozyilkan , Johannes Ballé , Elza Erkip

This paper introduces a new theoretical framework for optimizing second-order behaviors of wireless networks. Unlike existing techniques for network utility maximization, which only considers first-order statistics, this framework models…

Networking and Internet Architecture · Computer Science 2022-01-19 Daojing Guo , Khaled Nakhleh , I-Hong Hou , Sastry Kompella , Clement Kam

Nonconvex optimization plays a key role in multi-user information theory and related fields, but it is usually difficult to solve. The rate region of the Gray--Wyner source coding system (or almost equivalently, the mutual information…

Information Theory · Computer Science 2023-07-07 Lei Yu

We consider lossy compression of an information source when the decoder has lossless access to a correlated one. This setup, also known as the Wyner-Ziv problem, is a special case of distributed source coding. To this day, real-world…

Information Theory · Computer Science 2023-05-09 Ezgi Ozyilkan , Johannes Ballé , Elza Erkip

The Wyner-Ahlswede-K\"orner (WAK) empirical-coordination problem where the encoders cooperate via a finite-capacity one-sided link is considered. The coordination-capacity region is derived by combining several source coding techniques,…

Information Theory · Computer Science 2016-11-18 Ziv Goldfeld , Haim H. Permuter , Gerhard Kramer

A new converse bound is presented for the two-user multiple-access channel under the average probability of error constraint. This bound shows that for most channels of interest, the second-order coding rate -- that is, the difference…

Information Theory · Computer Science 2021-10-04 Oliver Kosut

This paper studies the second-order asymptotics of the Gaussian multiple-access channel with degraded message sets. For a fixed average error probability $\varepsilon \in (0,1)$ and an arbitrary point on the boundary of the capacity region,…

Information Theory · Computer Science 2015-10-07 Jonathan Scarlett , Vincent Y. F. Tan

In this paper, we establish the second-order randomized identification capacity (RID capacity) of the Additive White Gaussian Noise Channel (AWGNC). On the one hand, we obtain a refined version of Hayashi's theorem to prove the…

Information Theory · Computer Science 2024-06-28 Zhicheng Liu , Yuan Li , Huazi Zhang , Jun Wang , Guiying Yan , Zhiming Ma

In the present paper, we focus on the vector optimization problems with inequality constraints, where objective functions and constrained functions are Fr\'echet differentiable, and whose gradient mapping is locally Lipschitz on an open…

Optimization and Control · Mathematics 2017-05-08 Nguyen Quang Huy , Do Sang Kim , Nguyen Van Tuyen

The problem of side-information scalable (SI-scalable) source coding is considered in this work, where the encoder constructs a progressive description, such that the receiver with high quality side information will be able to truncate the…

Information Theory · Computer Science 2007-08-01 Chao Tian , Suhas N. Diggavi

Wyner's common information was originally defined for a pair of dependent discrete random variables. Its significance is largely reflected in, hence also confined to, several existing interpretations in various source coding problems. This…

Information Theory · Computer Science 2013-01-11 Ge Xu , Wei Liu , Biao Chen

We consider a source coding problem with a network scenario in mind, and formulate it as a remote vector Gaussian Wyner-Ziv problem under covariance matrix distortions. We define a notion of minimum for two positive-definite matrices based…

Information Theory · Computer Science 2016-11-03 Adel Zahedi , Jan Østergaard , Søren Holdt Jensen , Patrick A. Naylor , Søren Bech

This paper characterizes the second-order coding rates for lossy source coding with side information available at both the encoder and the decoder. We first provide non-asymptotic bounds for this problem and then specialize the…

Information Theory · Computer Science 2014-10-13 Sy-Quoc Le , Vincent Y. F. Tan , Mehul Motani

We show a reduction method to construct a code for the Gray-Wyner (GW) network from a given code for the Wyner-Ahlswede-K\"orner (WAK) network. By combining this reduction with a converse bound on the GW network, we derive a converse bound…

Information Theory · Computer Science 2017-08-15 Shun Watanabe

The second-order coding rate of the multiple-input multiple-output (MIMO) quasi-static Rayleigh fading channel is studied. We tackle this problem via an information-spectrum approach and statistical bounds based on recent random matrix…

Information Theory · Computer Science 2016-11-17 Jakob Hoydis , Romain Couillet , Pablo Piantanida