English
Related papers

Related papers: Subset Typicality Lemmas and Improved Achievable R…

200 papers

Lossless variable-length source coding with unequal cost function is considered for general sources. In this problem, the codeword cost instead of codeword length is important. The infimum of average codeword cost has already been…

Information Theory · Computer Science 2012-05-10 Ryo Nomura , Toshiyasu Matsushima

This work presents a new way of exploiting non-uniform file popularity in coded caching networks. Focusing on a fully-connected fully-interfering wireless setting with multiple cache-enabled transmitters and receivers, we show how…

Information Theory · Computer Science 2021-03-23 Eleftherios Lampiris , Berksan Serbetci , Thrasyvoulos Spyropoulos , Giuseppe Caire , Petros Elia

Locally repairable codes (LRCs) have gained significant interest for the design of large distributed storage systems as they allow a small number of erased nodes to be recovered by accessing only a few others. Several works have thus been…

Information Theory · Computer Science 2019-06-07 Matthias Grezet , Ragnar Freij-Hollanti , Thomas Westerbäck , Camilla Hollanti

Over-parameterized models like deep nets and random forests have become very popular in machine learning. However, the natural goals of continuity and differentiability, common in regression models, are now often ignored in modern…

Machine Learning · Computer Science 2023-10-16 Mingxuan Han , Varun Shankar , Jeff M Phillips , Chenglong Ye

Recently, large-scale visual language pre-trained (VLP) models have demonstrated impressive performance across various downstream tasks. Motivated by these advancements, pioneering efforts have emerged in multi-label image recognition with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Leilei Ma , Hongxing Xie , Lei Wang , Yanping Fu , Dengdi Sun , Haifeng Zhao

We present sufficient conditions for multicasting a set of correlated sources over cooperative networks. We propose joint source-Wyner-Ziv encoding/sliding-window decoding scheme, in which each receiver considers an ordered partition of…

Information Theory · Computer Science 2009-01-16 Mohammad Hossein Yassaee , Mohammad Reza Aref

A low-complexity coding scheme is developed to achieve the rate region of maximum likelihood decoding for interference channels. As in the classical rate-splitting multiple access scheme by Grant, Rimoldi, Urbanke, and Whiting, the proposed…

Information Theory · Computer Science 2017-01-11 Lele Wang , Young-Han Kim , Chiao-Yi Chen , Hosung Park , Eren Sasoglu

A new single-letter achievable rate region is proposed for the two-user discrete memoryless multiple-access channel(MAC) with noiseless feedback. The proposed region includes the Cover-Leung rate region [1], and it is shown that the…

Information Theory · Computer Science 2014-03-31 Ramji Venkataramanan , S. Sandeep Pradhan

Given a general source with countably infinite source alphabet and a general channel with arbitrary abstract channel input/channel output alphabets, we study the joint source-channel coding problem from the information-spectrum point of…

Information Theory · Computer Science 2007-12-19 Te Sun Han

Nonconvex optimization plays a key role in multi-user information theory and related fields, but it is usually difficult to solve. The rate region of the Gray--Wyner source coding system (or almost equivalently, the mutual information…

Information Theory · Computer Science 2023-07-07 Lei Yu

A packing lemma is proved using a setting where the channel is a binary-input discrete memoryless channel $(\mathcal{X},w(y|x),\mathcal{Y})$, the code is selected at random subject to parity-check constraints, and the decoder is a joint…

Information Theory · Computer Science 2015-05-05 Erdal Arıkan

The communication scenario under consideration in this paper corresponds to a multiuser channel with side information and consists of a broadcast channel with two legitimate receivers and an eavesdropper. Mainly, the results obtained are as…

Information Theory · Computer Science 2012-10-24 Maël Le Treust , Abdellatif Zaidi , Samson Lasaulce

We investigate the achievable rate of data transmission from sources to sinks through a multiple-relay network. We study achievable rates for omniscient coding, in which all nodes are considered in the coding design at each node. We find…

Information Theory · Computer Science 2010-04-15 Lawrence Ong , Mehul Motani

A new channel coding approach was proposed in [1] for random multiple access communication over the discrete-time memoryless channel. The coding approach allows users to choose their communication rates independently without sharing the…

Information Theory · Computer Science 2016-11-15 Zheng Wang , Jie Luo

In this paper, we consider a distributed reception scenario where a transmitter broadcasts a signal to multiple geographically separated receive nodes over fading channels, and each node forwards a few bits representing a processed version…

Information Theory · Computer Science 2015-06-19 Junil Choi , David J. Love , Patrick Bidigare

In the problem of variable-length $\delta$-channel resolvability, the channel output is approximated by encoding a variable-length uniform random number under the constraint that the variational distance between the target and approximated…

Information Theory · Computer Science 2018-01-16 Hideki Yagi , Te Sun Han

The diversity across outputs generated by LLMs shapes perception of their quality and utility. High lexical diversity is often desirable, but there is no standard method to measure this property. Templated answer structures and ``canned''…

Computation and Language · Computer Science 2026-02-19 Chantal Shaib , Venkata S. Govindarajan , Joe Barrow , Jiuding Sun , Alexa F. Siu , Byron C. Wallace , Ani Nenkova

In this paper the ensemble of codes formed by a serial concatenation of a repetition code with multiple accumulators connected through random interleavers is considered. Based on finite length weight enumerators for these codes, asymptotic…

Information Theory · Computer Science 2008-10-21 Joerg Kliewer , Kamil S. Zigangirov , Christian Koller , Daniel J. Costello

An index code for broadcast channel with receiver side information is locally decodable if each receiver can decode its demand by observing only a subset of the transmitted codeword symbols instead of the entire codeword. Local decodability…

Information Theory · Computer Science 2020-07-31 Lakshmi Natarajan , Prasad Krishnan , V. Lalitha , Hoang Dau

We describe and analyze the joint source/channel coding properties of a class of sparse graphical codes based on compounding a low-density generator matrix (LDGM) code with a low-density parity check (LDPC) code. Our first pair of theorems…

Information Theory · Computer Science 2007-07-13 Martin J. Wainwright , Emin Martinian