English
Related papers

Related papers: Dual-Domain Exponent of Maximum Mutual Information…

200 papers

This paper investigates a unification of distributed source coding, multiple description coding, and source coding with side information at decoders. The equivalence between the multiple-decoder extension of distributed source coding with…

Information Theory · Computer Science 2024-10-28 Jun Muramatsu

Semantic segmentation is a fundamental problem in computer vision. It is considered as a pixel-wise classification problem in practice, and most segmentation models use a pixel-wise loss as their optimization riterion. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Shuai Zhao , Yang Wang , Zheng Yang , Deng Cai

We investigate the problem of strong coordination over a multiple-access channel (MAC) with cribbing encoders. In this configuration, two encoders observe independent and identically distributed (i.i.d.) samples of a source random variable…

Information Theory · Computer Science 2025-06-06 Viswanathan Ramachandran , Tobias J. Oechtering , Mikael Skoglund

This paper is focused on the performance analysis of binary linear block codes (or ensembles) whose transmission takes place over independent and memoryless parallel channels. New upper bounds on the maximum-likelihood (ML) decoding error…

Information Theory · Computer Science 2007-07-13 I. Sason , I. Goldenberg

In distributed communication, each transmitter prepares an ensemble of channel codes. To encode a message, a transmitter chooses a channel code individually without sharing the coding choice with other transmitters or with the receiver.…

Information Theory · Computer Science 2018-05-08 Yanru Tang , Faeze Heydaryan , Jie Luo

This paper focuses on molecular communication (MC) systems using two types of signaling molecules which may participate in a reversible bimolecular reaction in the channel. The motivation for studying these MC systems is that they can…

Information Theory · Computer Science 2019-07-25 Vahid Jamali , Nariman Farsad , Robert Schober , Andrea Goldsmith

In this paper, a refinement of the weight distribution in an MDS code is computed. Concretely, the number of codewords with a fixed amount of nonzero bits in both information and redundancy parts is obtained. This refinement improves the…

Information Theory · Computer Science 2016-07-26 F. J. Lobillo , Gabriel Navarro , José Gómez-Torrecillas

Asymptotic expressions of the mutual information between any discrete input and the corresponding output of the scalar additive white Gaussian noise channel are presented in the limit as the signal-to-noise ratio (SNR) tends to infinity.…

Information Theory · Computer Science 2014-04-23 Alex Alvarado , Fredrik Brannstrom , Erik Agrell , Tobias Koch

This paper considers the performance of Reed-Muller (RM) codes transmitted over binary memoryless symmetric (BMS) channels under bitwise maximum-a-posteriori (bit-MAP) decoding. Its main result is that, for a fixed BMS channel, the family…

Information Theory · Computer Science 2023-06-14 Galen Reeves , Henry D. Pfister

The problem of joint source-channel coding is considered for a stationary remote (noisy) Gaussian source and a Gaussian channel. The encoder and decoder are assumed to be causal and their combined operations are subject to a delay…

Information Theory · Computer Science 2012-03-29 Erik Johannesson , Anders Rantzer , Bo Bernhardsson , Andrey Ghulchak

We consider data transmission across discrete memoryless channels (DMCs) using variable-length codes with feedback. We consider the family of such codes whose rates are $\rho_N$ below the channel capacity $C$, where $\rho_N$ is a positive…

Information Theory · Computer Science 2018-05-17 Lan V. Truong , Vincent Y. F. Tan

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We introduce two notions of discrepancy between binary vectors, which are not metric functions in general but nonetheless capture the mathematical structure of the binary asymmetric channel. In turn, these lead to two new fundamental…

Information Theory · Computer Science 2022-01-19 Giuseppe Cotardo , Alberto Ravagnani

The golden code is a full-rate full-diversity space-time code for two transmit antennas that has a maximal coding gain. Because each codeword conveys four information symbols from an M-ary quadrature-amplitude modulation alphabet, the…

Information Theory · Computer Science 2008-11-14 Mohanned O. Sinnokrot , John R. Barry

With the unprecedented growth of signal processing and machine learning application domains, there has been a tremendous expansion of interest in distributed optimization methods to cope with the underlying large-scale problems.…

Optimization and Control · Mathematics 2022-10-25 Hansi Abeynanda , Chathuranga Weeraddana , G. H. J. Lanel , Carlo Fischione

Multiple imputation (MI) is a method for repairing and analyzing data with missing values. MI replaces missing values with a sample of random values drawn from an imputation model. The most popular form of MI, which we call posterior draw…

Methodology · Statistics 2019-11-18 Paul T. von Hippel , Jonathan Bartlett

The Binomial channel serves as a fundamental model for molecular communication (MC) systems employing molecule-counting receivers. Here, deterministic identification (DI) is addressed for the discrete-time Binomial channels (DTBC), subject…

Information Theory · Computer Science 2023-04-26 Mohammad Javad Salariseddigh , Vahid Jamali , Holger Boche , Christian Deppe , Robert Schober

We study the problem of universal decoding for unknown discrete memoryless channels in the presence of erasure/list option at the decoder, in the random coding regime. Specifically, we harness a universal version of Forney's classical…

Information Theory · Computer Science 2017-06-23 Wasim Huleihel , Nir Weinberger , Neri Merhav

We consider Gaussian multiple-input multiple-output (MIMO) channels with discrete input alphabets. We propose a non-diagonal precoder based on the X-Codes in \cite{Xcodes_paper} to increase the mutual information. The MIMO channel is…

Information Theory · Computer Science 2016-11-17 Saif Khan Mohammed , Emanuele Viterbo , Yi Hong , Ananthanarayanan Chockalingam

A Lagrange-dual (Gallager-style) lower bound is derived for the error exponent function of the typical random code (TRC) pertaining to the i.i.d. random coding ensemble and mismatched stochastic likelihood decoding. While the original…

Information Theory · Computer Science 2019-08-13 Neri Merhav