English
Related papers

Related papers: Data-Driven Optimization of Directed Information o…

200 papers

Directed information (DI) is an information measure that attempts to capture directionality in the flow of information from one random process to another. It is closely related to other causal influence measures, such as transfer entropy,…

Information Theory · Computer Science 2026-02-11 Dor Tsur , Oron Sabag , Navin Kashyap , Haim Permuter , Gerhard Kramer

Calculating the capacity (with or without feedback) of channels with memory and continuous alphabets is a challenging task. It requires optimizing the directed information (DI) rate over all channel input distributions. The objective is a…

Information Theory · Computer Science 2020-05-19 Ziv Aharoni , Dor Tsur , Ziv Goldfeld , Haim Henry Permuter

For any class of channel conditional distributions, with finite memory dependence on channel input RVs $A^n {\stackrel{\triangle}{=}} \{A_i: i=0, \ldots, n\}$ or channel output RVs $B^n {\stackrel{\triangle}{=}} \{B_i: i=0, \ldots, n\}$ or…

Information Theory · Computer Science 2016-08-22 Charalambos D. Charalambous , Christos K. Kourtellaris

Various applications of molecular communications (MC) are event-triggered, and, as a consequence, the prevalent Shannon capacity may not be the right measure for performance assessment. Thus, in this paper, we motivate and establish the…

Information Theory · Computer Science 2022-03-08 Mohammad Javad Salariseddigh , Uzi Pereg , Holger Boche , Christian Deppe , Vahid Jamali , Robert Schober

Motivated by communication systems with constrained complexity, we consider the problem of input symbol selection for discrete memoryless channels (DMCs). Given a DMC, the goal is to find a subset of its input alphabet, so that the optimal…

Information Theory · Computer Science 2024-07-02 Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh , Deniz Gündüz , Nir Weinberger

Following initial work by JaJa, Ahlswede and Cai, and inspired by a recent renewed surge in interest in deterministic identification (DI) via noisy channels, we consider the problem in its generality for memoryless channels with finite…

Information Theory · Computer Science 2025-03-28 Pau Colomer , Christian Deppe , Holger Boche , Andreas Winter

Several applications of molecular communications (MC) feature an alarm-prompt behavior for which the prevalent Shannon capacity may not be the appropriate performance metric. The identification capacity as an alternative measure for such…

Information Theory · Computer Science 2022-12-07 Mohammad Javad Salariseddigh , Vahid Jamali , Uzi Pereg , Holger Boche , Christian Deppe , Robert Schober

The Differential Privacy (DP) literature often centers on meeting privacy constraints by introducing noise to the query, typically using a pre-specified parametric distribution model with one or two degrees of freedom. However, this…

Cryptography and Security · Computer Science 2024-09-30 Sachin Kadam , Anna Scaglione , Nikhil Ravi , Sean Peisert , Brent Lunghino , Aram Shumavon

We extend the Blahut-Arimoto algorithm for maximizing Massey's directed information. The algorithm can be used for estimating the capacity of channels with delayed feedback, where the feedback is a deterministic function of the output. In…

Information Theory · Computer Science 2010-12-30 Iddo Naiss , Haim Permuter

The construction of optimal non-uniform mappings for discrete input memoryless channels (DIMCs) is investigated. An efficient algorithm to find optimal mappings is proposed and the rate by which a target distribution is approached is…

Information Theory · Computer Science 2014-07-09 Georg Böcherer

Many communication channels with discrete input have non-uniform capacity achieving probability mass functions (PMF). By parsing a stream of independent and equiprobable bits according to a full prefix-free code, a modu-lator can generate…

Information Theory · Computer Science 2011-01-04 Georg Böcherer , Rudolf Mathar

The development of optimal and efficient machine learning-based communication systems is likely to be a key enabler of beyond 5G communication technologies. In this direction, physical layer design has been recently reformulated under a…

Information Theory · Computer Science 2021-11-16 Nunzio A. Letizia , Andrea M. Tonello

We consider the problem of estimating an upper bound on the capacity of a memoryless channel with unknown channel law and continuous output alphabet. A novel data-driven algorithm is proposed that exploits the dual representation of…

Information Theory · Computer Science 2024-01-25 Christian Häger , Erik Agrell

This paper investigates the linear precoder design that maximizes the average mutual information of multiple-input multiple-output channels with finite-alphabet inputs and statistical channel state information known at the transmitter. This…

Information Theory · Computer Science 2011-09-07 Weiliang Zeng , Chengshan Xiao , Mingxi Wang , Jianhua Lu

A methodology is developed to realized optimal channel input conditional distributions, which maximize the finite-time horizon directed information, for channels with memory and feedback, by information lossless randomized strategies. The…

Information Theory · Computer Science 2016-04-06 Charalambos D. Charalambous , Christos K. Kourtellaris , Sergey Loyka

Analytical modeling of field-assisted molecular communication under dynamic electric fields is fundamentally challenging due to the coupling between stochastic transport and complex boundary geometries, which renders conventional partial…

Information Theory · Computer Science 2026-04-02 Po-Chun Chou , Yen-Chi Lee , Chun-An Yang , Chia-Han Lee , Ping-Cheng Yeh

Diffusive molecular communications (DiMC) have recently gained attention as a candidate for nano- to micro- and macro-scale communications due to its simplicity and energy efficiency. As signal propagation is solely enabled by Brownian…

Information Theory · Computer Science 2021-01-11 Mustafa Can Gursoy , Masoumeh Nasiri-Kenari , Urbashi Mitra

We consider the problem of energy-efficient point-to-point transmission of delay-sensitive data (e.g. multimedia data) over a fading channel. Existing research on this topic utilizes either physical-layer centric solutions, namely…

Machine Learning · Computer Science 2017-03-29 Nicholas Mastronarde , Mihaela van der Schaar

We study the problem of computing the capacity of a discrete memoryless channel under uncertainty affecting the channel law matrix, and possibly with a constraint on the average cost of the input distribution. The problem has been…

Information Theory · Computer Science 2018-05-28 Krzysztof Postek , Aharon Ben-Tal

This paper explores the Achievable Information Rate (AIR) of a diffusive Molecular Communication (MC) channel featuring a fully absorbing receiver that counts the absorbed particles during symbol time intervals (STIs) and resets the counter…

Information Theory · Computer Science 2023-08-08 Fardad Vakilipoor , Luca Barletta , Stefano Bregni , Maurizio Magarini
‹ Prev 1 2 3 10 Next ›