English
Related papers

Related papers: Rewritable storage channels with hidden state

200 papers

Recurrent neural networks are a widely used class of neural architectures. They have, however, two shortcomings. First, they are often treated as black-box models and as such it is difficult to understand what exactly they learn as well as…

Machine Learning · Computer Science 2022-12-13 Cheng Wang , Carolin Lawrence , Mathias Niepert

We consider the Gel'fand-Pinsker problem in which the channel and state are general, i.e., possibly non-stationary, non-memoryless and non-ergodic. Using the information spectrum method and a non-trivial modification of the piggyback coding…

Information Theory · Computer Science 2014-04-17 Vincent Y. F. Tan

There is an implicit assumption that by unfolding recurrent neural networks (RNN) in finite time, the misspecification of choosing a zero value for the initial hidden state is mitigated by later time steps. This assumption has been shown to…

Machine Learning · Computer Science 2019-02-12 Sam Wenke , Jim Fleming

Several cryptosystems based on the \emph{Ring Learning with Errors} (RLWE) problem have been proposed within the NIST post-quantum cryptography standardization process, e.g., NewHope. Furthermore, there are systems like Kyber which are…

Information Theory · Computer Science 2022-11-28 Georg Maringer , Sven Puchinger , Antonia Wachter-Zeh

There is a long history of side channels in the memory hierarchy of modern CPUs. Especially the cache side channel is widely used in the context of transient execution attacks and covert channels. Therefore, many secure cache architectures…

Cryptography and Security · Computer Science 2022-09-07 Jan Philipp Thoma , Tim Güneysu

Certain biological neurons demonstrate a remarkable capability to optimally compress the history of sensory inputs while being maximally informative about the future. In this work, we investigate if the same can be said of artificial…

Machine Learning · Computer Science 2020-02-12 Zhe Dong , Deniz Oktay , Ben Poole , Alexander A. Alemi

To model time-varying nonlinear temporal dynamics in sequential data, a recurrent network capable of varying and adjusting the recurrence depth between input intervals is examined. The recurrence depth is extended by several intermediate…

Machine Learning · Computer Science 2017-08-15 Hyunsin Park , Chang D. Yoo

When classical or quantum information is broadcast to separate receivers, there exist codes that encrypt the encoded data such that the receivers cannot recover it when performing local operations and classical communication, but they can…

Quantum Physics · Physics 2016-05-31 Cosmo Lupo , Mark M. Wilde , Seth Lloyd

In terabit-density magnetic recording, several bits of data can be replaced by the values of their neighbors in the storage medium. As a result, errors in the medium are dependent on each other and also on the data written. We consider a…

Information Theory · Computer Science 2011-11-23 Arya Mazumdar , Alexander Barg , Navin Kashyap

Reliable communication imposes an upper limit on the achievable rate, namely the Shannon capacity. Wyner's wiretap coding, which ensures a security constraint also, in addition to reliability, results in decrease of the achievable rate. To…

Information Theory · Computer Science 2017-02-14 Shahid M. Shah , Vinod Sharma

This paper studies covert communication over channels with ADSI when the state is available either non-causally or causally at the transmitter. Covert communication refers to reliable communication between a transmitter and a receiver while…

Information Theory · Computer Science 2025-01-24 Hassan ZivariFard , Xiaodong Wang

We propose locally rewritable codes (LWC) for resistive memories inspired by locally repairable codes (LRC) for distributed storage systems. Small values of repair locality of LRC enable fast repair of a single failed node since the lost…

Binary-input memoryless channels with a runlength constrained input are considered. Upper bounds to the capacity of such noisy runlength constrained channels are derived using the dual capacity method with Markov test distributions…

Information Theory · Computer Science 2016-11-17 Andrew Thangaraj

In this paper, a new wiretap channel model is proposed, where the legitimate transmitter and receiver communicate over a discrete memoryless channel. The wiretapper has perfect access to a fixed-length subset of the transmitted codeword…

Information Theory · Computer Science 2017-01-25 Mohamed Nafea , Aylin Yener

We study noisy broadcast networks with local cache memories at the receivers, where the transmitter can pre-store information even before learning the receivers' requests. We mostly focus on packet-erasure broadcast networks with two…

Information Theory · Computer Science 2016-05-10 Shirin Saeedi Bidokhti , Michèle Wigger , Roy Timo

We design and conduct a simple experiment to study whether neural networks can perform several steps of approximate reasoning in a fixed dimensional latent space. The set of rewrites (i.e. transformations) that can be successfully performed…

Machine Learning · Computer Science 2019-09-27 Dennis Lee , Christian Szegedy , Markus N. Rabe , Sarah M. Loos , Kshitij Bansal

A noisy network coding scheme for sending multiple sources over a general noisy network is presented. For multi-source multicast networks, the scheme naturally extends both network coding over noiseless networks by Ahlswede, Cai, Li, and…

Information Theory · Computer Science 2015-03-13 Sung Hoon Lim , Young-Han Kim , Abbas El Gamal , Sae-Young Chung

Input space reconstruction is an attractive representation learning paradigm. Despite interpretability of the reconstruction and generation, we identify a misalignment between learning by reconstruction, and learning for perception. We show…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Randall Balestriero , Yann LeCun

In an arbitrarily varying channel (AVC), the channel has a state which is under the control of an adversarial jammer and the corresponding capacities are often functions of the "power" constraints on the transmitter and jammer. In this…

Information Theory · Computer Science 2025-04-29 Bikash Kumar Dey , Sidharth Jaggi , Michael Langberg , Anand D. Sarwate , Yihan Zhang

Coded caching is a recently proposed technique for dealing with large scale content distribution over the Internet. As in conventional caching, it leverages the presence of local caches at the end users. However, it considers coding in the…

Information Theory · Computer Science 2016-05-06 Li Tang , Aditya Ramamoorthy