English
Related papers

Related papers: Information theory of massively parallel probe sto…

200 papers

Scrambling quantum systems have attracted attention as effective substrates for temporal information processing. Here we consider a quantum reservoir processing framework that captures a broad range of physical computing models with quantum…

Exactly solvable neural network models with asymmetric weights are rare, and exact solutions are available only in some mean-field approaches. In this article we find exact analytical solutions of an asymmetric spin-glass-like model of…

Neurons and Cognition · Quantitative Biology 2017-02-16 Diego Fasoli , Anna Cattani , Stefano Panzeri

Because of its high data density and longevity, DNA is emerging as a promising candidate for satisfying increasing data storage needs. Compared to conventional storage media, however, data stored in DNA is subject to a wider range of errors…

Information Theory · Computer Science 2020-08-20 Yuanyuan Tang , Farzad Farnoud

The storage capacity of a binary classification model is the maximum number of random input-output pairs per parameter that the model can learn. It is one of the indicators of the expressive power of machine learning models and is important…

Disordered Systems and Neural Networks · Physics 2024-12-02 Sota Nishiyama , Masayuki Ohzeki

The DNA storage channel is considered, in which the $M$ Deoxyribonucleic acid (DNA) molecules comprising each codeword are stored without order, sampled $N$ times with replacement, and then sequenced over a discrete memoryless channel. For…

Information Theory · Computer Science 2022-02-15 Nir Weinberger , Neri Merhav

Understanding how information can efficiently spread in distributed systems under noisy communications is a fundamental question in both biological research and artificial system design. When agents are able to control whom they interact…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-11 Niccolò D'Archivio , Amos Korman , Emanuele Natale , Robin Vacus

In this paper, we consider a recent channel model of a nanopore sequencer proposed by McBain, Viterbo, and Saunderson (2024), termed the noisy nanopore channel (NNC). In essence, an NNC is a duplication channel with structured, Markov…

Information Theory · Computer Science 2025-04-25 V. Arvind Rameshwar , Nir Weinberger

Motivated by communication channels in which the transmitted sequences are subject to random permutations, as well as by certain DNA storage systems, we study the error control problem in settings where the information is stored/transmitted…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Vincent Y. F. Tan

In this paper, we study achievable rates of concatenated coding schemes over a deoxyribonucleic acid (DNA) storage channel. Our channel model incorporates the main features of DNA-based data storage. First, information is stored on many,…

Information Theory · Computer Science 2020-05-04 Andreas Lenz , Lorenz Welter , Sven Puchinger

We investigate the problem of maintaining an encoded distributed storage system when some nodes contain adversarial errors. Using the error-correction capabilities that are built into the existing redundancy of the system, we propose a…

Cryptography and Security · Computer Science 2015-03-17 Theodoros K. Dikaliotis , Alexandros G. Dimakis , Tracey Ho

Due to its longevity and enormous information density, DNA is an attractive medium for archival data storage. Thanks to rapid technological advances, DNA storage is becoming practically feasible, as demonstrated by a number of experimental…

Information Theory · Computer Science 2022-11-11 Ilan Shomorony , Reinhard Heckel

In this paper, we examine the problem of information storage on memristors affected by resistive drift noise under energy constraints. We introduce a novel, fundamental trade-off between the information lifetime of memristive states and the…

Emerging Technologies · Computer Science 2025-01-22 Waleed El-Geresy , Christos Papavassiliou , Deniz Gündüz

We study the problem of secure joint source-channel coding for multimodal semantic sources transmitted over noisy wiretap channels. The source model consists of $m$ modalities (e.g., image, audio, and sensor data), all represented as random…

Information Theory · Computer Science 2026-05-26 Denis Kozlov , Mahtab Mirmohseni , Rahim Tafazolli

Sorting is the task of ordering $n$ elements using pairwise comparisons. It is well known that $m=\Theta(n\log n)$ comparisons are both necessary and sufficient when the outcomes of the comparisons are observed with no noise. In this paper,…

Information Theory · Computer Science 2024-07-09 Ziao Wang , Nadim Ghaddar , Banghua Zhu , Lele Wang

In this paper we extend our investigations on noise-assisted storage devices through the experimental study of a loop composed of a single Schmitt trigger and an element that introduces a finite delay. We show that such a system allows the…

Adaptation and Self-Organizing Systems · Physics 2015-05-27 G. Bellomo , G. A. Patterson , P. I. Fierens , D. F. Grosz

We establish the capacity of a class of communication channels introduced in [1]. The $n$-letter input from a finite alphabet is passed through a discrete memoryless channel $P_{Z|X}$ and then the output $n$-letter sequence is uniformly…

Information Theory · Computer Science 2023-10-30 Jennifer Tang , Yury Polyanskiy

Despite their significant advantages over competing technologies, nanopore sequencers are plagued by high error rates, due to physical characteristics of the nanopore and inherent noise in the biological processes. It is thus paramount not…

Information Theory · Computer Science 2025-10-27 Anisha Banerjee , Yonatan Yehezkeally , Antonia Wachter-Zeh , Eitan Yaakobi

Due to its longevity and enormous information density, DNA is an attractive medium for archival storage. In this work, we study the fundamental limits and trade-offs of DNA-based storage systems by introducing a new channel model, which we…

Information Theory · Computer Science 2020-01-20 Ilan Shomorony , Reinhard Heckel

We consider the problem of communicating over a channel that breaks the message block into fragments of random lengths, shuffles them out of order, and deletes a random fraction of the fragments. Such a channel is motivated by applications…

Information Theory · Computer Science 2024-07-09 Aditya Narayan Ravi , Alireza Vahid , Ilan Shomorony

In this work, we show, for the well-studied problem of learning parity under noise, where a learner tries to learn $x=(x_1,\ldots,x_n) \in \{0,1\}^n$ from a stream of random linear equations over $\mathrm{F}_2$ that are correct with…

Machine Learning · Computer Science 2021-07-07 Sumegha Garg , Pravesh K. Kothari , Pengda Liu , Ran Raz