English
Related papers

Related papers: The Random Subsequence Model and Uniform Codes for…

200 papers

This paper considers error probabilities of random codes for memoryless channels in the fixed-rate regime. Random coding is a fundamental scheme to achieve the channel capacity and many studies have been conducted for the asymptotics of the…

Information Theory · Computer Science 2017-07-17 Junya Honda

We consider a variant of the channel simulation problem with a single input and multiple outputs, where Alice observes a probability distribution $P$ from a set of prescribed probability distributions $\mathbb{\mathcal{P}}$, and sends a…

Information Theory · Computer Science 2021-09-07 Chak Fung Choi , Cheuk Ting Li

We study reliable communication over finite-state channels (FSCs) using Reed--Muller (RM) codes. Building on recent symmetry-based analyses for memoryless channels, we show that a sequence of binary RM codes (with some random scrambling)…

Information Theory · Computer Science 2026-04-17 Henry D. Pfister , Navin Kashyap , Jean-Francois Chamberland , Galen Reeves

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

Information Theory · Computer Science 2023-02-17 Amit Tsvieli , Nir Weinberger

Recently [Bhattacharya et al., STOC 2015] provide the first non-trivial algorithm for the densest subgraph problem in the streaming model with additions and deletions to its edges, i.e., for dynamic graph streams. They present a…

Data Structures and Algorithms · Computer Science 2015-07-30 Hossein Esfandiari , MohammadTaghi Hajiaghayi , David P. Woodruff

The performance and the decoding complexity of a novel coding scheme based on the concatenation of maximum distance separable (MDS) codes and linear random fountain codes are investigated. Differently from Raptor codes (which are based on a…

Information Theory · Computer Science 2019-09-19 Francisco Lázaro , Giuliano Garrammone , Gianluigi Liva

Reed-Muller (RM) codes achieve the capacity of general binary-input memoryless symmetric channels and are conjectured to have a comparable performance to that of random codes in terms of scaling laws. However, such results are established…

Information Theory · Computer Science 2023-08-02 Mohammad Vahid Jamali , Xiyang Liu , Ashok Vardhan Makkuva , Hessam Mahdavifar , Sewoong Oh , Pramod Viswanath

The success of neural networks over the past decade has established them as effective models for many relevant data generating processes. Statistical theory on neural networks indicates graceful scaling of sample complexity. For example,…

Machine Learning · Computer Science 2023-03-28 Yifan Zhu , Hong Jun Jeon , Benjamin Van Roy

In this work, discrete element method (DEM) simulations coupled with machine learning are used to study the process of dry impregnation. Our results show that the particle bed contains two regimes. Regime 1 shows smaller inclination angles…

Applied Physics · Physics 2022-12-02 Joseph Shovlin , Kuang Liu , Yangyang Shen , Bill Borghard , Hernan A. Makse , Maria S. Tomassone

The problem of stabilizing an unstable plant over a noisy communication link is an increasingly important one that arises in problems of distributed control and networked control systems. Although the work of Schulman and Sahai over the…

Systems and Control · Computer Science 2011-03-24 Ravi Teja Sukhavasi , Babak Hassibi

The problem of stabilizing an unstable plant over a noisy communication link is an increasingly important one that arises in applications of networked control systems. Although the work of Schulman and Sahai over the past two decades, and…

Information Theory · Computer Science 2012-02-28 Ravi Teja Sukhavasi , Babak Hassibi

The task of the binary classification problem is to determine which of two distributions has generated a length-$n$ test sequence. The two distributions are unknown; two training sequences of length $N$, one from each distribution, are…

Information Theory · Computer Science 2016-04-18 Dayu Huang , Sean Meyn

Data deduplication saves storage space by identifying and removing repeats in the data stream. Compared with traditional compression methods, data deduplication schemes are more time efficient and are thus widely used in large scale storage…

Information Theory · Computer Science 2022-05-30 Hao Lou , Farzad Farnoud

This study presents a novel model for invertible sentence embeddings using a residual recurrent network trained on an unsupervised encoding task. Rather than the probabilistic outputs common to neural machine translation models, our…

Computation and Language · Computer Science 2023-04-07 Jeremy Wilkerson

Recent advances in DNA sequencing technology and DNA storage systems have rekindled the interest in deletion channels. Multiple recent works have looked at variants of sequence reconstruction over a single and over multiple deletion…

Information Theory · Computer Science 2020-06-01 Sundara Rajan Srinivasavaradhan , Michelle Du , Suhas Diggavi , Christina Fragouli

Consider a sequence $X^n$ of length $n$ emitted by a Discrete Memoryless Source (DMS) with unknown distribution $p_X$. The objective is to construct a lossless source code that maps $X^n$ to a sequence $\widehat{Y}^m$ of length $m$ that is…

Information Theory · Computer Science 2021-06-21 Remi A. Chou , Matthieu R. Bloch , Aylin Yener

In the \emph{trace reconstruction problem}, an unknown source string $x \in \{0,1\}^n$ is sent through a probabilistic \emph{deletion channel} which independently deletes each bit with probability $\delta$ and concatenates the surviving…

Data Structures and Algorithms · Computer Science 2020-08-31 Xi Chen , Anindya De , Chin Ho Lee , Rocco A. Servedio , Sandip Sinha

We consider a high-dimensional random constrained optimization problem in which a set of binary variables is subjected to a linear system of equations. The cost function is a simple linear cost, measuring the Hamming distance with respect…

Disordered Systems and Neural Networks · Physics 2022-11-23 Alfredo Braunstein , Louise Budzynski , Stefano Crotti , Federico Ricci-Tersenghi

Recurrent neural networks (RNNs) with continuous-time hidden states are a natural fit for modeling irregularly-sampled time series. These models, however, face difficulties when the input data possess long-term dependencies. We prove that…

Machine Learning · Computer Science 2020-12-07 Mathias Lechner , Ramin Hasani

We propose a list-decoding scheme for reconstruction codes in the context of uniform-tandem-duplication noise, which can be viewed as an application of the associative memory model to this setting. We find the uncertainty associated with…

Information Theory · Computer Science 2021-06-30 Yonatan Yehezkeally , Moshe Schwartz
‹ Prev 1 3 4 5 6 7 10 Next ›