English
Related papers

Related papers: The Random Subsequence Model and Uniform Codes for…

200 papers

Capacity formulas and random-coding exponents are derived for a generalized family of Gel'fand-Pinsker coding problems. These exponents yield asymptotic upper bounds on the achievable log probability of error. In our model, information is…

Information Theory · Computer Science 2007-07-13 Pierre Moulin , Ying Wang

We consider the problem of erasure/list decoding using certain classes of simplified decoders. Specifically, we assume a class of erasure/list decoders, such that a codeword is in the list if its likelihood is larger than a threshold. This…

Information Theory · Computer Science 2016-11-17 Nir Weinberger , Neri Merhav

In this work, we consider the problem of efficient decoding of codes from insertions and deletions. Most of the known efficient codes are codes with synchronization strings which allow one to reduce the problem of decoding insertions and…

Information Theory · Computer Science 2025-05-06 Anisha Banerjee , Roni Con , Antonia Wachter-Zeh , Eitan Yaakobi

We present a Random-Phase-Approximation formalism for the collective spectrum of two hyperfine species of dilute 40K atoms, magnetically trapped at zero temperature and subjected to a repulsive s-wave interaction between atoms with…

Condensed Matter · Physics 2009-10-31 P. Capuzzi , E. S. Hernandez

We describe an apparatus for subgradient-following of the optimum of convex problems with variational penalties. In this setting, we receive a sequence $y_i,\ldots,y_n$ and seek a smooth sequence $x_1,\ldots,x_n$. The smooth sequence needs…

Machine Learning · Computer Science 2025-04-11 Kai-Chia Mo , Shai Shalev-Shwartz , Nisæl Shártov

Sparse superposition codes, or sparse regression codes, constitute a new class of codes which was first introduced for communication over the additive white Gaussian noise (AWGN) channel. It has been shown that such codes are…

Information Theory · Computer Science 2018-11-12 Jean Barbier , Mohamad Dia , Nicolas Macris

Density functional theory underlies the most successful and widely used numerical methods for electronic structure prediction of solids. However, it has the fundamental shortcoming that the universal density functional is unknown. In…

Disordered Systems and Neural Networks · Physics 2020-09-23 M. Michael Denner , Mark H. Fischer , Titus Neupert

The range-minimum query (RMQ) problem is a fundamental data structuring task with numerous applications. Despite the fact that succinct solutions with worst-case optimal $2n+o(n)$ bits of space and constant query time are known, it has been…

Data Structures and Algorithms · Computer Science 2019-03-07 J. Ian Munro , Sebastian Wild

We consider an invariant random matrix model where the standard Gaussian potential is distorted by an additional single pole of order $m$. We compute the average or macroscopic spectral density in the limit of large matrix size, solving the…

Mathematical Physics · Physics 2014-07-09 Gernot Akemann , Dario Villamaina , Pierpaolo Vivo

Using the asymptotical minimax framework, we examine convergence rates equivalency between a continuous functional deconvolution model and its real-life discrete counterpart over a wide range of Besov balls and for the $L^2$-risk. For this…

Statistics Theory · Mathematics 2010-10-06 Marianna Pensky , Theofanis Sapatinas

Memoryless channels with deletion errors as defined by a stochastic channel matrix allowing for bit drop outs are considered in which transmitted bits are either independently deleted with probability $d$ or unchanged with probability…

Information Theory · Computer Science 2012-11-13 Mojtaba Rahmati , Tolga M. Duman

This paper presents the recurrent estimation of distributions (RED) for modeling real-valued data in a semiparametric fashion. RED models make two novel uses of recurrent neural networks (RNNs) for density estimation of general real-valued…

Machine Learning · Computer Science 2017-05-31 Junier B. Oliva , Kumar Avinava Dubey , Barnabas Poczos , Eric Xing , Jeff Schneider

We provide efficient algorithms for the problem of distribution learning from high-dimensional Gaussian data where in each sample, some of the variable values are missing. We suppose that the variables are missing not at random (MNAR). The…

Machine Learning · Computer Science 2025-04-29 Arnab Bhattacharyya , Constantinos Daskalakis , Themis Gouleakis , Yuhao Wang

Irreversible random sequential deposition of interacting particles is widely used to model aggregation phenomena in physical, chemical, and biophysical systems. We show that in one dimension the exact time dependent solution of such…

Statistical Mechanics · Physics 2019-06-07 Adrian Baule

This paper presents a new construction of error correcting codes which achieves optimal recovery of a streaming source over a packet erasure channel. The channel model considered is the sliding window erasure model, with burst and arbitrary…

Information Theory · Computer Science 2019-04-23 Damian Dudzicz , Silas L. Fong , Ashish Khisti

Many popular random partition models, such as the Chinese restaurant process and its two-parameter extension, fall in the class of exchangeable random partitions, and have found wide applicability in model-based clustering, population…

Methodology · Statistics 2017-11-21 Giuseppe Di Benedetto , François Caron , Yee Whye Teh

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

This paper investigates the problem of variable-length lossy source coding allowing a positive excess distortion probability and an overflow probability of codeword lengths. Novel one-shot achievability and converse bounds of the optimal…

Information Theory · Computer Science 2018-12-17 Shota Saito , Hideki Yagi , Toshiyasu Matsushima

Uniform sampling of simple graphs having a given degree sequence is a known problem with exponential complexity in the square of the mean degree. For undirected graphs, randomised approximation algorithms have nonetheless been shown to…

Probability · Mathematics 2022-06-28 Femke van Ieperen , Ivan Kryven

Expand-and-sparsify representations are a class of theoretical models that capture sparse representation phenomena observed in the sensory systems of many animals. At a high level, these representations map an input $x \in \mathbb{R}^d$ to…

Statistics Theory · Mathematics 2026-03-20 Kaushik Sinha , Christopher Tosh