English
Related papers

Related papers: Codeword or noise? Exact random coding exponents f…

200 papers

Message-passing models of distributed computing vary along numerous dimensions: degree of synchrony, kind of faults, number of faults... Unfortunately, the sheer number of models and their subtle distinctions hinder our ability to design a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-13 Adam Shimi , Aurélie Hurault , Philippe Quéinnec

A coding scheme for transmission of a bit maps a given bit to a sequence of channel inputs (called the codeword associated to the transmitted bit). In this paper, we study the problem of designing the best code for a discrete Poisson…

Information Theory · Computer Science 2021-04-16 Niloufar Ahmadypour , Amin Gohari

Due to the short and bursty incoming messages, channel access activities in a wireless random access system are often fractional. The lack of frequent data support consequently makes it difficult for the receiver to estimate and track the…

Information Theory · Computer Science 2011-10-11 Zheng Wang , Jie Luo

We consider a setting of non-cooperative communication where a receiver wants to recover randomly generated sequences of symbols that are observed by a strategic sender. The sender aims to maximize an average utility that may not align with…

Information Theory · Computer Science 2025-03-03 Anuj S. Vora , Ankur A. Kulkarni

Probabilistic next-token prediction trained using cross-entropy loss is the basis of most large language models. Given a sequence of previous values, next-token prediction assigns a probability to each possible next value in the vocabulary.…

Machine Learning · Statistics 2025-05-19 Jacob Trauger , Ambuj Tewari

In this work, we introduce a framework to study the effect of random operations on the combinatorial list-decodability of a code. The operations we consider correspond to row and column operations on the matrix obtained from the code by…

Information Theory · Computer Science 2014-08-12 Atri Rudra , Mary Wootters

A sliding window algorithm receives a stream of symbols and has to output at each time instant a certain value which only depends on the last $n$ symbols. If the algorithm is randomized, then at each time instant it produces an incorrect…

Formal Languages and Automata Theory · Computer Science 2018-02-22 Moses Ganardi , Danny Hucke , Markus Lohrey

We present a randomized distributed algorithm that in radio networks with collision detection broadcasts a single message in $O(D+\log^2 n)$ time slots, with high probability. In view of the lower-bound $\Omega(D+\log^2 n)$, our algorithm…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-04 Ny Aina Andriambolamalala , Vlady Ravelomanana

We consider a system in which an information source generates independent and identically distributed status update packets from an observed phenomenon that takes $n$ possible values based on a given pmf. These update packets are encoded at…

Information Theory · Computer Science 2020-01-28 Melih Bastopcu , Baturalp Buyukates , Sennur Ulukus

A status updating communication system is examined, in which a transmitter communicates with a receiver over a noisy channel. The goal is to realize timely delivery of fresh data over time, which is assessed by an age-of-information (AoI)…

Information Theory · Computer Science 2019-05-09 Ahmed Arafa , Karim Banawan , Karim G. Seddik , H. Vincent Poor

We consider an approach to fault tolerant quantum computing based on a simple error detecting code operating as the substrate for a conventional surface code. We develop a customised decoder to process the information about the likely…

Quantum Physics · Physics 2019-12-11 Xiaosi Xu , Qi Zhao , Xiao Yuan , Simon C. Benjamin

Algorithms are developed for the quickest detection of a change in statistically periodic processes. These are processes in which the statistical properties are nonstationary but repeat after a fixed time interval. It is assumed that the…

Methodology · Statistics 2023-03-07 Yousef Oleyaeimotlagh , Taposh Banerjee , Ahmad Taha , Eugene John

Randomized techniques play a fundamental role in theoretical computer science and discrete mathematics, in particular for the design of efficient algorithms and construction of combinatorial objects. The basic goal in derandomization theory…

Discrete Mathematics · Computer Science 2011-07-26 Mahdi Cheraghchi

In distributed communication, each transmitter prepares an ensemble of channel codes. To encode a message, a transmitter chooses a channel code individually without sharing the coding choice with other transmitters or with the receiver.…

Information Theory · Computer Science 2018-05-08 Yanru Tang , Faeze Heydaryan , Jie Luo

In this paper, random coding error exponents and cutoff rate are studied for noncoherent Rician fading channels, where neither the receiver nor the transmitter has channel side information. First, it is assumed that the input is subject…

Information Theory · Computer Science 2016-11-18 Mustafa Cenk Gursoy

We investigate dense coding by imposing various locality restrictions to our decoder by employing the resource theory of asymmetry framework. In this task, the sender Alice and the receiver Bob share an entangled state. She encodes the…

Quantum Physics · Physics 2024-09-10 Masahito Hayashi , Kun Wang

This paper revisits a classical scenario in communication theory: a waveform sampled at regular intervals is to be encoded so as to minimize distortion in its reconstruction, despite noise. This transformation must be online (causal), to…

Discrete Mathematics · Computer Science 2019-06-04 Leonard J. Schulman , Piyush Srivastava

We define all-to-all encode, a collective communication operation serving as a primitive in decentralized computation and storage systems. Consider a scenario where every processor initially has a data packet and requires a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-21 Canran Wang , Netanel Raviv

Decoding sits between a language model and everything we do with it, yet it is still treated as a heuristic knob-tuning exercise. We argue decoding should be understood as a principled optimisation layer: at each token, we solve a…

Machine Learning · Computer Science 2026-02-26 Xiaotong Ji , Rasul Tutunov , Matthieu Zimmer , Haitham Bou-Ammar

We examine dense coding with an arbitrary pure entangled state sharing between the sender and the receiver. Upper bounds on the average success probability in approximate dense coding and on the probability of conclusive results in…

Quantum Physics · Physics 2009-11-13 Yuan Feng , Runyao Duan , Zhengfeng Ji
‹ Prev 1 4 5 6 7 8 10 Next ›