English
Related papers

Related papers: Common Randomness Generation from Sources with Inf…

200 papers

We consider the secret key generation problem when sources are randomly excited by the sender and there is a noiseless public discussion channel. Our setting is thus similar to recent works on channels with action-dependent states where the…

Information Theory · Computer Science 2016-11-15 Tzu-Han Chou , Vincent Y. F. Tan , Stark C. Draper

We consider the problem of synthesizing a memoryless channel between an unobserved source and a remote terminal. An encoder has access to a partial or noisy version $Z^n = (Z_1, \ldots, Z_n)$ of a remote source sequence $X^n = (X_1, \ldots,…

Information Theory · Computer Science 2025-07-22 Yassine Hamdi , Deniz Gündüz

Two processors output correlated sequences using the help of a coordinator with whom they individually share independent randomness. For the case of unlimited shared randomness, we characterize the rate of communication required from the…

Information Theory · Computer Science 2018-05-09 Gowtham R. Kurri , Vinod M. Prabhakaran , Anand D. Sarwate

The problem of simultaneously generating a secret key (SK) and private key (PK) pair among three terminals via public discussion is investigated, in which each terminal observes a component of correlated sources. All three terminals are…

Information Theory · Computer Science 2014-04-28 Huishuai Zhang , Lifeng Lai , Yingbin Liang , Hua Wang

Generative Commonsense Reasoning (GCR) requires a model to reason about a situation using commonsense knowledge, while generating coherent sentences. Although the quality of the generated sentences is crucial, the diversity of the…

Computation and Language · Computer Science 2024-09-30 Tianhui Zhang , Bei Peng , Danushka Bollegala

We define a growing model of random graphs. Given a sequence of nonnegative integers $\{d_n\}_{n=0}^\infty$ with the property that $d_i\leq i$, we construct a random graph on countably infinitely many vertices $v_0,v_1\ldots$ by the…

Combinatorics · Mathematics 2017-04-04 Csaba Biró , Udayan B. Darji

We consider the problem of universally communicating over an unknown and arbitrarily varying channel, using feedback. The focus of this paper is on determining the input behavior, and specifically, a prior distribution which is used to…

Information Theory · Computer Science 2012-02-03 Yuval Lomnitz , Meir Feder

We consider the first-order theory of random variables with the probabilistic independence relation, which concerns statements consisting of random variables, the probabilistic independence symbol, logical operators, and existential and…

Information Theory · Computer Science 2021-08-18 Cheuk Ting Li

The success of large language models (LLMs) has motivated formal theories of language generation and learning. We study the framework of \emph{language generation in the limit}, where an adversary enumerates strings from an unknown language…

Data Structures and Algorithms · Computer Science 2025-11-10 Jon Kleinberg , Fan Wei

We study language generation in the limit, where an algorithm observes an adversarial enumeration of strings from an unknown target language $K$ and must eventually generate new, unseen strings from $K$. Kleinberg and Mullainathan [KM24]…

Machine Learning · Statistics 2025-11-11 Anay Mehrotra , Grigoris Velegkas , Xifan Yu , Felix Zhou

We study countable graphs that -- up to isomorphism and with probability one -- arise from a random process, in a similar fashion as the Rado graph. Unlike in the classical case, we do not require that probabilities assigned to pairs of…

Combinatorics · Mathematics 2026-01-23 Ziemowit Kostana , Jarosław Swaczyna , Agnieszka Widz

We study language generation in the limit under bounded memory. In this task, a learner observes examples from an unknown target language one at a time and must eventually output only new valid examples. Prior work assumes access to the…

Data Structures and Algorithms · Computer Science 2026-05-29 Jon Kleinberg , Anay Mehrotra , Amin Saberi , Grigoris Velegkas

We show that some derived $\mathrm{L}^1$ full groups provide examples of non simple Polish groups with the topological bounded normal generation property. In particular, it follows that there are Polish groups with the topological bounded…

Group Theory · Mathematics 2018-01-08 Philip A. Dowerk , François Le Maître

We consider a model for secrecy generation, with three terminals, by means of public interterminal communication, and examine the problem of characterizing all the rates at which all three terminals can generate a ``secret key,'' and --…

Information Theory · Computer Science 2007-07-13 Chunxuan Ye , Prakash Narayan

We study a distributed sampling problem where a set of processors want to output (approximately) independent and identically distributed samples from a joint distribution with the help of a common message from a coordinator. Each processor…

Information Theory · Computer Science 2021-06-24 Gowtham R. Kurri , Vinod M. Prabhakaran , Anand D. Sarwate

The zero-error channel capacity is the maximum asymptotic rate that can be reached with error probability exactly zero, instead of a vanishing error probability. The nature of this problem, essentially combinatorial rather than…

Information Theory · Computer Science 2020-01-13 Nicolas Charpenay , Maël Le Treust

In the problem of channel resolvability, where a given output probability distribution via a channel is approximated by transforming the uniform random numbers, characterizing the asymptotically minimum rate of the size of the random…

Information Theory · Computer Science 2017-01-31 Hideki Yagi

We establish the capacity of a class of communication channels introduced in [1]. The $n$-letter input from a finite alphabet is passed through a discrete memoryless channel $P_{Z|X}$ and then the output $n$-letter sequence is uniformly…

Information Theory · Computer Science 2023-10-30 Jennifer Tang , Yury Polyanskiy

Several aspects of the problem of asynchronous point-to-point communication without feedback are developed when the source is highly intermittent. In the system model of interest, the codeword is transmitted at a random time within a…

Information Theory · Computer Science 2012-07-10 Aslan Tchamkerten , Venkat Chandar , Gregory Wornell

We introduce a random coding technique for transmission over discrete memoryless channels, reminiscent of the basic construction attaining the Gilbert-Varshamov bound for codes in Hamming spaces. The code construction is based on drawing…

Information Theory · Computer Science 2019-03-15 Anelia Somekh-Baruch , Jonathan Scarlett , Albert Guillén i Fàbregas