English
Related papers

Related papers: A Preadapted Universal Switch Distribution for Tes…

200 papers

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

We propose a universal classifier for binary Neyman-Pearson classification where null distribution is known while only a training sequence is available for the alternative distribution. The proposed classifier interpolates between…

Information Theory · Computer Science 2022-06-24 Parham Boroumand , Albert Guillén i Fàbregas

The problem of quickest change detection is studied, where there is an additional constraint on the cost of observations used before the change point and where the post-change distribution is composite. Minimax formulations are proposed for…

Statistics Theory · Mathematics 2014-10-14 Taposh Banerjee , Venugopal V. Veeravalli

We study a majority based preference diffusion model in which the members of a social network update their preferences based on those of their connections. Consider an undirected graph where each node has a strict linear order over a set of…

Social and Information Networks · Computer Science 2023-12-27 Ahad N. Zehmakan

Universal compression algorithms have been studied in the past for sequential change detection, where they have been used to estimate the post-change distribution in the modified version of the Cumulative Sum (CUSUM) Test. In this paper, we…

Information Theory · Computer Science 2021-12-15 Vikrant Malik , R. K. Bansal

We consider communication over binary-input memoryless output-symmetric channels using low-density parity-check codes and message-passing decoding. The asymptotic (in the length) performance of such a combination for a fixed number of…

Information Theory · Computer Science 2008-02-12 Satish Babu Korada , Ruediger Urbanke

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents…

Optimization and Control · Mathematics 2022-10-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

We propose in this paper a new coding scheme called twisted-pair superposition transmission (TPST). The encoding is to "mix together" a pair of basic codes by superposition, while the decoding can be implemented as a successive cancellation…

Information Theory · Computer Science 2021-01-25 Suihua Cai , Xiao Ma

This work considers distributed sensing and transmission of sporadic random samples. Lower bounds are derived for the reconstruction error of a single normally or uniformly-distributed finite-dimensional vector imperfectly measured by a…

Information Theory · Computer Science 2015-11-20 Ayşe Ünsal , Raymond Knopp

The dependence of the frequency distributions due to multiple meanings of words in a text is investigated by deleting letters. By coding the words with fewer letters the number of meanings per coded word increases. This increase is measured…

Computation and Language · Computer Science 2017-10-04 Xiaoyong Yan , Petter Minnhagen

We study the notion of a generalization bound being uniformly tight, meaning that the difference between the bound and the population loss is small for all learning algorithms and all population distributions. Numerous generalization bounds…

Machine Learning · Computer Science 2023-11-29 Michael Gastpar , Ido Nachum , Jonathan Shafer , Thomas Weinberger

An important body of quantitative linguistics is constituted by a series of statistical laws about language usage. Despite the importance of these linguistic laws, some of them are poorly formulated, and, more importantly, there is no…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Isabel Serra

Raptor code ensembles with linear random outer codes in a fixed-rate setting are considered. An expression for the average distance spectrum is derived and this expression is used to obtain the asymptotic exponent of the weight…

Information Theory · Computer Science 2015-11-03 Francisco Lázaro , Enrico Paolini , Gianluigi Liva , Gerhard Bauch

We present a universal Holevo-like upper bound on the locally accessible information for arbitrary multipartite ensembles. This bound allows us to analyze the indistinguishability of a set of orthogonal states under LOCC. We also derive the…

Quantum Physics · Physics 2007-11-25 Wei Song

We consider a two-unicast-$Z$ network over a directed acyclic graph of unit capacitated edges; the two-unicast-$Z$ network is a special case of two-unicast networks where one of the destinations has apriori side information of the unwanted…

Information Theory · Computer Science 2018-05-29 Mohammad Fahim , Viveck Cadambe

We establish a novel framework for bounding the adapted power gain $G_p$ and approximation gain $G_a$ of coprime integer solutions to the generalized diagonal superelliptic equation $By^n = Ax^n + k$ with $x, y \ge 2$. By first deriving a…

Number Theory · Mathematics 2026-02-24 Karsten Müller

Tries are among the most versatile and widely used data structures on words. They are pertinent to the (internal) structure of (stored) words and several splitting procedures used in diverse contexts ranging from document taxonomy to IP…

Probability · Mathematics 2012-09-20 Kevin Leckey , Ralph Neininger , Wojciech Szpankowski

The basic underlying assumption of machine learning (ML) models is that the training and test data are sampled from the same distribution. However, in daily practice, this assumption is often broken, i.e. the distribution of the test data…

Computation and Language · Computer Science 2026-01-16 Adriana Valentina Costache , Silviu Florin Gheorghe , Eduard Gabriel Poesina , Paul Irofti , Radu Tudor Ionescu

Code-switching entails mixing multiple languages. It is an increasingly occurring phenomenon in social media texts. Usually, code-mixed texts are written in a single script, even though the languages involved have different scripts.…

Computation and Language · Computer Science 2025-11-24 Niraj Pahari , Kazutaka Shimada

A key aim in biology and psychology is to identify fundamental principles underpinning the behavior of animals, including humans. Analyses of human language and the behavior of a range of non-human animal species have provided evidence for…

Neurons and Cognition · Quantitative Biology 2014-12-03 R. Ferrer-i-Cancho , A. Hernández-Fernández , D. Lusseau , G. Agoramoorthy , M. J. Hsu , S. Semple