English
Related papers

Related papers: Divergence Scaling for Distribution Matching

200 papers

Traditionally, the evolution of cooperation has been studied on single, isolated networks. Yet a player, especially in human societies, will typically be a member of many different networks, and those networks will play a different role in…

Physics and Society · Physics 2014-06-09 Zhen Wang , Lin Wang , Matjaz Perc

Channel polarization, originally proposed for binary-input channels, is generalized to arbitrary discrete memoryless channels. Specifically, it is shown that when the input alphabet size is a prime number, a similar construction to that for…

Information Theory · Computer Science 2009-08-04 Eren Sasoglu , Emre Telatar , Erdal Arikan

In many applications in biology, engineering and economics, identifying similarities and differences between distributions of data from complex processes requires comparing finite categorical samples of discrete counts. Statistical…

Methodology · Statistics 2023-07-11 Francesco Camaglia , Ilya Nemenman , Thierry Mora , Aleksandra M. Walczak

Finding a basis matrix (dictionary) by which objective signals are represented sparsely is of major relevance in various scientific and technological fields. We consider a problem to learn a dictionary from a set of training signals. We…

Disordered Systems and Neural Networks · Physics 2015-06-04 Ayaka Sakata , Yoshiyuki Kabashima

The ascent of scaling in artificial intelligence research has revolutionized the field over the past decade, yet it presents significant challenges for academic researchers, particularly in computational social science and critical…

Computers and Society · Computer Science 2025-04-24 Bolun Zhang , Yang Shen , Linzhuo Li , Yu Ji , Di Wu , Tongyu Wu , Lianghao Dai

An equivalent condition for the product of elements of an independent random sample on a compact algebraic group converging in distribution to some random variable as the sample size increases is obtained. Namely, a limit distribution…

Probability · Mathematics 2022-11-21 O. G. Styrt

We consider communication over binary-input memoryless output-symmetric channels using low-density parity-check codes and message-passing decoding. The asymptotic (in the length) performance of such a combination for a fixed number of…

Information Theory · Computer Science 2008-02-12 Satish Babu Korada , Ruediger Urbanke

We present the results of detailed numerical study of a model for the sharing and sorting of informations in a community consisting of a large number of agents. The information gathering takes place in a sequence of mutual bipartite…

Physics and Society · Physics 2015-06-16 Biplab Bhattacherjee , S. S. Manna , Animesh Mukherjee

The purpose of this note is to give a number of open problems on matching theory and their relation to the well-known results in this area. We also give a linear analogue of the acyclic matchings.

Group Theory · Mathematics 2018-03-23 Babak Hassanzadeh

An algorithm is presented for approximating a single-user channel with a prime input alphabet size. The result is an upgraded version of the channel with a reduced output alphabet size. It is shown that this algorithm can be used to reduce…

Information Theory · Computer Science 2013-05-06 Arash Ghayoori , T. Aaron Gulliver

Motivated by DNA storage in living organisms, and by known biological mutation processes, we study the reverse-complement string-duplication system. We fully classify the conditions under which the system has full expressiveness, for all…

Information Theory · Computer Science 2021-12-23 Eyar Ben-Tolila , Moshe Schwartz

We analyze the analytic continuation of the formally divergent one-loop amplitude for scattering of the graviton multiplet in the Type II Superstring. In particular we obtain explicit double and single dispersion relations, formulas for all…

High Energy Physics - Theory · Physics 2011-04-20 Eric D'Hoker , D. H. Phong

Recent observations in the theory of verse and empirical metrics have suggested that constructing a verse line involves a pattern-matching search through a source text, and that the number of found elements (complete words totaling a…

cmp-lg · Computer Science 2007-05-23 Hideaki Aoyama , John Constable

In this paper, we study various models for random combinatorial partitions using large deviation analysis for diverging scale of the reference process. Scaling limits of similar models have been studied recently \cite{FSa,FSb} going back to…

Probability · Mathematics 2022-06-22 Stefan Adams , Matthew Dickson

We use an information-theoretic measure of linguistic similarity to investigate the organization and evolution of scientific fields. An analysis of almost 20M papers from the past three decades reveals that the linguistic similarity is…

Digital Libraries · Computer Science 2018-01-30 Laercio Dias , Martin Gerlach , Joachim Scharloth , Eduardo G. Altmann

Divergent word usages reflect differences among people. In this paper, we present a novel angle for studying word usage divergence -- word interpretations. We propose an approach that quantifies semantic differences in interpretations among…

Computation and Language · Computer Science 2017-03-30 Tianran Hu , Ruihua Song , Maya Abtahian , Philip Ding , Xing Xie , Jiebo Luo

This paper presents a discriminative classifier for compositional data. This classifier is based on the posterior distribution of the Generalized Dirichlet which is the discriminative counterpart of Generalized Dirichlet mixture model.…

Machine Learning · Computer Science 2024-05-06 Elvis Togban , Djemel Ziou

This paper studies the effect of discretizing the parametrization of a dictionary used for Matching Pursuit decompositions of signals. Our approach relies on viewing the continuously parametrized dictionary as an embedded manifold in the…

Differential Geometry · Mathematics 2009-11-13 Laurent Jacques , Christophe De Vleeschouwer

The extremes of a stationary time series typically occur in clusters. A primary measure for this phenomenon is the extremal index, representing the reciprocal of the expected cluster size. Both a disjoint and a sliding blocks estimator for…

Statistics Theory · Mathematics 2017-07-14 Betina Berghaus , Axel Bücher

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed