English
Related papers

Related papers: Discrete Layered Entropy, Conditional Compression …

200 papers

In this paper, we consider contention resolution algorithms that are augmented with predictions about the network. We begin by studying the natural setup in which the algorithm is provided a distribution defined over the possible network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-27 Seth Gilbert , Calvin Newport , Nitin Vaidya , Alex Weaver

We propose a general framework for neural network compression that is motivated by the Minimum Description Length (MDL) principle. For that we first derive an expression for the entropy of a neural network, which measures its complexity…

Machine Learning · Computer Science 2018-12-20 Simon Wiedemann , Arturo Marban , Klaus-Robert Müller , Wojciech Samek

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

In the first chapter of Shannon's "A Mathematical Theory of Communication," it is shown that the maximum entropy rate of an input process of a constrained system is limited by the combinatorial capacity of the system. Shannon considers…

Information Theory · Computer Science 2009-11-20 Georg Böcherer , Valdemar Cardoso da Rocha Junior , Cecilio Pimentel

Learning-based lossy image compression usually involves the joint optimization of rate-distortion performance. Most existing methods adopt spatially invariant bit length allocation and incorporate discrete entropy approximation to constrain…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Mu Li , Wangmeng Zuo , Shuhang Gu , Jane You , David Zhang

From the output produced by a memoryless deletion channel from a uniformly random input of known length $n$, one obtains a posterior distribution on the channel input. The difference between the Shannon entropy of this distribution and that…

Information Theory · Computer Science 2018-08-01 Arash Atashpendar , David Mestel , A. W. Roscoe , Peter Y. A. Ryan

This paper provides an extensive study of the behavior of the best achievable rate (and other related fundamental limits) in variable-length lossless compression. In the non-asymptotic regime, the fundamental limits of fixed-to-variable…

Information Theory · Computer Science 2012-12-13 Ioannis Kontoyiannis , Sergio Verdu

We solve an open problem related to an optimal encoding of a straight line program (SLP), a canonical form of grammar compression deriving a single string deterministically. We show that an information-theoretic lower bound for representing…

Data Structures and Algorithms · Computer Science 2013-06-18 Yasuo Tabei , Yoshimasa Takabatake , Hiroshi Sakamoto

We study the problem of generating a random variate $X$ from a finite discrete probability distribution $P$ using an entropy source of independent fair coin flips. A classic result from Knuth and Yao shows that the optimal expected number…

Data Structures and Algorithms · Computer Science 2026-04-28 Thomas L. Draper , Feras A. Saad

This article presents the calculation of the entropy of a system with Zipfian distribution and shows that a communication system tends to present an exponent value close to one, but still greater than one, so that it might maximize entropy…

Applications · Statistics 2013-07-04 Leonardo Carneiro Araujo , Thaïs Cristófaro-Silva , Hani Camille Yehia

We investigate symbolic sequences and in particular information carriers as e.g. books and DNA-strings. First the higher order Shannon entropies are calculated, a characteristic root law is detected. Then the algorithmic entropy is…

Disordered Systems and Neural Networks · Physics 2007-05-23 Werner Ebeling , Alexander Neiman , Thorsten Poeschel

We investigate higher derivative estimates for the Lam\'e system with hard inclusions embedded in a bounded domain in $\mathbb{R}^{d}$. As the distance $\varepsilon$ between two closely spaced hard inclusions approaches zero, the stress in…

Analysis of PDEs · Mathematics 2024-11-26 Hongjie Dong , Haigang Li , Huaijun Teng , Peihao Zhang

The entanglement entropy of a subsystem $A$ of a quantum system is expressed, in the replica method, through analytic continuation with respect to n of the trace of the n-th power of the reduced density matrix $\tr\rho_A^n$. We study the…

Statistical Mechanics · Physics 2010-03-25 F. Gliozzi , L. Tagliacozzo

This paper explores the relationship between the condition number of a neural network's weight tensor and the extent of information encoded by the associated processing unit, viewed through the lens of information theory. It argues that a…

Machine Learning · Statistics 2026-02-10 Oswaldo Ludwig

Extensive efforts have been made to boost the performance in the domain of language models by introducing various attention-based transformers. However, the inclusion of linear layers with large dimensions contributes to significant…

Machine Learning · Computer Science 2024-11-19 Priyansh Bhatnagar , Linfeng Wen , Mingu Kang

In this note we present that the patch counting entropy can be obtained as a limit and investigate which sequences of compact sets are suitable to define this quantity. We furthermore present a geometric definition of patch counting entropy…

Dynamical Systems · Mathematics 2020-11-26 Till Hauser

Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…

Information Theory · Computer Science 2016-11-18 Francisco J. Piera , Patricio Parada

The stretched exponential function, $\exp[-(t/\tau_{K})^{\beta}]$, describes various relaxation processes while it has been suggested that the power exponent, $\beta$ is derived from the non-uniformity of the process. In this paper, we…

Soft Condensed Matter · Physics 2018-09-12 Hirokazu Maruoka , Akio Nishimura , Makoto Yoshida , Keisuke Hatada

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

In this paper, the maximum entropy property of the discrete-time first-order stable spline kernel is studied. The advantages of studying this property in discrete-time domain instead of continuous-time domain are outlined. One of such…

Systems and Control · Computer Science 2015-04-14 Tohid Ardeshiri , Tianshi Chen
‹ Prev 1 4 5 6 7 8 10 Next ›