English
Related papers

Related papers: Saving fractional bits: A practical entropy effici…

200 papers

The total entropy production generated by the dynamics of an externally driven systems exchanging energy and matter with multiple reservoirs and described by a master equation is expressed as the sum of three contributions, each…

Statistical Mechanics · Physics 2010-03-01 Massimiliano Esposito , Upendra Harbola , Shaul Mukamel

The standard particle-in-cell algorithm suffers from grid heating. There exists a gridless alternative which bypasses the deposition step and calculates each Fourier mode of the charge density directly from the particle positions. We show…

Plasma Physics · Physics 2019-09-04 Matthew S. Mitchell , Matthew T. Miecnikowski , Gregory Beylkin , Scott E. Parker

This note describes an algorithm for enumerating all the elements in a finite set based on uniformly random sampling from the set. This algorithm can be used for enumeration by fair sampling with quantum annealing. Our algorithm is based on…

Quantum Physics · Physics 2021-04-06 Yuta Mizuno , Tamiki Komatsuzaki

We introduce new rounding methods to improve the accuracy of finite precision quantum arithmetic. These quantum rounding methods are applicable when multiple samples are being taken from a quantum program. We show how to use multiple…

Quantum Physics · Physics 2021-08-18 Rajiv Krishnakumar , William Zeng

In this contribution we derive and analyze a new numerical method for kinetic equations based on a variable transformation of the moment approximation. Classical minimum-entropy moment closures are a class of reduced models for kinetic…

Numerical Analysis · Mathematics 2021-09-22 Tobias Leibner , Mario Ohlberger

In this paper, I investigate more closely the recently proposed Free Energy Monte Carlo algorithm that is devised in particular for calculations where conventional Monte Carlo simulations struggle with ergodicity problems. The simplest…

Condensed Matter · Physics 2007-05-23 M. J. Thill

Preserving biodiversity and ecosystem stability is a challenge that can be pursued through modern statistical mechanics modeling. Here we introduce a variational maximum entropy-based algorithm to evaluate the entropy in a minimal ecosystem…

Biological Physics · Physics 2018-10-17 Mattia Miotto , Lorenzo Monacelli

I propose a new algorithm, a free energy Monte Carlo algorithm, for calculations where conventional Monte Carlo simulations struggle with ergodicity problems. The simplest version of the proposed algorithm allows for the determination of…

Condensed Matter · Physics 2007-05-23 M. J. Thill

The efficient preparation of input distributions is an important problem in obtaining quantum advantage in a wide range of domains. We propose a novel quantum algorithm for the efficient preparation of arbitrary normal distributions in…

Quantum Physics · Physics 2021-12-30 Arthur G. Rattew , Yue Sun , Pierre Minssen , Marco Pistoia

For any discrete probability distributions with bounded entropy, we can generate exactly a random variate using only a finite expected number of perfect coin flips. A perfect coin flip is the outcome of an unbiased Bernoulli random…

Information Theory · Computer Science 2020-11-12 Luc Devroye , Claude Gravel

We establish a sharp estimate for a minimal number of binary digits (bits) needed to represent all bounded total generalized variation functions taking values in a general totally bounded metric space $(E,\rho)$ up to an accuracy of…

Functional Analysis · Mathematics 2020-11-19 Rossana Capuani , Prerona Dutta , Khai T. Nguyen

Suppose that you have $n$ colours and $m$ mutually independent dice, each of which has $r$ sides. Each dice lands on any of its sides with equal probability. You may colour the sides of each die in any way you wish, but there is one…

Probability · Mathematics 2018-08-14 Christos Pelekis

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

We apply the replica trick to compute the entropy of a cylinder amplitude in string theory. We focus on the contribution from non-perturbative winding modes and impose tadpole cancellation to understand the correct prescription for…

High Energy Physics - Theory · Physics 2017-07-19 Andrea Prudenziati , Diego Trancanelli

This paper proposes a novel entropy encoding technique for lossless data compression. Representing a message string by its lexicographic index in the permutations of its symbols results in a compressed version matching Shannon entropy of…

Information Theory · Computer Science 2017-03-24 Abu Bakar Siddique

Active systems comprise a class of nonequilibrium dynamics in which individual components autonomously dissipate energy. Efforts towards understanding the role played by activity have centered on computation of the entropy production rate…

Statistical Mechanics · Physics 2024-11-22 Nicholas M. Boffi , Eric Vanden-Eijnden

Penney's Ante exhibits non-transitivity when two target strings race to appear in a shared stream of coin tosses. We study instead independent string races, where each player observes their own independent and identically distributed…

Probability · Mathematics 2026-01-26 Søren Riis , Mike Paterson

We design, implement and test a simple algorithm which computes the approximate entropy of a finite binary string of arbitrary length. The algorithm uses a weighted average of the Shannon Entropies of the string and all but the last binary…

Other Computer Science · Computer Science 2013-09-17 Grenville J. Croll

`Twenty questions' is a guessing game played by two players: Bob thinks of an integer between $1$ and $n$, and Alice's goal is to recover it using a minimal number of Yes/No questions. Shannon's entropy has a natural interpretation in this…

Data Structures and Algorithms · Computer Science 2018-11-07 Yuval Dagan , Yuval Filmus , Daniel Kane , Shay Moran

The profile of a sample is the multiset of its symbol frequencies. We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression. Specifically,…

Machine Learning · Statistics 2020-02-27 Yi Hao , Alon Orlitsky