English
Related papers

Related papers: Mixing, Ergodic, and Nonergodic Processes with Rap…

200 papers

We study the partial maxima of stationary \alpha-stable processes. We relate their asymptotic behavior to the ergodic theoretical properties of the flow. We observe a sharp change in the asymptotic behavior of the sequence of partial maxima…

Probability · Mathematics 2007-05-23 Gennady Samorodnitsky

This work addressed the problem of learning a network with communication between vertices. The communication between vertices is presented in the form of perturbation on the measure. We studied the scenario where samples are drawn from a…

Machine Learning · Statistics 2021-11-23 Yihan He

In this paper, we analyze the relationship between entropy and information in the context of the mixing process of two identical ideal gases. We will argue that entropy has a special information-based feature that is enfolded in the…

Quantum Physics · Physics 2015-06-26 Afshin Shafiee , Majid Karimi

Mixing describes the process by which solutes evolve from an initial heterogeneous state to uniformity under the stirring action of a fluid flow. Fluid stretching forms thin scalar lamellae which coalesce due to molecular diffusion. Owing…

Fluid Dynamics · Physics 2024-05-30 Joris Heyman , Tanguy Le Borgne , Philippe Davy , Emmanuel Villermaux

In thermal environments, information processing requires thermodynamic costs determined by the second law of thermodynamics. Information processing within finite time is particularly important, since fast information processing has…

Statistical Mechanics · Physics 2024-11-14 Takuya Kamijima , Ken Funo , Takahiro Sagawa

Stationary ergodic processes with finite alphabets are estimated by finite memory processes from a sample, an n-length realization of the process, where the memory depth of the estimator process is also estimated from the sample using…

Statistics Theory · Mathematics 2013-07-25 Zsolt Talata

Pinning down a precise understanding of information flow within physical interactions remains a central concern to fields like stochastic thermodynamics and quantum information science. In both spheres a careful accounting of bits (or…

Statistical Mechanics · Physics 2026-01-15 Miles Miller-Dickson , Christopher Rose

We adapt tools from information theory to analyze how an observer comes to synchronize with the hidden states of a finitary, stationary stochastic process. We show that synchronization is determined by both the process's internal…

Statistical Mechanics · Physics 2015-05-19 James P. Crutchfield , Christopher J. Ellison , Ryan G. James , John R. Mahoney

Following the recent success of word embeddings, it has been argued that there is no such thing as an ideal representation for words, as different models tend to capture divergent and often mutually incompatible aspects like…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Iñigo Lopez-Gazpio , Eneko Agirre

We investigate the convergence in distribution of sequential empirical processes of dependent data indexed by a class of functions F. Our technique is suitable for processes that satisfy a multiple mixing condition on a space of functions…

Probability · Mathematics 2014-09-26 Herold Dehling , Olivier Durieu , Marco Tusche

We consider homogeneous STIT tessellations in the $\ell$-dimensional Euclidean space ${\mathbb R}^\ell$. Based on results for the spatial $\beta$-mixing coefficient an upper bound for the variance of additive functionals of tessellations is…

Probability · Mathematics 2016-09-06 Servet Martínez , Werner Nagel

In many real-world situations, there are constraints on the ways in which a physical system can be manipulated. We investigate the entropy production (EP) and extractable work involved in bringing a system from some initial distribution $p$…

Statistical Mechanics · Physics 2022-11-22 Artemy Kolchinsky , David H. Wolpert

We prove that a rank one transformation satisfying a condition called restricted growth is a mixing transformation if and only if the spacer sequence for the transformation is uniformly ergodic. Uniform ergodicity is a generalization of the…

Dynamical Systems · Mathematics 2007-05-23 Darren Creutz , C. E. Silva

For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…

Statistical Mechanics · Physics 2013-04-08 A. C. Barato , D Hartich , U. Seifert

We give a thermodynamically consistent description of simultaneous heat and particle transport, as well as of the associated cross-effects, in the framework of a chaotic dynamical system, a generalized multibaker map. Besides the density, a…

chao-dyn · Physics 2009-10-31 Laszlo Matyas , Tamas Tel , Jurgen Vollmer

The deterministic notions of capacity and entropy are studied in the context of communication and storage of information using square-integrable, bandlimited signals subject to perturbation. The $(\epsilon,\delta)$-capacity, that extends…

Information Theory · Computer Science 2015-04-21 Massimo Franceschetti , Taehyung J. Lim

We study a system of $N$ interacting particles on $\bf{Z}$. The stochastic dynamics consists of two components: a free motion of each particle (independent random walks) and a pair-wise interaction between particles. The interaction belongs…

Probability · Mathematics 2011-10-25 A. Manita , V. Shcherbakov

Natural language relies on a finite lexicon to express an unbounded set of emerging ideas. One result of this tension is the formation of new compositions, such that existing linguistic units can be combined with emerging items into novel…

Computation and Language · Computer Science 2021-09-13 Lei Yu , Yang Xu

The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distribution is the variable part under fixed marginals. We aim to minimize and…

Optimization and Control · Mathematics 2025-09-08 Paula Franke , Kay Hamacher , Paul Manns

We obtain the hydrodynamic limit of one-dimensional interacting particle systems describing the macroscopic evolution of the density of mass in infinite volume from the microscopic dynamics. The processes are weak pertubations of the…

Probability · Mathematics 2009-08-14 Glauco Valle