English
Related papers

Related papers: Predictive Complexity and Generalized Entropy Rate…

200 papers

We improve the entropic uncertainty relations for position and momentum coarse-grained measurements. We derive the continuous, coarse-grained counterparts of the discrete uncertainty relations based on the concept of majorization. The…

Quantum Physics · Physics 2015-06-30 Łukasz Rudnicki

Recently, Sidford, Wang, Wu and Ye (2018) developed an algorithm combining variance reduction techniques with value iteration to solve discounted Markov decision processes. This algorithm has a sublinear complexity when the discount factor…

Optimization and Control · Mathematics 2019-09-16 Marianne Akian , Stéphane Gaubert , Zheng Qu , Omar Saadi

We investigate activities that have different periods of duration. We define the profit intensity as a measure of this economic category. The profit intensity in a repeated trading has a unique property of attaining its maximum at a fixed…

Trading and Market Microstructure · Quantitative Finance 2009-11-13 Edward W. Piotrowski , Jan Sladkowski

Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome's plausibility. Information measures based on…

Information Theory · Computer Science 2020-01-17 Jed A. Duersch , Thomas A. Catanach

We investigate the resolution of second-order, potential, and monotone mean field games with the generalized conditional gradient algorithm, an extension of the Frank-Wolfe algorithm. We show that the method is equivalent to the fictitious…

Optimization and Control · Mathematics 2023-08-22 Pierre Lavigne , Laurent Pfeiffer

We apply the generalized conditional gradient algorithm to potential mean field games and we show its well-posedeness. It turns out that this method can be interpreted as a learning method called fictitious play. More precisely, each step…

Analysis of PDEs · Mathematics 2021-09-14 J Frédéric Bonnans , Pierre Lavigne , Laurent Pfeiffer

In the simplest sequential decision problem for an ergodic stochastic process X, at each time n a decision u_n is made as a function of past observations X_0,...,X_{n-1}, and a loss l(u_n,X_n) is incurred. In this setting, it is known that…

Probability · Mathematics 2015-02-04 Ramon van Handel

A unified combinatorial definition of the information content and entropy of different types of patterns, compatible with the traditional concepts of information and entropy, going beyond the limitations of Shannon information interpretable…

Information Theory · Computer Science 2025-01-22 Zsolt Pocze

We establish a conditional limit theorem for occupation times of infinite ergodic transformations under a tied-down condition, that is, the condition that the orbit returns to a reference set with finite measure at the final observation…

Dynamical Systems · Mathematics 2023-08-21 Jon. Aaronson , Toru Sera

We establish a stability result for the Shannon-McMillan-Breiman theorem on the one-sided finite shift space. For any shift-invariant probability measure P and any data-dependent parsing whose number of blocks is sublinear in N almost…

Information Theory · Computer Science 2026-04-16 Raphael Grondin

We establish an abstract local ergodic theorem, under suitable space-time scaling, for the (boundary-driven) symmetric exclusion process on an increasing sequence of balls covering an infinite weighted graph. The proofs are based on 1-block…

Probability · Mathematics 2017-08-25 Joe P. Chen

This thesis presents some geometric insights into three different types of two player prediction games -- namely general learning task, prediction with expert advice, and online convex optimization. These games differ in the nature of the…

Machine Learning · Computer Science 2018-05-23 Parameswaran Kamalaruban

We propose a sequential optimizing betting strategy in the multi-dimensional bounded forecasting game in the framework of game-theoretic probability of Shafer and Vovk (2001). By studying the asymptotic behavior of its capital process, we…

Probability · Mathematics 2011-02-16 Masayuki Kumon , Akimichi Takemura , Kei Takeuchi

The classical Eagleson's theorem states that if appropriately normalized Birkhoff sums generated by a measurable function and a probability preserving transformation converge in distribution, then they also converge in distribution with…

Dynamical Systems · Mathematics 2020-11-11 Yeor Hafouta

General probabilistic theories are designed to provide operationally the most general probabilistic models including both classical and quantum theories. In this letter, we introduce a systematic method to construct a series of entropies,…

Quantum Physics · Physics 2016-10-26 Gen Kimura , Junji Ishiguro , Makoto Fukui

Entropy regularization has been extensively adopted to improve the efficiency, the stability, and the convergence of algorithms in reinforcement learning. This paper analyzes both quantitatively and qualitatively the impact of entropy…

Optimization and Control · Mathematics 2021-12-10 Xin Guo , Renyuan Xu , Thaleia Zariphopoulou

We consider the problem of approximating the stationary distribution of an ergodic Markov chain given a set of sampled transitions. Classical simulation-based approaches assume access to the underlying process so that trajectories of…

Machine Learning · Computer Science 2020-03-03 Junfeng Wen , Bo Dai , Lihong Li , Dale Schuurmans

We consider two-player stochastic games played on a finite graph for infinitely many rounds. Stochastic games generalize both Markov decision processes (MDP) by adding an adversary player, and two-player deterministic games by adding…

Computer Science and Game Theory · Computer Science 2022-02-28 Laurent Doyen

In recent work by Bramoull\'{e} and Kranton, a model for the provision of public goods on a network was presented and relations between equilibria of such a game and properties of the network were established. This model was further…

Computer Science and Game Theory · Computer Science 2019-06-19 Karan N. Chadha , Ankur A. Kulkarni

It is well-known that a strict analogue of the Birkhoff Ergodic Theorem in infinite ergodic theory is trivial; it states that for any infinite-measure-preserving ergodic system the Birkhoff average of every integrable function is almost…

Dynamical Systems · Mathematics 2018-09-06 Marco Lenci , Sara Munday