English
Related papers

Related papers: Further remarks on absorbing Markov decision proce…

200 papers

Partially Observable Markov Decision Processes (POMDPs) are rich environments often used in machine learning. But the issue of information and causal structures in POMDPs has been relatively little studied. This paper presents the concepts…

Artificial Intelligence · Computer Science 2018-01-16 Stuart Armstrong

We study the structure of invariant measures for continuous automorphisms of compact metrizable abelian groups satisfying the descending chain condition. We show that the finitely supported invariant measures are weak-* dense in the space…

Dynamical Systems · Mathematics 2025-07-21 Rotem Yaari

In this paper we investigate repeated weak measurements,without post-selection, on a \emph{single copy} of an \emph{unknown} quantum state. The resulting random walk in state space is precisely characterised in terms of joint probabilities…

Quantum Physics · Physics 2017-06-30 N. D. Hari Dass

In the uniformly hyperbolic setting it is well known that the set of all measures supported on periodic orbits is dense in the convex space of all invariant measures. In this paper we consider the converse question, in the non-uniformly…

Dynamical Systems · Mathematics 2017-07-20 Jairo Bochi , Christian Bonatti , Katrin Gelfert

Herein, a methodology is developed to replicate functions, measures and stochastic processes onto a compact metric space. Many results are easily established for the replica objects and then transferred back to the original ones. Two…

Probability · Mathematics 2020-11-03 Chi Dong , Michael A. Kouritzin

In the paper we prove the existence of probabilistic solutions to systems of the form $-Au=F(x,u)+\mu$, where $F$ satisfies a generalized sign condition and $\mu$ is a smooth measure. As for $A$ we assume that it is a generator of a Markov…

Analysis of PDEs · Mathematics 2016-11-04 Tomasz Klimsiak

We study the rate of decay of correlations for equilibrium states associated to a robust class of non-uniformly expanding maps where no Markov assumption is required. We show that the Ruelle-Perron-Frobenius operator acting on the space of…

Dynamical Systems · Mathematics 2015-06-05 Armando Castro , Paulo Varandas

For $C^1$ diffeomorphisms, we prove that the Pesin's entropy formula holds for some invariant measure supported on any topological attractor that admits a dominated splitting without mixed behavior. We also prove Shub's entropy conjecture…

Dynamical Systems · Mathematics 2015-12-31 Dawei Yang , Yongluo Cao

In this paper, we investigate the limiting absorption principle associated to and the well-posedness of the Helmholtz equations with sign changing coefficients which are used to model negative index materials. Using the reflecting technique…

Analysis of PDEs · Mathematics 2015-11-26 Hoai-Minh Nguyen

Over the last years, minimization problems over spaces of measures have received increased interest due to their relevance in the context of inverse problems, optimal control and machine learning. A fundamental role in their numerical…

Optimization and Control · Mathematics 2024-03-19 Gerd Wachsmuth , Daniel Walter

This article develops a general framework for Laplace duality between positive Markov processes in which the one-dimensional Laplace transform of one process can be represented through that of another. We show that a process admits a…

Probability · Mathematics 2026-04-14 Clément Foucart , Matija Vidmar

Occupied diffusions offer a Markovian framework for path-dependent dynamics by lifting the state space with a flow of occupation measures. Because this additional feature is infinite-dimensional, the simulation of these processes remains…

Numerical Analysis · Mathematics 2026-04-29 Valentin Tissot-Daguette , Xin Zhang

The notion of a successful coupling of Markov processes, based on the idea that both components of the coupled system ``intersect'' in finite time with probability one, is extended to cover situations when the coupling is unnecessarily…

Probability · Mathematics 2007-05-23 Michael Blank , Sergey Pirogov

We present a sufficient condition for a non-injective function of a Markov chain to be a second-order Markov chain with the same entropy rate as the original chain. This permits an information-preserving state space reduction by merging…

Information Theory · Computer Science 2013-12-20 Bernhard C. Geiger , Christoph Temmel

In this paper, we prove first that the iterates of a mean nonexpansive map defined on a weakly compact, convex set converge weakly to a fixed point in the presence of Opial's property and asymptotic regularity at a point. Next, we prove the…

Functional Analysis · Mathematics 2016-11-30 Torrey M. Gallagher

We introduce four, a priori different, notions of topological pressure for possibly discontinuous semiflows acting on compact metric spaces and observe that they all agree with the classical one when restricted to the continuous setting.…

Dynamical Systems · Mathematics 2023-02-27 Lucas Backes , Fagner B. Rodrigues

The rigidity of the spacetime positive mass theorem states that an initial data set $(M,g,k)$ satisfying the dominant energy condition with vanishing mass can be isometrically embedded into Minkowski space. This has been established by…

Differential Geometry · Mathematics 2022-08-05 Sven Hirsch , Yiyue Zhang

In this work, we study the dynamics of a spatially heterogeneous single population model with the memory effect and nonlinear boundary condition. By virtue of the implicit function theorem and Lyapunov-Schmidt reduction, spatially…

Dynamical Systems · Mathematics 2024-03-25 Quanli Ji , Ranchao Wu , Tonghua Zhang

It is common, when dealing with quantum processes involving a subsystem of a much larger composite closed system, to treat them as effectively memory-less (Markovian). While open systems theory tells us that non-Markovian processes should…

Quantum Physics · Physics 2019-05-02 Pedro Figueroa-Romero , Kavan Modi , Felix A. Pollock

Let S be an ergodic measure-preserving automorphism on a non-atomic probability space, and let T be the time-one map of a topologically weak mixing suspension flow over an irreducible subshift of finite type under a Holder ceiling function.…

Dynamical Systems · Mathematics 2012-08-20 Anthony Quas , Terry Soo
‹ Prev 1 8 9 10 Next ›