English
Related papers

Related papers: Memory Through a Hidden Martingale Process in Prog…

200 papers

We study a Q learning algorithm for continuous time stochastic control problems. The proposed algorithm uses the sampled state process by discretizing the state and control action spaces under piece-wise constant control processes. We show…

Optimization and Control · Mathematics 2023-03-10 Erhan Bayraktar , Ali Devran Kara

In this review we discuss the persistence and the related first-passage properties in extended many-body nonequilibrium systems. Starting with simple systems with one or few degrees of freedom, such as random walk and random acceleration…

Statistical Mechanics · Physics 2013-06-26 Alan J. Bray , Satya N. Majumdar , G. Schehr

It is shown that due to memory effects the complex behaviour of components in a stochastic system can be transmitted to macroscopic evolution of the system as a whole. Within the Markov approximation widely using in ordinary statistical…

adap-org · Physics 2009-10-30 A. A. Stanislavsky

In this dissertation, we show that the Central Limit Theorem and the Invariance Principle for Discrete Fourier Transforms discovered by Peligrad and Wu can be extended to the quenched setting. We show that the random normalization…

Probability · Mathematics 2016-05-25 David Barrera

In the paper we consider some piecewise deterministic Markov process whose continuous component evolves according to semiflows, which are switched at the jump times of a Poisson process. The associated Markov chain describes the states of…

Probability · Mathematics 2023-10-06 Dawid Czapla , Sander C. Hille , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

The use of target networks is a common practice in deep reinforcement learning for stabilizing the training; however, theoretical understanding of this technique is still limited. In this paper, we study the so-called periodic Q-learning…

Machine Learning · Computer Science 2020-02-25 Donghwan Lee , Niao He

Quantum machine learning is a rapidly advancing discipline that leverages the features of quantum mechanics to enhance the performance of computational tasks. Quantum reservoir processing, which allows efficient optimization of a single…

Motion camouflage is a stealth strategy observed in nature. We formulate the problem as a feedback system for particles moving at constant speed, and define what it means for the system to be in a state of motion camouflage. (Here we focus…

Optimization and Control · Mathematics 2009-11-11 E. W. Justh , P. S. Krishnaprasad

Feedback uses past detection outcomes to dynamically modify a quantum system and is central to quantum control. These outcomes can be stored in a memory, defined as a stochastic function of past measurements. In this work, we investigate…

Quantum Physics · Physics 2025-12-10 Alberto J. B. Rosal , Patrick P. Potts , Gabriel T. Landi

We consider a repeated Stackelberg game setup where the leader faces a sequence of followers of unknown types and must learn what commitments to make. While previous works have considered followers that best respond to the commitment…

Computer Science and Game Theory · Computer Science 2024-12-10 Vijeth Hebbar , Cédric Langbort

In this paper, we introduce a class of processes that contains many natural examples. The interesting feature of such type processes lays on its infinite memory that allows it to record a quite ancient history. Then, using the martingale…

Probability · Mathematics 2025-03-04 Paul Doukhan , Xiequan Fan

A growing body of work has established the modelling of stochastic processes as a promising area of application for quantum techologies; it has been shown that quantum models are able to replicate the future statistics of a stochastic…

Quantum Physics · Physics 2020-03-25 Matthew Ho , Mile Gu , Thomas J. Elliott

We develop a fundamental framework for the quantum mechanics of stochastic systems (QMSS), showing that classical discrete stochastic processes emerge naturally as perturbations of the quantum harmonic oscillator (QHO). By constructing…

Quantum Physics · Physics 2025-10-30 Yurang , Kuang

Scrambling quantum systems have attracted attention as effective substrates for temporal information processing. Here we consider a quantum reservoir processing framework that captures a broad range of physical computing models with quantum…

We develop techniques to analyse the statistics of completion times of non-deterministic elements in quantum entanglement generation, and how they affect the overall performance as measured by the secret key rate. By considering such…

Quantum Physics · Physics 2019-04-10 Scott E. Vinay , Pieter Kok

Statistical procedures rarely retain all features of the observed data. A sufficient statistic removes information irrelevant to a parameter; a maximum likelihood estimate compresses an empirical objective into an optimizing point; and a…

Methodology · Statistics 2026-05-27 Yuan-chin Ivan Chang

The continuous time stochastic process is a mainstream mathematical instrument modeling the random world with a wide range of applications involving finance, statistics, physics, and time series analysis, while the simulation and analysis…

Quantum Physics · Physics 2023-10-04 Xi-Ning Zhuang , Zhao-Yun Chen , Cheng Xue , Yu-Chun Wu , Guo-Ping Guo

Given a growth rule which sequentially constructs random permutations of increasing degree, the stochastic process version of the rencontre problem asks what is the limiting proportion of time that the permutation has no fixed points…

Probability · Mathematics 2022-09-27 Alexander Gnedin , Dudley Stark

We investigate stochastic resetting in coupled systems involving two degrees of freedom, where only one variable is reset. The resetting variable, which we think of as hidden, indirectly affects the remaining observable variable through…

Statistical Mechanics · Physics 2024-04-03 Kristian Stølevik Olsen , Hartmut Löwen

Stochastic processes with random reinforced relocations have been introduced in the physics literature to model animal foraging behaviour. Such a process evolves as a Markov process, except at random relocation times, when it chooses a time…

Probability · Mathematics 2023-07-12 Erion-Stelios Boci , Cécile Mailler