English
Related papers

Related papers: Memory Through a Hidden Martingale Process in Prog…

200 papers

An autoregressive process with Markov regime is an autoregressive process for which the regression function at each time point is given by a nonobservable Markov chain. In this paper we consider the asymptotic properties of the maximum…

Statistics Theory · Mathematics 2007-06-13 Randal Douc , Eric Moulines , Tobias Ryden

Even simply-defined, finite-state generators produce stochastic processes that require tracking an uncountable infinity of probabilistic features for optimal prediction. For processes generated by hidden Markov chains the consequences are…

Statistical Mechanics · Physics 2021-09-15 Alexandra M. Jurgens , James P. Crutchfield

Quantum property preservation (QPP) is the problem of maintaining a target property of a quantum system for as long as possible. This problem arises naturally in the context of open quantum systems subject to decoherence. Here, we develop a…

Quantum Physics · Physics 2025-02-28 Kumar Saurav , Daniel A. Lidar

Variational quantum algorithms (VQAs) have emerged as the leading strategy to obtain quantum advantage on the current noisy intermediate-scale devices. However, their entanglement-trainability correlation, as the major reason for the barren…

Quantum Physics · Physics 2025-05-07 Shikun Zhang , Yang Zhou , Zheng Qin , Rui Li , Chunxiao Du , Zhisong Xiao , Yongyou Zhang

We present sufficient conditions, in terms of the jumping kernels, for two large classes of conservative Markov processes of pure-jump type to be purely discontinuous martingales with finite second moment. As an application, we establish…

Probability · Mathematics 2020-09-01 Yuichi Shiozawa , Jian Wang

In stochastic modeling, the excess entropy -- the mutual information shared between a process's past and future -- represents the fundamental lower bound of the memory needed to simulate its dynamics. However, this bound cannot be saturated…

Quantum Physics · Physics 2026-02-27 Kelvin Onggadinata , Andrew Tanggara , Mile Gu , Dagomir Kaszlikowski

We introduce a new method for internal replay that modulates the frequency of rehearsal based on the depth of the network. While replay strategies mitigate the effects of catastrophic forgetting in neural networks, recent works on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Stanisław Pawlak , Filip Szatkowski , Michał Bortkiewicz , Jan Dubiński , Tomasz Trzciński

This paper investigates a stochastic parabolic system under Robin boundary conditions, for which the deterministic counterpart exhibits finite quenching. The stochastic system incorporates mixed noise, combining standard one-dimensional…

Probability · Mathematics 2025-08-06 Nikos I. Kavallaris , Christos V. Nikolopoulos , Subramani Sankar

Stochastic chains represent a wide and key variety of phenomena in many branches of science within the context of Information Theory and Thermodynamics. They are typically approached by a sequence of independent events or by a memoryless…

Statistical Mechanics · Physics 2017-03-06 J. Ricardo Arias-Gonzalez

The paper is devoted to the study of the asymptotic behaviour of Moran process in random environment, say random selection. In finite population, the Moran process may be degenerate in finite time, thus we will study its limiting process in…

Probability · Mathematics 2019-11-05 Arnaud Guillin , Arnaud Personne , Edouard Strickler

The balance between exploration and exploitation is a key problem for reinforcement learning methods, especially for Q-learning. In this paper, a fidelity-based probabilistic Q-learning (FPQL) approach is presented to naturally solve this…

Machine Learning · Computer Science 2018-06-11 Chunlin Chen , Daoyi Dong , Han-Xiong Li , Jian Chu , Tzyh-Jong Tarn

This paper introduces a martingale that characterizes two properties of evolving forecast distributions. Ideal forecasts of a future event behave as martingales, sequen- tially updating the forecast to leverage the available information as…

Machine Learning · Computer Science 2021-05-17 Dean P. Foster , Robert A. Stine

Continual learning, the ability of a model to adapt to an ongoing sequence of tasks without forgetting earlier ones, is a central goal of artificial intelligence. To better understand its underlying mechanisms, we study the limitations of…

Machine Learning · Statistics 2026-04-21 Hossein Taheri , Avishek Ghosh , Arya Mazumdar

Neural-network quantum states (NQS) offer a versatile and expressive alternative to traditional variational ans\"atze for simulating physical systems. Energy-based frameworks, like Hopfield networks and Restricted Boltzmann Machines,…

Quantum Physics · Physics 2024-12-18 Manas Sajjan , Vinit Singh , Sabre Kais

The evolution of a quantum oscillator, with periodically varying frequency and damping, is studied in the two cases of parametric resonance (PR) producing a limited, or unlimited stretching of the wave function. The different asymptotic…

Quantum Physics · Physics 2019-03-15 Loris Ferrari

The main problem about replacing LTP as a memory mechanism has been to find other highly abstract, easily understandable principles for induced plasticity. In this paper we attempt to lay out such a basic mechanism, namely intrinsic…

Neurons and Cognition · Quantitative Biology 2014-05-13 Gabriele Scheler

The compressive learning framework reduces the computational cost of training on large-scale datasets. In a sketching phase, the data is first compressed to a lightweight sketch vector, obtained by mapping the data samples through a…

Machine Learning · Statistics 2022-04-20 Vincent Schellekens , Laurent Jacques

We consider the problem of predictive monitoring (PM), i.e., predicting at runtime the satisfaction of a desired property from the current system's state. Due to its relevance for runtime safety assurance and online control, PM methods need…

Systems and Control · Electrical Eng. & Systems 2023-04-07 Francesca Cairoli , Nicola Paoletti , Luca Bortolussi

Determinantal process is a dynamical extension of a determinantal point process such that any spatio-temporal correlation function is given by a determinant specified by a single continuous function called the correlation kernel.…

Probability · Mathematics 2013-07-10 Makoto Katori

Quantile estimation and regression within the Bayesian framework is challenging as the choice of likelihood and prior is not obvious. In this paper, we introduce a novel Bayesian nonparametric method for quantile estimation and regression…

Methodology · Statistics 2026-02-16 Edwin Fong , Andrew Yiu