English
Related papers

Related papers: Memory Functions of the Additive Markov chains: Ap…

200 papers

Conversion of temporal to spatial correlations in the cortex is one of the most intriguing functions in the brain. The learning at synapses triggering the correlation conversion can take place in a wide integration window, whose influence…

Disordered Systems and Neural Networks · Physics 2021-12-21 Zijian Jiang , Jianwen Zhou , Tianqi Hou , K. Y. Michael Wong , Haiping Huang

We augment recurrent neural networks with an external memory mechanism that builds upon recent progress in metalearning. We conceptualize this memory as a rapidly adaptable function that we parameterize as a deep neural network. Reading…

Neural and Evolutionary Computing · Computer Science 2019-12-04 Tsendsuren Munkhdalai , Alessandro Sordoni , Tong Wang , Adam Trischler

Networks with memristive elements (resistors with memory) are being explored for a variety of applications ranging from unconventional computing to models of the brain. However, analytical results that highlight the role of the graph…

Disordered Systems and Neural Networks · Physics 2017-03-08 Francesco Caravelli , Fabio Lorenzo Traversa , Massimiliano Di Ventra

From ancient philosophers to modern economists, biologists, and other researchers, there has been a continuous effort to unveil causal relations. The most formidable challenge lies in deducing the nature of the causal relationship: whether…

A scheme is presented to extract detailed dynamical signatures from successive measurements of complex systems. Relative entropy based time series tools are used to quantify the gain in predictive power of increasing past knowledge. By…

Data Analysis, Statistics and Probability · Physics 2008-12-31 Nick S. Jones

We study the performance of a stochastic algorithm based on the power method that adaptively learns the large deviation functions characterizing the fluctuations of additive functionals of Markov processes, used in physics to model…

Statistical Mechanics · Physics 2023-03-30 Francesco Coghi , Hugo Touchette

Memory effects in time-series of experimental observables are ubiquitous, have important cosequences for the interpretation of kinetic data, and may even affect the function of biomolecular nanomachines such as enzymes. Here we propose a…

Statistical Mechanics · Physics 2021-06-02 Alessio Lapolla , Aljaž Godec

Understanding the binding dynamics of liquid molecules is of fundamental importance in physical and life sciences. However, nanoscale fast dynamics pose great challenges for experimental characterization. Conventionally, the binding…

Chemical Physics · Physics 2024-10-28 Shiyi Qin , Zhi Yang , Huimin Liu , Xiaoli Wang , Shangguo Hou , Kai Huang

We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to…

Neural and Evolutionary Computing · Computer Science 2016-05-20 Ivo Danihelka , Greg Wayne , Benigno Uria , Nal Kalchbrenner , Alex Graves

The generalized Langevin equation is a model for the motion of coarse-grained particles where dissipative forces are represented by a memory term. The numerical realization of such a model requires the implementation of a stochastic…

Soft Condensed Matter · Physics 2021-05-26 Niklas Bockius , Jeanine Shea , Gerhard Jung , Friederike Schmid , Martin Hanke

We propose a new method to generate a sequence of random numbers with long-range power-law correlations that overcomes known difficulties associated with large systems. The new method presents an improvement on the commonly-used methods. We…

Condensed Matter · Physics 2009-10-28 Hernán A. Makse , Shlomo Havlin , Moshe Schwartz , H. Eugene Stanley

In the paper, the law of the iterated logarithm for additive functionals of Markov chains is obtained under some weak conditions, which are weaker than the conditions of invariance principle of additive functionals of Markov chains in M.…

Probability · Mathematics 2007-05-23 Yu Miao , Guangyu Yang

In this note we re-visit the fundamental question of the strong law of large numbers and central limit theorem for processes in continuous time with conditional stationary and independent increments. For convenience we refer to them as…

Probability · Mathematics 2026-02-05 Andreas E. Kyprianou , Victor Rivero

Based on a model first studied in [Physical Review A, vol. 43, 5240-5260,1991] properties of correlation function for expansion-modification systems are developed. The existence of several characteristic exponents is proved. The…

chao-dyn · Physics 2016-08-31 R. Mansilla , G. Cocho

Causal relationships play a fundamental role in understanding the world around us. The ability to identify and understand cause-effect relationships is critical to making informed decisions, predicting outcomes, and developing effective…

Statistical Mechanics · Physics 2025-09-10 Sergio Chibbaro , Cyril Furtlehner , Théo Marchetta , Andrei-Tiberiu Pantea , Davide Rossetti

We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these…

Probability · Mathematics 2012-10-11 Fangjun Xu

We present a memory-augmented approach to condition an autoregressive language model on a knowledge graph. We represent the graph as a collection of relation triples and retrieve relevant relations for a given context to improve text…

Computation and Language · Computer Science 2022-01-25 Qi Liu , Dani Yogatama , Phil Blunsom

Earlier we proposed the stochastic point process model, which reproduces a variety of self-affine time series exhibiting power spectral density S(f) scaling as power of the frequency f and derived a stochastic differential equation with the…

Physics and Society · Physics 2008-12-02 V. Gontis , B. Kaulakys

Given a sequence of i.i.d. random functions $\Psi_{n}:\mathbb{R}\to\mathbb{R}$, $n\in\mathbb{N}$, we consider the iterated function system and Markov chain which is recursively defined by $X_{0}^{x}:=x$ and…

Probability · Mathematics 2021-10-07 Gerold Alsmeyer , Sara Brofferio , Dariusz Buraczewski

Lack of memory (locality in time) is a major limitation of almost all present time-dependent density functional approximations. By using semiclassical dynamics to compute correlation effects within a density-matrix functional approach, we…

Chemical Physics · Physics 2015-05-18 A. K. Rajam , I. Raczkowska , N. T. Maitra