English
Related papers

Related papers: The Elusive Present: Hidden Past and Future Depend…

200 papers

Markov Population Models are a widespread formalism used to model the dynamics of complex systems, with applications in Systems Biology and many other fields. The associated Markov stochastic process in continuous time is often analyzed by…

Machine Learning · Computer Science 2021-06-25 Francesca Cairoli , Ginevra Carbone , Luca Bortolussi

Behavioural and neural time series are often correlated with the past. This history-dependence may represent a fundamental property of the measured variables, or may arise from how confounding variables change over time. Here we argue that…

Neurons and Cognition · Quantitative Biology 2024-03-05 Brandon Caie , Gunnar Blohm

As a model for an on-line classification setting we consider a stochastic process $(X_{-n},Y_{-n})_{n}$, the present time-point being denoted by 0, with observables $ \ldots,X_{-n},X_{-n+1},\ldots, X_{-1}, X_0$ from which the pattern $Y_0$…

Machine Learning · Statistics 2017-07-07 Sören Christensen , Albrecht Irle , Lars Willert

This paper provides insight into when, why, and how forecast strategies fail when they are applied to complicated time series. We conjecture that the inherent complexity of real-world time-series data---which results from the dimension,…

Information Theory · Computer Science 2014-11-24 Joshua Garland , Ryan James , Elizabeth Bradley

Fitting generative models to sequential data typically involves two recursive computations through time, one forward and one backward. The latter could be a computation of the loss gradient (as in backpropagation through time), or an…

Machine Learning · Computer Science 2023-10-23 Azwar Abdulsalam , Joseph G. Makin

When is keeping a memory of observations worthwhile? We use hidden Markov models to look at phase transitions that emerge when comparing state estimates in systems with discrete states and noisy observations. We infer the underlying state…

Statistical Mechanics · Physics 2017-07-05 Emma Lathouwers , John Bechhoefer

We present a new algorithm for discovering patterns in time series and other sequential data. We exhibit a reliable procedure for building the minimal set of hidden, Markovian states that is statistically capable of producing the behavior…

Machine Learning · Computer Science 2007-05-23 Cosma Rohilla Shalizi , Kristina Lisa Shalizi , James P. Crutchfield

We address tracking and prediction of multiple moving objects in visual data streams as inference and sampling in a disentangled latent state-space model. By encoding objects separately and including explicit position information in the…

Machine Learning · Statistics 2019-10-15 Adnan Akhundov , Maximilian Soelch , Justin Bayer , Patrick van der Smagt

The probabilistic description of the time evolution of a physical system can take two conceptually distinct forms: a trajectory of probabilities, which specifies how probabilities evolve over time, and a probability on trajectories, which…

Quantum Physics · Physics 2026-03-02 Győző Egri , Marton Gomori , Balazs Gyenis , Gábor Hofer-Szabó

The study of belief change has been an active area in philosophy and AI. In recent years two special cases of belief change, belief revision and belief update, have been studied in detail. Roughly, revision treats a surprising observation…

Artificial Intelligence · Computer Science 2013-02-18 Nir Friedman , Joseph Y. Halpern

Biological systems need to react to stimuli over a broad spectrum of timescales. If and how this ability can emerge without external fine-tuning is a puzzle. We consider here this problem in discrete Markovian systems, where we can leverage…

Disordered Systems and Neural Networks · Physics 2021-08-11 Faheem Mosam , Diego Vidaurre , Eric De Giuli

We consider a pair of correlated processes {Z_n} and {S_n} (two sided), where the former is observable and the later is hidden. The uncertainty in the estimation of Z_n upon its finite past history is H(Z_n|Z_0^{n-1}), and for estimation of…

Information Theory · Computer Science 2007-07-13 Mohammad Rezaeian

Time series prediction is a widespread and well studied problem with applications in many domains (medical, geoscience, network analysis, finance, econometry etc.). In the case of multivariate time series, the key to good performances is to…

Machine Learning · Computer Science 2022-02-09 Darko Drakulic , Jean-Marc Andreoli

The investigation of the phenomenon of dephasing assisted quantum transport, which happens when the presence of dephasing benefits the efficiency of this process, has been mainly focused on Markovian scenarios associated with constant and…

Quantum Physics · Physics 2022-01-27 Saulo V. Moreira , Breno Marques , Fernando L. Semião

We observe n possibly dependent random variables, the distribution of which is presumed to be stationary even though this might not be true, and we aim at estimating the stationary distribution. We establish a non-asymptotic deviation bound…

Statistics Theory · Mathematics 2023-07-10 Alexandre Lecestre

We introduce the minimal maximally predictive models ({\epsilon}-machines) of processes generated by certain hidden semi-Markov models. Their causal states are either hybrid discrete-continuous or continuous random variables and…

Statistical Mechanics · Physics 2017-05-24 Sarah E. Marzen , James P. Crutchfield

The mixing time of a Markov chain determines how fast the iterates of the Markov chain converge to the stationary distribution; however, it does not control the dependencies between samples along the Markov chain. In this paper, we study…

Statistics Theory · Mathematics 2025-06-30 Jiaming Liang , Siddharth Mitra , Andre Wibisono

When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This can be done by considering as basic uncertainty models the so-called credal sets that…

Probability · Mathematics 2009-11-24 Gert de Cooman , Filip Hermans , Erik Quaeghebeur

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

In Bayesian persuasion, an informed sender strategically discloses information to a receiver so as to persuade them to undertake desirable actions. Recently, a growing attention has been devoted to settings in which sender and receivers…

Computer Science and Game Theory · Computer Science 2024-03-07 Francesco Bacchiocchi , Francesco Emanuele Stradi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti