English
Related papers

Related papers: Learning Temporal Dependence from Time-Series Data…

200 papers

We consider the problem of inferring a latent function in a probabilistic model of data. When dependencies of the latent function are specified by a Gaussian process and the data likelihood is complex, efficient computation often involve…

Machine Learning · Statistics 2018-07-23 Martin Tegner , Benjamin Bloem-Reddy , Stephen Roberts

Progressive diseases worsen over time and are characterised by monotonic change in features that track disease progression. Here we connect ideas from two formerly separate methodologies -- event-based and hidden Markov modelling -- to…

Machine Learning · Computer Science 2021-06-07 Peter A. Wijeratne , Daniel C. Alexander

Model-based reinforcement learning methods typically learn models for high-dimensional state spaces by aiming to reconstruct and predict the original observations. However, drawing inspiration from model-free reinforcement learning, we…

Machine Learning · Computer Science 2019-12-10 Aaron Havens , Yi Ouyang , Prabhat Nagarajan , Yasuhiro Fujita

Scalable probabilistic modeling and prediction in high dimensional multivariate time-series is a challenging problem, particularly for systems with hidden sources of dependence and/or homogeneity. Examples of such problems include dynamic…

Social and Information Networks · Computer Science 2016-06-07 Forough Arabshahi , Furong Huang , Animashree Anandkumar , Carter T. Butts , Sean M. Fitshugh

We illustrate a class of conditional models for the analysis of longitudinal data suffering attrition in random effects models framework, where the subject-specific random effects are assumed to be discrete and to follow a time-dependent…

Methodology · Statistics 2014-04-28 Antonello Maruotti

One of the pivotal tasks in scientific machine learning is to represent underlying dynamical systems from time series data. Many methods for such dynamics learning explicitly require the derivatives of state data, which are not directly…

Machine Learning · Computer Science 2024-04-17 Dongwei Ye , Mengwu Guo

Modern learning systems increasingly interact with data that evolve over time and depend on hidden internal state. We ask a basic question: when is such a dynamical system learnable from observations alone? This paper proposes a research…

Machine Learning · Computer Science 2025-12-23 Elad Hazan , Shai Shalev Shwartz , Nathan Srebro

The ubiquity of multiscale interactions in complex systems is well-recognized, with development and heredity serving as a prime example of how processes at different temporal scales influence one another. This work introduces a novel…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Nayely Vélez-Cruz , Manfred D. Laubichler

Events across a timeline are a common data representation, seen in different temporal modalities. Individual atomic events can occur in a certain temporal ordering to compose higher level composite events. Examples of a composite event are…

Machine Learning · Computer Science 2022-02-14 Karan Samel , Zelin Zhao , Binghong Chen , Shuang Li , Dharmashankar Subramanian , Irfan Essa , Le Song

We consider the dynamic linear regression problem, where the predictor vector may vary with time. This problem can be modeled as a linear dynamical system, with non-constant observation operator, where the parameters that need to be learned…

Machine Learning · Computer Science 2022-10-13 Mark Kozdoba , Edward Moroshko , Shie Mannor , Koby Crammer

Humans learn and form memories in stochastic environments. Auto-associative memory systems model these processes by storing patterns and later recovering them from corrupted versions. Here, memories are learned by associating each pattern…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Qin He , Jing Shuang Li

For the challenging task of modeling multivariate time series, we propose a new class of models that use dependent Mat\'ern processes to capture the underlying structure of data, explain their interdependencies, and predict their unknown…

Machine Learning · Statistics 2015-02-13 Alexander Vandenberg-Rodes , Babak Shahbaba

Humans can make predictions on various time scales and hierarchical levels. Thereby, the learning of event encodings seems to play a crucial role. In this work we model the development of hierarchical predictions via autonomously learned…

Machine Learning · Computer Science 2022-08-30 Christian Gumbsch , Maurits Adam , Birgit Elsner , Georg Martius , Martin V. Butz

Causal discovery in time series is a rapidly evolving field with a wide variety of applications in other areas such as climate science and neuroscience. Traditional approaches assume a stationary causal graph, which can be adapted to…

Machine Learning · Statistics 2024-06-26 Carles Balsells-Rodas , Yixin Wang , Pedro A. M. Mediano , Yingzhen Li

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

Differential graphical models are designed to represent the difference between the conditional dependence structures of two groups, thus are of particular interest for scientific investigation. Motivated by modern applications, this…

Statistics Theory · Mathematics 2021-02-03 Sen Na , Mladen Kolar , Oluwasanmi Koyejo

We propose a probabilistic framework for developing computational models of biological neural systems. In this framework, physiological recordings are viewed as discrete-time partial observations of an underlying continuous-time stochastic…

Neurons and Cognition · Quantitative Biology 2026-02-10 Ahmed ElGazzar , Marcel van Gerven

When modelling time series, it is common to decompose observed variation into a "signal" process, the process of interest, and "noise", representing nuisance factors that obfuscate the signal. To separate signal from noise, assumptions must…

Methodology · Statistics 2020-11-11 Richard Creswell , Ben Lambert , Chon Lok Lei , Martin Robinson , David Gavaghan

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

This paper addresses the estimation of locally stationary long-range dependent processes, a methodology that allows the statistical analysis of time series data exhibiting both nonstationarity and strong dependency. A time-varying…

Statistics Theory · Mathematics 2010-11-12 Wilfredo Palma , Ricardo Olea