English
Related papers

Related papers: Variational approach for learning Markov processes…

200 papers

Hawkes processes are often applied to model dependence and interaction phenomena in multivariate event data sets, such as neuronal spike trains, social interactions, and financial transactions. In the nonparametric setting, learning the…

Statistics Theory · Mathematics 2023-09-04 Deborah Sulem , Vincent Rivoirard , Judith Rousseau

High-dimensional time series appear in many scientific setups, demanding a nuanced approach to model and analyze the underlying dependence structure. Theoretical advancements so far often rely on stringent assumptions regarding the sparsity…

Information Theory · Computer Science 2025-03-20 Daria Tieplova , Samriddha Lahiry , Jean Barbier

In this paper we consider the problem of parameter inference for Markov jump process (MJP) representations of stochastic kinetic models. Since transition probabilities are intractable for most processes of interest yet forward simulation is…

Computation · Statistics 2014-09-16 Andrew Golightly , Darren J. Wilkinson

An efficient numerical scheme based on the scalar auxiliary variable (SAV) and marker and cell scheme (MAC) is constructed for the Navier-Stokes equations. A particular feature of the scheme is that the nonlinear term is treated explicitly…

Numerical Analysis · Mathematics 2019-09-12 Xiaoli Li , Jie Shen

Traditional partial differential equations with constant coefficients often struggle to capture abrupt changes in real-world phenomena, leading to the development of variable coefficient PDEs and Markovian switching models. Recently,…

Machine Learning · Statistics 2024-09-02 Yi Zhang , Zhikun Zhang , Xiangjun Wang

We present a time dependent variational method to learn the mechanisms of equilibrium reactive processes and efficiently evaluate their rates within a transition path ensemble. This approach builds off variational path sampling methodology…

Chemical Physics · Physics 2023-07-10 Aditya N. Singh , David T. Limmer

Koopman analysis provides a general framework from which to analyze a nonlinear dynamical system in terms of a linear operator acting on an infinite-dimensional observable space. This theoretical framework provides a rigorous underpinning…

Dynamical Systems · Mathematics 2022-10-11 Dan Wilson

For the challenging task of modeling multivariate time series, we propose a new class of models that use dependent Mat\'ern processes to capture the underlying structure of data, explain their interdependencies, and predict their unknown…

Machine Learning · Statistics 2015-02-13 Alexander Vandenberg-Rodes , Babak Shahbaba

Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient of the Kullback-Leibler divergence between data and model…

Machine Learning · Statistics 2021-12-28 Jianwen Xie , Zilong Zheng , Ping Li

A new class of Markov chain Monte Carlo (MCMC) algorithms, based on simulating piecewise deterministic Markov processes (PDMPs), have recently shown great promise: they are non-reversible, can mix better than standard MCMC algorithms, and…

Computation · Statistics 2020-10-23 Augustin Chevallier , Paul Fearnhead , Matthew Sutton

In this paper, we seek to understand the behavior of dynamical systems that are perturbed by a parameter that changes discretely in time. If we impose certain conditions, we can study certain embedded systems within a hybrid system as…

Dynamical Systems · Mathematics 2014-08-04 Xavier Garcia , Jennifer Kunze , Thomas Rudelius , Anthony Sanchez , Sijing Shao , Emily Speranza , Chad Vidden

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

Using a proper model to characterize a time series is crucial in making accurate predictions. In this work we use time-varying autoregressive process (TVAR) to describe non-stationary time series and model it as a mixture of multiple stable…

Machine Learning · Statistics 2016-11-17 Jie Ding , Mohammad Noshad , Vahid Tarokh

We propose a recurrent neural network for a "model-free" simulation of a dynamical system with unknown parameters without prior knowledge. The deep learning model aims to jointly learn the nonlinear time marching operator and the effects of…

Machine Learning · Computer Science 2021-03-01 Kyongmin Yeo , Dylan E. C. Grullon , Fan-Keng Sun , Duane S. Boning , Jayant R. Kalagnanam

We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic…

Machine Learning · Computer Science 2020-06-11 Silvan Melchior , Sebastian Curi , Felix Berkenkamp , Andreas Krause

This paper presents a data-driven approach to approximate the dynamics of a nonlinear time-varying system (NTVS) by a linear time-varying system (LTVS), which is resulted from the Koopman operator and deep neural networks. Analysis of the…

Systems and Control · Electrical Eng. & Systems 2026-03-16 Wenjian Hao , Bowen Huang , Wei Pan , Di Wu , Shaoshuai Mou

We describe spatio-temporal random processes using linear mixed models. We show how many commonly used models can be viewed as special cases of this general framework and pay close attention to models with separable or product-sum…

Methodology · Statistics 2021-06-01 Michael Dumelle , Jay M. Ver Hoef , Claudio Fuentes , Alix Gitelman

We propose a novel method for fast and scalable evaluation of periodic solutions of systems of ordinary differential equations for a given set of parameter values and initial conditions. The equations governing the system dynamics are…

Dynamical Systems · Mathematics 2016-05-30 I. Yu. Tyukin , A. N. Gorban , T. A. Tyukina , J. Al Ameri , Yu. A. Korablev

Vector approximate message passing (VAMP) is an efficient approximate inference algorithm used for generalized linear models. Although VAMP exhibits excellent performance, particularly when measurement matrices are sampled from rotationally…

Information Theory · Computer Science 2025-08-05 Takashi Takahashi , Yoshiyuki Kabashima

We discuss a general Bayesian framework on modeling multidimensional function-valued processes by using a Gaussian process or a heavy-tailed process as a prior, enabling us to handle nonseparable and/or nonstationary covariance structure.…

Methodology · Statistics 2020-07-29 Evandro Konzen , Jian Qing Shi , Zhanfeng Wang