English
Related papers

Related papers: Maximum Likelihood Learning of Latent Dynamics Wit…

200 papers

We propose a few-shot learning method for spatial regression. Although Gaussian processes (GPs) have been successfully used for spatial regression, they require many observations in the target task to achieve a high predictive performance.…

Machine Learning · Statistics 2020-10-12 Tomoharu Iwata , Yusuke Tanaka

We propose a deep generative Markov State Model (DeepGenMSM) learning framework for inference of metastable dynamical systems and prediction of trajectories. After unsupervised training on time series data, the model contains (i) a…

Machine Learning · Statistics 2019-01-14 Hao Wu , Andreas Mardt , Luca Pasquali , Frank Noe

We introduce the truncated Gaussian graphical model (TGGM) as a novel framework for designing statistical models for nonlinear learning. A TGGM is a Gaussian graphical model (GGM) with a subset of variables truncated to be nonnegative. The…

Machine Learning · Statistics 2016-11-22 Qinliang Su , Xuejun Liao , Changyou Chen , Lawrence Carin

In this paper, we introduce a new directed graphical model from Gaussian data: the Gaussian graphical interaction model (GGIM). The development of this model comes from considering stationary Gaussian processes on graphs, and leveraging the…

Machine Learning · Computer Science 2020-11-19 Katherine Fitch

State space models are well-known for their versatility in modeling dynamic systems that arise in various scientific disciplines. Although parametric state space models are well studied, nonparametric approaches are much less explored in…

Methodology · Statistics 2015-07-23 Satyaki Mazumder , Sourabh Bhattacharya

We report an exact likelihood computation for Linear Gaussian Markov processes that is more scalable than existing algorithms for complex models and sparsely sampled signals. Better scaling is achieved through elimination of repeated…

Machine Learning · Statistics 2018-05-21 Stijn de Waele

This paper introduces a new probabilistic framework for supervised learning in neural systems. It is designed to model complex, uncertain systems whose random outputs are strongly non-Gaussian given deterministic inputs. The architecture…

Machine Learning · Statistics 2025-12-12 Christian Soize

Probabilistic models such as Gaussian processes (GPs) are powerful tools to learn unknown dynamical systems from data for subsequent use in control design. While learning-based control has the potential to yield superior performance in…

Systems and Control · Electrical Eng. & Systems 2022-09-22 Alexander von Rohr , Matthias Neumann-Brosig , Sebastian Trimpe

Latent Gaussian models (LGMs) are perhaps the most commonly used class of models in statistical applications. Nevertheless, in areas ranging from longitudinal studies in biostatistics to geostatistics, it is easy to find datasets that…

Methodology · Statistics 2022-11-22 Rafael Cabral , David Bolin , Håvard Rue

Deep state-space models (Deep SSMs) are becoming popular as effective approaches to model sequence data. They have also been shown to be capable of in-context learning, much like transformers. However, a complete picture of how SSMs might…

Machine Learning · Computer Science 2025-02-19 Neeraj Mohan Sushma , Yudou Tian , Harshvardhan Mestha , Nicolo Colombo , David Kappel , Anand Subramoney

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

We introduce a unified framework, formulated as general latent space models, to study complex higher-order network interactions among multiple entities. Our framework covers several popular models in recent network analysis literature,…

Machine Learning · Computer Science 2021-07-01 Zhongyuan Lyu , Dong Xia , Yuan Zhang

Sequential modelling of high-dimensional data is an important problem that appears in many domains including model-based reinforcement learning and dynamics identification for control. Latent variable models applied to sequential data…

Machine Learning · Computer Science 2023-01-23 Oliver Limoyo , Trevor Ablett , Jonathan Kelly

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

In nonlinear latent variable models or dynamic models, if we consider the latent variables as confounders (common causes), the noise dependencies imply further relations between the observed variables. Such models are then closely related…

Machine Learning · Computer Science 2012-03-19 Kun Zhang , Bernhard Schoelkopf , Dominik Janzing

We present a novel algorithm for learning the parameters of hidden Markov models (HMMs) in a geometric setting where the observations take values in Riemannian manifolds. In particular, we elevate a recent second-order method of moments…

Machine Learning · Computer Science 2023-02-16 Berlin Chen , Cyrus Mostajeran , Salem Said

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric

Gaussian process latent variable models (GPLVM) are a flexible and non-linear approach to dimensionality reduction, extending classical Gaussian processes to an unsupervised learning context. The Bayesian incarnation of the GPLVM Titsias…

Machine Learning · Computer Science 2022-10-31 Vidhi Lalchand , Aditya Ravuri , Neil D. Lawrence

Model-based reinforcement learning refers to a set of approaches capable of sample-efficient decision making, which create an explicit model of the environment. This model can subsequently be used for learning optimal policies. In this…

Machine Learning · Computer Science 2024-11-19 Théophile Champion , Marek Grześ , Howard Bowman