English
Related papers

Related papers: Collapsed Amortized Variational Inference for Swit…

200 papers

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

Machine Learning · Computer Science 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

While the identification of nonlinear dynamical systems is a fundamental building block of model-based reinforcement learning and feedback control, its sample complexity is only understood for systems that either have discrete states and…

Machine Learning · Statistics 2020-06-19 Horia Mania , Michael I. Jordan , Benjamin Recht

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequential data setting.…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

This paper is concerned with the estimation of time-varying networks for high-dimensional nonstationary time series. Two types of dynamic behaviors are considered: structural breaks (i.e., abrupt change points) and smooth changes. To…

Statistics Theory · Mathematics 2020-02-19 Mengyu Xu , Xiaohui Chen , Wei Biao Wu

Though action recognition in videos has achieved great success recently, it remains a challenging task due to the massive computational cost. Designing lightweight networks is a possible solution, but it may degrade the recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Wenhao Wu , Dongliang He , Xiao Tan , Shifeng Chen , Yi Yang , Shilei Wen

This paper presents a shape-theoretic framework for dynamical analysis of nonlinear dynamical systems which appear frequently in several video-based inference tasks. Traditional approaches to dynamical modeling have included linear and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Vinay Venkataraman , Pavan Turaga

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

Modeling the temporal behavior of data is of primordial importance in many scientific and engineering fields. Baseline methods assume that both the dynamic and observation equations follow linear-Gaussian models. However, there are many…

Machine Learning · Computer Science 2020-11-03 Xavier Alameda-Pineda , Vincent Drouard , Radu Horaud

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Markov models, in a…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

We propose a simple method to learn linear causal cyclic models in the presence of latent variables. The method relies on equilibrium data of the model recorded under a specific kind of interventions ("shift interventions"). The location…

Methodology · Statistics 2016-01-11 Dominik Rothenhäusler , Christina Heinze , Jonas Peters , Nicolai Meinshausen

We propose a novel approach for change-point detection and parameter learning in multivariate non-stationary time series exhibiting oscillatory behaviour. We approximate the process through a piecewise function defined by a sum of…

Methodology · Statistics 2026-02-02 Nicolas Bianco , Lorenzo Cappello

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a…

Machine Learning · Computer Science 2023-10-02 Kevin Roy , Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

This work aims to improve generalization and interpretability of dynamical systems by recovering the underlying lower-dimensional latent states and their time evolutions. Previous work on disentangled representation learning within the…

Machine Learning · Computer Science 2024-06-07 Çağlar Hızlı , Çağatay Yıldız , Matthias Bethge , ST John , Pekka Marttinen

We focus on variational inference in dynamical systems where the discrete time transition function (or evolution rule) is modelled by a Gaussian process. The dominant approach so far has been to use a factorised posterior distribution,…

Machine Learning · Statistics 2018-12-17 Alessandro Davide Ialongo , Mark van der Wilk , James Hensman , Carl Edward Rasmussen

We present a general framework for classifying partially observed dynamical systems based on the idea of learning in the model space. In contrast to the existing approaches using model point estimates to represent individual data items, we…

Machine Learning · Statistics 2017-04-19 Yuan Shen , Peter Tino , Krasimira Tsaneva-Atanasova

We propose a recurrent neural network for a "model-free" simulation of a dynamical system with unknown parameters without prior knowledge. The deep learning model aims to jointly learn the nonlinear time marching operator and the effects of…

Machine Learning · Computer Science 2021-03-01 Kyongmin Yeo , Dylan E. C. Grullon , Fan-Keng Sun , Duane S. Boning , Jayant R. Kalagnanam

The paper algorithmizes the problem of regime change point identification for data measured in a system exhibiting impulsive behaviors. This is a fundamental challenge for annotation of measurement data relevant, e.g., for designing…

‹ Prev 1 2 3 10 Next ›