English
Related papers

Related papers: Modelling multivariate spatio-temporal data with i…

200 papers

We present a method for learning latent stochastic differential equations (SDEs) from high-dimensional time series data. Given a high-dimensional time series generated from a lower dimensional latent unknown It\^o process, the proposed…

Machine Learning · Statistics 2021-11-30 Ali Hasan , João M. Pereira , Sina Farsiu , Vahid Tarokh

We present a data-driven method for separating complex, multiscale systems into their constituent time-scale components using a recursive implementation of dynamic mode decomposition (DMD). Local linear models are built from windowed…

Systems and Control · Computer Science 2019-06-26 Daniel Dylewsky , Molei Tao , J. Nathan Kutz

We propose a new solution to the blind source separation problem that factors mixed time-series signals into a sum of spatiotemporal modes, with the constraint that the temporal components are intrinsic mode functions (IMF's). The key…

Numerical Analysis · Mathematics 2018-06-25 Seth M. Hirsh , Bingni W. Brunton , J. Nathan Kutz

We assume a second-order source separation model where the observed multivariate time series is a linear mixture of latent, temporally uncorrelated time series with some components pure white noise. To avoid the modelling of noise, we…

Methodology · Statistics 2019-05-07 Markus Matilainen , Klaus Nordhausen , Joni Virta

Time series sequence prediction and modelling has proven to be a challenging endeavor in real world datasets. Two key issues are the multi-dimensionality of data and the interaction of independent dimensions forming a latent output signal,…

Machine Learning · Computer Science 2020-10-09 Jakob Aungiers

Autoencoders exhibit impressive abilities to embed the data manifold into a low-dimensional latent space, making them a staple of representation learning methods. However, without explicit supervision, which is often unavailable, the…

Machine Learning · Computer Science 2023-01-12 Felix Leeb , Stefan Bauer , Michel Besserve , Bernhard Schölkopf

In many scientific problems such as video surveillance, modern genomics, and finance, data are often collected from diverse measurements across time that exhibit time-dependent heterogeneous properties. Thus, it is important to not only…

Machine Learning · Statistics 2022-10-10 Lin Qiu , Vernon M. Chinchilli , Lin Lin

Discrete latent spaces in variational autoencoders have been shown to effectively capture the data distribution for many real-world problems such as natural language understanding, human intent prediction, and visual scene representation.…

Machine Learning · Computer Science 2021-01-19 Masha Itkina , Boris Ivanovic , Ransalu Senanayake , Mykel J. Kochenderfer , Marco Pavone

The task of blind source separation (BSS) involves separating sources from a mixture without prior knowledge of the sources or the mixing system. Single-channel mixtures and non-linear mixtures are a particularly challenging problem in BSS.…

Signal Processing · Electrical Eng. & Systems 2025-07-24 Matthew B. Webster , Joonnyong Lee

A crucial assumption to reduce computational complexity in spatial-temporal data analysis is separability, which factors the covariance structure into a purely spatial and a purely temporal component. In this paper, we develop statistical…

Statistics Theory · Mathematics 2026-03-30 Lujia Bai , Holger Dette , Zihao Yuan

We aim to separate the generative factors of data into two latent vectors in a variational autoencoder. One vector captures class factors relevant to target classification tasks, while the other vector captures style factors relevant to the…

Machine Learning · Computer Science 2020-03-17 Bo-Kyeong Kim , Sungjin Park , Geonmin Kim , Soo-Young Lee

In this paper, we propose a latent-variable generative model called mixture of dynamical variational autoencoders (MixDVAE) to model the dynamics of a system composed of multiple moving sources. A DVAE model is pre-trained on a…

Machine Learning · Computer Science 2023-12-08 Xiaoyu Lin , Laurent Girin , Xavier Alameda-Pineda

A core problem in machine learning is to learn expressive latent variables for model prediction on complex data that involves multiple sub-components in a flexible and interpretable fashion. Here, we develop an approach that improves…

Machine Learning · Computer Science 2024-02-13 Yi-Lin Tuan , Zih-Yun Chiu , William Yang Wang

This article addresses the modeling of reverberant recording environments in the context of under-determined convolutive blind source separation. We model the contribution of each source to all mixture channels in the time-frequency domain…

Machine Learning · Statistics 2009-12-14 Ngoc Duong , Emmanuel Vincent , Remi Gribonval

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

Experimental data is often affected by uncontrolled variables that make analysis and interpretation difficult. For spatiotemporal systems, this problem is further exacerbated by their intricate dynamics. Modern machine learning methods are…

Computational Physics · Physics 2020-09-16 Peter Y. Lu , Samuel Kim , Marin Soljačić

The blind source separation model for multivariate time series generally assumes that the observed series is a linear transformation of an unobserved series with temporally uncorrelated or independent components. Given the observations, the…

Statistics Theory · Mathematics 2017-09-04 Joni Virta , Klaus Nordhausen

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

Blind source separation (BSS) techniques aims at joint estimation of source signals and a mixing matrix from observations of mixtures. This paper addresses a doubly nonstationary BSS problem, where the mixing matrix is time dependent and…

Signal Processing · Electrical Eng. & Systems 2019-06-25 Adrien Meynard

Many applications, such as text modelling, high-throughput sequencing, and recommender systems, require analysing sparse, high-dimensional, and overdispersed discrete (count-valued or binary) data. Although probabilistic matrix…

Machine Learning · Computer Science 2019-05-27 He Zhao , Piyush Rai , Lan Du , Wray Buntine , Mingyuan Zhou