English
Related papers

Related papers: Interpretable Latent Variables in Deep State Space…

200 papers

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

Probabilistic time series forecasting involves estimating the distribution of future based on its history, which is essential for risk management in downstream decision-making. We propose a deep state space model for probabilistic time…

Machine Learning · Computer Science 2021-02-02 Longyuan Li , Junchi Yan , Xiaokang Yang , Yaohui Jin

Time series analysis by state-space models is widely used in forecasting and extracting unobservable components like level, slope, and seasonality, along with explanatory variables. However, their reliance on traditional Kalman filtering…

Machine Learning · Statistics 2024-08-20 André Ramos , Davi Valladão , Alexandre Street

Latent space models (LSMs) are often used to analyze dynamic (time-varying) networks that evolve in continuous time. Existing approaches to Bayesian inference for these models rely on Markov chain Monte Carlo algorithms, which cannot handle…

Methodology · Statistics 2024-01-19 Joshua Daniel Loyal

Multivariate time series (MTS) forecasting is crucial for decision-making in domains such as weather, energy, and finance. It remains challenging because real-world sequences intertwine slow trends, multi-rate seasonalities, and irregular…

Machine Learning · Computer Science 2026-02-06 Shunya Nagashima , Shuntaro Suzuki , Shuitsu Koyama , Shinnosuke Hirano

The field of Text-to-Speech has experienced huge improvements last years benefiting from deep learning techniques. Producing realistic speech becomes possible now. As a consequence, the research on the control of the expressiveness,…

Computation and Language · Computer Science 2019-03-28 Noé Tits , Fengna Wang , Kevin El Haddad , Vincent Pagel , Thierry Dutoit

Capturing interpretable variations has long been one of the goals in disentanglement learning. However, unlike the independence assumption, interpretability has rarely been exploited to encourage disentanglement in the unsupervised setting.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Xinqi Zhu , Chang Xu , Dacheng Tao

In this paper, we propose multi-variable LSTM capable of accurate forecasting and variable importance interpretation for time series with exogenous variables. Current attention mechanism in recurrent neural networks mostly focuses on the…

Machine Learning · Computer Science 2018-06-19 Tian Guo , Tao Lin

Rapid progress in machine learning and deep learning has enabled a wide range of applications in the electricity load forecasting of power systems, for instance, univariate and multivariate short-term load forecasting. Though the strong…

Machine Learning · Computer Science 2024-02-20 Yuqi Jiang , Yan Li , Yize Chen

State-space models (SSMs) are a popular tool for modeling animal abundances. Inference difficulties for simple linear SSMs are well known, particularly in relation to simultaneous estimation of process and observation variances. Several…

Populations and Evolution · Quantitative Biology 2019-09-20 Leo Polansky , Ken B. Newman , Lara Mitchell

Latent variable models are powerful statistical tools that can uncover relevant variation between patients or cells, by inferring unobserved hidden states from observable high-dimensional data. A major shortcoming of current methods,…

Machine Learning · Statistics 2022-04-12 Arber Qoku , Florian Buettner

Deep state-space models (Deep SSMs) are becoming popular as effective approaches to model sequence data. They have also been shown to be capable of in-context learning, much like transformers. However, a complete picture of how SSMs might…

Machine Learning · Computer Science 2025-02-19 Neeraj Mohan Sushma , Yudou Tian , Harshvardhan Mestha , Nicolo Colombo , David Kappel , Anand Subramoney

Learning accurate predictive models of real-world dynamic phenomena (e.g., climate, biological) remains a challenging task. One key issue is that the data generated by both natural and artificial processes often comprise time series that…

Machine Learning · Computer Science 2023-06-21 Abdul Fatir Ansari , Alvin Heng , Andre Lim , Harold Soh

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-10-04 Viktoriya Krakovna , Finale Doshi-Velez

Deep learning has achieved strong performance in Time Series Forecasting (TSF). However, we identify a critical representation paradox, termed Latent Chaos: models with accurate predictions often learn latent representations that are…

Machine Learning · Computer Science 2026-05-13 Jie Yang , Yifan Hu , Yuante Li , Kexin Zhang , Kaize Ding , Philip S. Yu

Deep Metric Learning (DML) approaches learn to represent inputs to a lower-dimensional latent space such that the distance between representations in this space corresponds with a predefined notion of similarity. This paper investigates how…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Niall O' Mahony , Sean Campbell , Anderson Carvalho , Lenka Krpalkova , Gustavo Velasco-Hernandez , Daniel Riordan , Joseph Walsh

Deep learning models have significantly improved the visual quality and accuracy on compressive sensing recovery. In this paper, we propose an algorithm for signal reconstruction from compressed measurements with image priors captured by a…

Machine Learning · Computer Science 2020-03-20 Shaojie Xu , Sihan Zeng , Justin Romberg

Extracting the true dynamical variables of a system from high-dimensional video is challenging due to distracting visual factors such as background motion, occlusions, and texture changes. We propose LyTimeT, a two-phase framework for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Kuai Yu , Crystal Su , Xiang Liu , Judah Goldfeder , Mingyuan Shao , Hod Lipson

Disentangled latent spaces usually have better semantic separability and geometrical properties, which leads to better interpretability and more controllable data generation. While this has been well investigated in Computer Vision, in…

Computation and Language · Computer Science 2024-06-12 Yingji Zhang , Danilo S. Carvalho , André Freitas

Although considerable effort has been dedicated to improving the solution to the hyperspectral unmixing problem, non-idealities such as complex radiation scattering and endmember variability negatively impact the performance of most…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Ricardo Augusto Borsoi , Deniz Erdoğmuş , Tales Imbiriba