English
Related papers

Related papers: Active Learning in Gaussian Process State Space Mo…

200 papers

This paper introduces a new approach for continual planning and model learning in relational, non-stationary stochastic environments. Such capabilities are essential for the deployment of sequential decision-making systems in the uncertain…

Artificial Intelligence · Computer Science 2024-07-24 Rushang Karia , Pulkit Verma , Alberto Speranzon , Siddharth Srivastava

Annotating data for supervised learning can be costly. When the annotation budget is limited, active learning can be used to select and annotate those observations that are likely to give the most gain in model performance. We propose an…

Machine Learning · Statistics 2024-08-19 Amanda Olmin , Jakob Lindqvist , Lennart Svensson , Fredrik Lindsten

State space models (SSMs) have shown remarkable empirical performance on many long sequence modeling tasks, but a theoretical understanding of these models is still lacking. In this work, we study the learning dynamics of linear SSMs to…

Machine Learning · Computer Science 2024-07-11 Jakub Smékal , Jimmy T. H. Smith , Michael Kleinman , Dan Biderman , Scott W. Linderman

Bayesian filtering is a general framework for recursively estimating the state of a dynamical system. Classical solutions such that Kalman filter and Particle filter are introduced in this report. Gaussian processes have been introduced as…

Information Theory · Computer Science 2010-11-04 Mr. Chong Han , Dr. Ido Nevat , Dr. Gareth Peters , Prof. Jinhong Yuan

High-fidelity measurements of continuum physical fields are essential for scientific discovery and engineering design but remain challenging under sparse and constrained sensing. Conventional reconstruction methods typically rely on fixed…

Machine Learning · Computer Science 2026-05-28 Huayu Deng , Jinghui Zhong , Xiangming Zhu , Yunbo Wang , Xiaokang Yang

Learning dynamics governing physical and spatiotemporal processes is a challenging problem, especially in scenarios where states are partially measured. In this work, we tackle the problem of learning dynamics governing these systems when…

Machine Learning · Computer Science 2024-12-13 Paul Ghanem , Ahmet Demirkaya , Tales Imbiriba , Alireza Ramezani , Zachary Danziger , Deniz Erdogmus

We investigate the use of derivative information for Batch Active Learning in Gaussian Process regression models. The proposed approach employs the predictive covariance matrix for selection of data batches to exploit full correlation of…

Machine Learning · Computer Science 2024-08-06 Hon Sum Alec Yu , Christoph Zimmer , Duy Nguyen-Tuong

In many real world problems, control decisions have to be made with limited information. The controller may have no a priori (or even posteriori) data on the nonlinear system, except from a limited number of points that are obtained over…

Optimization and Control · Mathematics 2011-05-12 Tansu Alpcan

In this paper, we propose a probabilistic physics-guided framework, termed Physics-guided Deep Markov Model (PgDMM). The framework targets the inference of the characteristics and latent structure of nonlinear dynamical systems from…

Machine Learning · Computer Science 2022-05-26 Wei Liu , Zhilu Lai , Kiran Bacsa , Eleni Chatzi

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

The state space (SS) representation of Gaussian processes (GP) has recently gained a lot of interest. The main reason is that it allows to compute GPs based inferences in O(n), where $n$ is the number of observations. This implementation…

Machine Learning · Computer Science 2016-01-08 Alessio Benavoli , Marco Zaffalon

Learning the continuous dynamics of a system from snapshots of its temporal marginals is a problem which appears throughout natural sciences and machine learning, including in quantum systems, single-cell biological data, and generative…

Machine Learning · Computer Science 2023-06-12 Kirill Neklyudov , Rob Brekelmans , Daniel Severo , Alireza Makhzani

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

Gaussian-process state-space models (GP-SSMs) provide a flexible nonparametric alternative for modeling time-series dynamics that are nonlinear or difficult to specify parametrically. While the Kalman filter is effective for linear-Gaussian…

Methodology · Statistics 2025-12-02 Genshiro Kitagawa

We present a model that can automatically learn alignments between high-dimensional data in an unsupervised manner. Our proposed method casts alignment learning in a framework where both alignment and data are modelled simultaneously.…

Machine Learning · Statistics 2019-03-04 Ieva Kazlauskaite , Carl Henrik Ek , Neill D. F. Campbell

Machine learning interatomic force fields are promising for combining high computational efficiency and accuracy in modeling quantum interactions and simulating atomistic dynamics. Active learning methods have been recently developed to…

Computational Physics · Physics 2023-03-07 Yu Xie , Jonathan Vandermause , Senja Ramakers , Nakib H. Protik , Anders Johansson , Boris Kozinsky

We consider the problem of learning a non-deterministic probabilistic system consistent with a given finite set of positive and negative tree samples. Consistency is defined with respect to strong simulation conformance. We propose learning…

Logic in Computer Science · Computer Science 2012-07-24 Anvesh Komuravelli , Corina S. Pasareanu , Edmund M. Clarke

Many dynamical systems exhibit similar structure, as often captured by hand-designed simplified models that can be used for analysis and control. We develop a method for learning to correspond pairs of dynamical systems via a learned latent…

Machine Learning · Computer Science 2020-06-08 Nam Hee Kim , Zhaoming Xie , Michiel van de Panne

Spatio-temporal processes in environmental applications are often assumed to follow a Gaussian model, possibly after some transformation. However, heterogeneity in space and time might have a pattern that will not be accommodated by…

Applications · Statistics 2021-10-15 Thaís C. O. da Fonseca , Viviana G. R. Lobo , Alexandra M. Schmidt

We propose a novel active learning scheme for automatically sampling a minimum number of uncorrelated configurations for fitting the Gaussian Approximation Potential (GAP). Our active learning scheme consists of an unsupervised machine…