English
Related papers

Related papers: GraphEM: EM algorithm for blind Kalman filtering u…

200 papers

Gaussian process state-space models (GP-SSMs) are a very flexible family of models of nonlinear dynamical systems. They comprise a Bayesian nonparametric representation of the dynamics of the system and additional (hyper-)parameters…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

This research enhances linear regression models by integrating a Kalman filter and analysing curve areas to minimize loss. The goal is to develop an optimal linear regression equation using stochastic gradient descent (SGD) for weight…

Machine Learning · Computer Science 2023-08-24 Gokulprasath R

System identification poses a significant bottleneck to characterizing and controlling complex systems. This challenge is greatest when both the system states and parameters are not directly accessible leading to a dual-estimation problem.…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Matthew F. Singh , Chong Wang , Michael W. Cole , ShiNung Ching

Representing and exploiting multivariate signals requires capturing relations between variables, which we can represent by graphs. Graph dictionaries allow to describe complex relational information as a sparse sum of simpler structures,…

Machine Learning · Computer Science 2026-01-09 William Cappelletti , Pascal Frossard

Normal priors with unknown variance (NUV) have long been known to promote sparsity and to blend well with parameter learning by expectation maximization (EM). In this paper, we advocate this approach for linear state space models for…

Information Theory · Computer Science 2016-02-10 Hans-Andrea Loeliger , Lukas Bruderer , Hampus Malmberg , Federico Wadehn , Nour Zalmai

Low dimensional representations of words allow accurate NLP models to be trained on limited annotated data. While most representations ignore words' local context, a natural way to induce context-dependent representations is to perform…

Machine Learning · Statistics 2015-06-02 David Belanger , Sham Kakade

Large-scale dynamic inverse problems are often ill-posed due to model complexity and the high dimensionality of the unknown parameters. Regularization is commonly employed to mitigate ill-posedness by incorporating prior information and…

Numerical Analysis · Mathematics 2026-01-21 Aryeh Keating , Mirjeta Pasha

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

The computation required for a switching Kalman Filter (SKF) increases exponentially with the number of system operation modes. In this paper, a computationally tractable graph representation is proposed for a switching linear dynamic…

Signal Processing · Electrical Eng. & Systems 2022-03-09 Parisa Karimi , Mark Butala , Zhizhen Zhao , Farzad Kamalabadi

This paper studies the distributed state estimation in sensor network, where $m$ sensors are deployed to infer the $n$-dimensional state of a linear time-invariant (LTI) Gaussian system. By a lossless decomposition of optimal steady-state…

Systems and Control · Electrical Eng. & Systems 2022-04-22 Jiaqi Yan , Xu Yang , Yilin Mo , Keyou You

This paper studies the problem of jointly estimating multiple network processes driven by a common unknown input, thus effectively generalizing the classical blind multi-channel identification problem to graphs. More precisely, we model…

Signal Processing · Electrical Eng. & Systems 2019-10-01 Yu Zhu , Fernando J. Iglesias , Antonio G. Marques , Santiago Segarra

We propose a nonparametric procedure to achieve fast inference in generative graphical models when the number of latent states is very large. The approach is based on iterative latent variable preselection, where we alternate between…

Machine Learning · Statistics 2021-10-06 Jacquelyn A. Shelton , Jan Gasthaus , Zhenwen Dai , Joerg Luecke , Arthur Gretton

The performance of ensemble-based data assimilation techniques that estimate the state of a dynamical system from partial observations depends crucially on the prescribed uncertainty of the model dynamics and of the observations. These are…

Computation · Statistics 2021-02-24 Tadeo Javier Cocucci , Manuel Pulido , Magdalena Lucini , Pierre Tandeo

The Kalman filter is a fundamental filtering algorithm that fuses noisy sensory data, a previous state estimate, and a dynamics model to produce a principled estimate of the current state. It assumes, and is optimal for, linear models and…

Neural and Evolutionary Computing · Computer Science 2021-04-30 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher Buckley

State-space smoothing has found many applications in science and engineering. Under linear and Gaussian assumptions, smoothed estimates can be obtained using efficient recursions, for example Rauch-Tung-Striebel and Mayne-Fraser algorithms.…

Optimization and Control · Mathematics 2016-09-27 A. Y. Aravkin , J. V. Burke , L. Ljung , A. Lozano , G. Pillonetto

One of the most crucial challenges in graph signal processing is the sampling of bandlimited graph signals, i.e., signals that are sparse in a well-defined graph Fourier domain. So far, the prior art is mostly focused on (sub)sampling…

Signal Processing · Electrical Eng. & Systems 2018-10-22 Elvin Isufi , Paolo Banelli , Paolo Di Lorenzo , Geert Leus

Bayesian graphical models are a useful tool for understanding dependence relationships among many variables, particularly in situations with external prior information. In high-dimensional settings, the space of possible graphs becomes…

Machine Learning · Statistics 2019-02-07 Zehang Richard Li , Tyler H. McCormick

In this work, we present a new class of models, called uncertain-input models, that allows us to treat system-identification problems in which a linear system is subject to a partially unknown input signal. To encode prior information about…

Systems and Control · Computer Science 2017-09-12 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Predicting the behavior of a dynamical system from noisy observations of its past outputs is a classical problem encountered across engineering and science. For linear systems with Gaussian inputs, the Kalman filter -- the best linear…

Machine Learning · Computer Science 2026-03-10 Usman Akram , Haris Vikalo

Author's Summary of the dissertation for the degree of the Candidate of Science (physics and mathematics). The aim of the dissertation is to develop a generalized Kalman Duality concept applicable for linear unbounded non-invertible…

Optimization and Control · Mathematics 2011-03-01 Sergiy Zhuk