English
Related papers

Related papers: Learning Differentiable Particle Filter on the Fly

200 papers

Decision-focused learning (DFL) is an increasingly popular paradigm for training predictive models whose outputs are used in decision-making tasks. Instead of merely optimizing for predictive accuracy, DFL trains models to directly minimize…

Machine Learning · Computer Science 2026-03-10 Aymeric Capitaine , Maxime Haddouche , Eric Moulines , Michael I. Jordan , Etienne Boursier , Alain Durmus

Particle filtering is a standard Monte-Carlo approach for a wide range of sequential inference tasks. The key component of a particle filter is a set of particles with importance weights that serve as a proxy of the true posterior…

Machine Learning · Computer Science 2022-09-02 Ruizhi Deng , Greg Mori , Andreas M. Lehrmann

Multi-object state estimation is a fundamental problem for robotic applications where a robot must interact with other moving objects. Typically, other objects' relevant state features are not directly observable, and must instead be…

Robotics · Computer Science 2022-12-15 Angad Singh , Omar Makhlouf , Maximilian Igl , Joao Messias , Arnaud Doucet , Shimon Whiteson

We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome…

Machine Learning · Statistics 2017-03-06 Maximilian Karl , Maximilian Soelch , Justin Bayer , Patrick van der Smagt

Deep learning models are considered to be state-of-the-art in many offline machine learning tasks. However, many of the techniques developed are not suitable for online learning tasks. The problem of using deep learning models with…

Machine Learning · Computer Science 2019-05-28 Guy Uziel

In this paper, we consider a new framework for particle filtering under model uncertainty that operates beyond the scope of Markovian switching systems. Specifically, we develop a novel particle filtering algorithm that applies to general…

Computation · Statistics 2020-09-11 Yousef El-Laham , Liu Yang , Petar M. Djuric , Monica F. Bugallo

In industrial machine learning pipelines, data often arrive in parts. Particularly in the case of deep neural networks, it may be too expensive to train the model from scratch each time, so one would rather use a previously learned model…

Machine Learning · Statistics 2018-03-29 Max Kochurov , Timur Garipov , Dmitry Podoprikhin , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

In Data Assimilation, observations are fused with simulations to obtain an accurate estimate of the state and parameters for a given physical system. Combining data with a model, however, while accurately estimating uncertainty, is…

Computational Engineering, Finance, and Science · Computer Science 2024-06-05 Nikolaj T. Mücke , Sander M. Bohté , Cornelis W. Oosterlee

This article discusses a partially adapted particle filter for estimating the likelihood of a nonlinear structural econometric state space models whose state transition density cannot be expressed in closed form. The filter generates the…

Methodology · Statistics 2012-09-05 Jamie Hall , Michael K. Pitt , Robert Kohn

During typical gradient-based training of deep neural networks, all of the model's parameters are updated at each iteration. Recent work has shown that it is possible to update only a small subset of the model's parameters during training,…

Machine Learning · Computer Science 2021-11-19 Yi-Lin Sung , Varun Nair , Colin Raffel

Recurrent neural networks (RNNs) have been extraordinarily successful for prediction with sequential data. To tackle highly variable and noisy real-world data, we introduce Particle Filter Recurrent Neural Networks (PF-RNNs), a new RNN…

Machine Learning · Computer Science 2019-12-03 Xiao Ma , Peter Karkus , David Hsu , Wee Sun Lee

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Particle filters are a group of algorithms to solve inverse problems through statistical Bayesian methods when the model does not comply with the linear and Gaussian hypothesis. Particle filters are used in domains like data assimilation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Sebastian Friedemann , Kai Keller , Yen-Sen Lu , Bruno Raffin , Leonardo Bautista Gomez

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

In many applications, a state-space model depends on a parameter which needs to be inferred from a data set. Quite often, it is necessary to perform the parameter inference online. In the maximum likelihood approach, this can be done using…

Statistics Theory · Mathematics 2021-01-05 Vladislav Z. B. Tadic , Arnaud Doucet

We develop a Bayesian particle filter for tracking traffic flows that is capable of capturing non-linearities and discontinuities present in flow dynamics. Our model includes a hidden state variable that captures sudden regime shifts…

Applications · Statistics 2017-11-15 Nicholas Polson , Vadim Sokolov

One of the most well-established applications of machine learning is in deciding what content to show website visitors. When observation data comes from high-velocity, user-generated data streams, machine learning methods perform a…

Learning the dynamics of robots from data can help achieve more accurate tracking controllers, or aid their navigation algorithms. However, when the actual dynamics of the robots change due to external conditions, on-line adaptation of…

Robotics · Computer Science 2019-03-14 Bilal Wehbe , Marc Hildebrandt , Frank Kirchner

A key challenge when designing particle filters in high-dimensional state spaces is the construction of a proposal distribution that is close to the posterior distribution. Recent advances in particle flow filters provide a promising avenue…

Methodology · Statistics 2017-06-30 Yunpeng Li , Mark Coates

In many real-world scenarios, such as gas leak detection or environmental pollutant tracking, solving the Inverse Source Localization and Characterization problem involves navigating complex, dynamic fields with sparse and noisy…

Machine Learning · Computer Science 2025-01-23 Yiwei Shi , Mengyue Yang , Qi Zhang , Weinan Zhang , Cunjia Liu , Weiru Liu