English
Related papers

Related papers: Rao-Blackwellised Particle Filtering for Dynamic B…

200 papers

The particle filter (PF) and the ensemble Kalman filter (EnKF) are widely used for approximate inference in state-space models. From a Bayesian perspective, these algorithms represent the prior by an ensemble of particles and update it to…

Methodology · Statistics 2025-02-11 Chengxin Gong , Wei Lin , Cheng Zhang

We introduce a new online algorithm for expected log-likelihood maximization in situations where the objective function is multi-modal and/or has saddle points, that we term G-PFSO. The key element underpinning G-PFSO is a probability…

Machine Learning · Statistics 2022-07-07 Mathieu Gerber , Randal Douc

Industrial soft sensing is crucial for accurate process monitoring through reliable inference of dominant sensor variables. However, developing effective data-driven soft sensor models presents challenges, such as achieving domain…

Machine Learning · Computer Science 2026-01-21 Junn Yong Loo , Hwa Hui Tew , Fang Yu Leong , Ze Yang Ding , Vishnu Monn Baskaran , Chee-Ming Ting , Chee Pin Tan

Operational constraint violations may occur when deep reinforcement learning (DRL) agents interact with real-world active distribution systems to learn their optimal policies during training. This letter presents a universal…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Hoang Tien Nguyen , Dae-Hyun Choi

The Kalman filter (KF) is used in a variety of applications for computing the posterior distribution of latent states in a state space model. The model requires a linear relationship between states and observations. Extensions to the Kalman…

Machine Learning · Statistics 2016-08-31 Michael C. Burkhart , David M. Brandman , Carlos E. Vargas-Irwin , Matthew T. Harrison

The Bayesian update step poses significant computational challenges in high-dimensional nonlinear estimation. While log-homotopy particle flow filters offer an alternative to stochastic sampling, existing formulations usually yield stiff…

Machine Learning · Computer Science 2026-05-14 Domonkos Csuzdi , Tamás Bécsi , Olivér Törő

Pruning is a model compression method that removes redundant parameters in deep neural networks (DNNs) while maintaining accuracy. Most available filter pruning methods require complex treatments such as iterative pruning, features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yue Wu , Yuan Lan , Luchan Zhang , Yang Xiang

In Data Assimilation, observations are fused with simulations to obtain an accurate estimate of the state and parameters for a given physical system. Combining data with a model, however, while accurately estimating uncertainty, is…

Computational Engineering, Finance, and Science · Computer Science 2024-06-05 Nikolaj T. Mücke , Sander M. Bohté , Cornelis W. Oosterlee

Binary Stochastic Filtering (BSF), the algorithm for feature selection and neuron pruning is proposed in this work. The method defines filtering layer which penalizes amount of the information involved in the training process. This…

Machine Learning · Computer Science 2019-08-21 Andrii Trelin , Ales Prochazka

This paper is concerned with sequential state filtering in the presence of nonlinearity, non-Gaussianity and model uncertainty. For this problem, the Bayesian model averaged particle filter (BMAPF) is perhaps one of the most efficient…

Computation · Statistics 2020-01-28 Bin Liu

In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian…

Statistics Theory · Mathematics 2020-04-22 Giorgio M. Vitetta , Pasquale Di Viesti , Emilio Sirignano , Francesco Montorsi

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied. In particular, we modify the Linear Programming…

Machine Learning · Statistics 2014-01-10 Jason Gejie Liu , Shuchin Aeron

Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Kashyap Chitta , Jose M. Alvarez , Adam Lesnikowski

In many real-world scenarios, such as gas leak detection or environmental pollutant tracking, solving the Inverse Source Localization and Characterization problem involves navigating complex, dynamic fields with sparse and noisy…

Machine Learning · Computer Science 2025-01-23 Yiwei Shi , Mengyue Yang , Qi Zhang , Weinan Zhang , Cunjia Liu , Weiru Liu

Uncertainties such as manufacturing tolerances cause performance variations in complex engineering systems, making robust design optimization (RDO) essential. However, simulation-based RDO faces high computational cost for statistical…

Optimization and Control · Mathematics 2026-02-10 Hyunho Jang , Dongjin Lee

Variational Bayesian neural networks (BNNs) perform variational inference over weights, but it is difficult to specify meaningful priors and approximate posteriors in a high-dimensional weight space. We introduce functional variational…

Machine Learning · Computer Science 2019-03-15 Shengyang Sun , Guodong Zhang , Jiaxin Shi , Roger Grosse

Particle filters contain the promise of fully nonlinear data assimilation. They have been applied in numerous science areas, but their application to the geosciences has been limited due to their inefficiency in high-dimensional systems in…

Applications · Statistics 2019-04-16 Peter Jan van Leeuwen , Hans R. Künsch , Lars Nerger , Roland Potthast , Sebastian Reich

This overview paper describes the particle methods developed for the implementation of the a class of Bayes filters formulated using the random finite set formalism. It is primarily intended for the readership already familiar with the…

Systems and Control · Computer Science 2016-02-15 Branko Ristic , Michael Beard , Claudio Fantacci

Recent years have witnessed a growing interest in tracking algorithms that augment Kalman Filters (KFs) with Deep Neural Networks (DNNs). By transforming KFs into trainable deep learning models, one can learn from data to reliably track a…

Signal Processing · Electrical Eng. & Systems 2025-06-19 Yehonatan Dahan , Guy Revach , Jindrich Dunik , Nir Shlezinger

Trend filtering simplifies complex time series data by applying smoothness to filter out noise while emphasizing proximity to the original data. However, existing trend filtering methods fail to reflect abrupt changes in the trend due to…

Machine Learning · Computer Science 2025-03-25 Jihyeon Seong , Sekwang Oh , Jaesik Choi