English
Related papers

Related papers: Rao-Blackwellized Particle Smoothing as Message Pa…

200 papers

We present approximate algorithms for performing smoothing in a class of high-dimensional state-space models via sequential Monte Carlo methods ("particle filters"). In high dimensions, a prohibitively large number of Monte Carlo samples…

Computation · Statistics 2017-09-21 Axel Finke , Sumeetpal S. Singh

We propose a machine learning framework for parameter estimation of single mode Gaussian quantum states. Under a Bayesian framework, our approach estimates parameters of suitable prior distributions from measured data. For phase-space…

Quantum Physics · Physics 2021-08-16 Neel Kanth Kundu , Matthew R. McKay , Ranjan K. Mallik

Probabilistic (or Bayesian) modeling and learning offers interesting possibilities for systematic representation of uncertainty using probability theory. However, probabilistic learning often leads to computationally challenging problems.…

Computation · Statistics 2018-03-14 Andreas Svensson , Thomas B. Schön , Fredrik Lindsten

Boolean matrix factorization and Boolean matrix completion from noisy observations are desirable unsupervised data-analysis methods due to their interpretability, but hard to perform due to their NP-hardness. We treat these problems as…

Statistics Theory · Mathematics 2016-02-08 Siamak Ravanbakhsh , Barnabas Poczos , Russell Greiner

The sum-product or belief propagation (BP) algorithm is a widely used message-passing technique for computing approximate marginals in graphical models. We introduce a new technique, called stochastic orthogonal series message-passing…

Information Theory · Computer Science 2012-12-18 Nima Noorshams , Martin J. Wainwright

There are proposals that extend the classical generalized additive models (GAMs) to accommodate high-dimensional data ($p>>n$) using group sparse regularization. However, the sparse regularization may induce excess shrinkage when estimating…

Methodology · Statistics 2022-07-07 Boyi Guo , Byron C. Jaeger , A. K. M. Fazlur Rahman , D. Leann Long , Nengjun Yi

The robustness of image segmentation has been an important research topic in the past few years as segmentation models have reached production-level accuracy. However, like classification models, segmentation models can be vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Othmane Laousy , Alexandre Araujo , Guillaume Chassagnon , Marie-Pierre Revel , Siddharth Garg , Farshad Khorrami , Maria Vakalopoulou

This paper studies the convergence rate of a message-passing distributed algorithm for solving a large-scale linear system. This problem is generalised from the celebrated Gaussian Belief Propagation (BP) problem for statistical learning…

Systems and Control · Electrical Eng. & Systems 2020-04-15 Zhaorong Zhang , Qianqian Cai , Minyue Fu

We propose an approximation to the forward-filter-backward-sampler (FFBS) algorithm for large-scale spatio-temporal smoothing. FFBS is commonly used in Bayesian statistics when working with linear Gaussian state-space models, but it…

Methodology · Statistics 2022-07-20 Marcin Jurek , Matthias Katzfuss

This paper proposes a new Bayesian strategy for the smooth estimation of altimetric parameters. The altimetric signal is assumed to be corrupted by a thermal and speckle noise distributed according to an independent and non identically…

Applications · Statistics 2016-04-20 Abderrahim Halimi , Corinne Mailhes , Jean-Yves Tourneret , Hichem Snoussi

We develop a message-passing algorithm for noisy matrix completion problems based on matrix factorization. The algorithm is derived by approximating message distributions of belief propagation with Gaussian distributions that share the same…

Machine Learning · Statistics 2021-10-27 Koki Okajima , Yoshiyuki Kabashima

Numerical weather forecasts can exhibit systematic errors due to simplifying model assumptions and computational approximations. Statistical postprocessing is a statistical approach to correcting such biases. A statistical postprocessing…

Methodology · Statistics 2022-09-02 Stefan Siegert , Ben Hooper , Joshua Lovegrove , Tyler Thomson , Birgir Hrafnkelsson

Spatial concurrent linear models, in which the model coefficients are spatial processes varying at a local level, are flexible and useful tools for analyzing spatial data. One approach places stationary Gaussian process priors on the…

Applications · Statistics 2012-02-03 Zuofeng Shang , Murray K. Clayton

Bayesian estimation is a vital tool in robotics as it allows systems to update the robot state belief using incomplete information from noisy sensors. To render the state estimation problem tractable, many systems assume that the motion and…

Robotics · Computer Science 2025-01-13 Miguel Saavedra-Ruiz , Steven A. Parkison , Ria Arora , James Richard Forbes , Liam Paull

We present closed-form expressions for marginalizing and conditioning Gaussians onto linear manifolds, and demonstrate how to apply these expressions to smooth nonlinear manifolds through linearization. Although marginalization and…

Robotics · Computer Science 2025-06-09 Zi Cong Guo , James R. Forbes , Timothy D. Barfoot

We present a scalable and robust Bayesian inference method for linear state space models. The method is applied to demand forecasting in the context of a large e-commerce platform, paying special attention to intermittent and bursty target…

We present a general probabilistic perspective on Gaussian filtering and smoothing. This allows us to show that common approaches to Gaussian filtering/smoothing can be distinguished solely by their methods of computing/approximating the…

Methodology · Statistics 2011-06-09 Marc Peter Deisenroth , Henrik Ohlsson

We introduce neural particle smoothing, a sequential Monte Carlo method for sampling annotations of an input string from a given probability model. In contrast to conventional particle filtering algorithms, we train a proposal distribution…

Computation and Language · Computer Science 2018-05-01 Chu-Cheng Lin , Jason Eisner

We propose a novel regularization loss that enforces standard Gaussianity, encouraging samples to align with a standard Gaussian distribution. This facilitates a range of downstream tasks involving optimization in the latent space of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jisung Hwang , Jaihoon Kim , Minhyuk Sung

Sequential fine-tuning of transformers is useful when new data arrive sequentially, especially with shifting distributions. Unlike batch learning, sequential learning demands that training be stabilized despite a small amount of data by…

Machine Learning · Computer Science 2025-09-16 Haoming Jing , Oren Wright , José M. F. Moura , Yorie Nakahira