English
Related papers

Related papers: Approximate Bayesian Inference in Linear State Spa…

200 papers

In this work the issue of Bayesian inference for stationary data is addressed. Therefor a parametrization of a statistically suitable subspace of the the shift-ergodic probability measures on a Cartesian product of some finite state space…

Statistics Theory · Mathematics 2017-10-24 Fritz Moritz von Rohrscheidt

A new dynamic latent space eigenmodel (LSM) is proposed for weighted temporal networks. The model accommodates integer-valued weights, excess of zeros, time-varying node positions (features), and time-varying network sparsity. The latent…

Methodology · Statistics 2026-04-15 Roberto Casarin , Matteo Iacopini , Antonio Peruzzi

Subspace inference for neural networks assumes that a subspace of their parameter space suffices to produce a reliable uncertainty quantification. In this work, we underpin the validity of this assumption by using low rank techniques. We…

Machine Learning · Computer Science 2026-04-13 Josua Faller , Jörg Martin

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

Bayesian statistical inference for Generalized Linear Models (GLMs) with parameters lying on a constrained space is of general interest (e.g., in monotonic or convex regression), but often constructing valid prior distributions supported on…

Methodology · Statistics 2021-09-02 Rahul Ghosal , Sujit K. Ghosh

Intermittency is a common and challenging problem in demand forecasting. We introduce a new, unified framework for building intermittent demand forecasting models, which incorporates and allows to generalize existing methods in several…

Machine Learning · Computer Science 2020-10-06 Ali Caner Turkmen , Tim Januschowski , Yuyang Wang , Ali Taylan Cemgil

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

The rapid growth of earth observation systems calls for a scalable approach to interpolate remote-sensing observations. These methods in principle, should acquire more information about the observed field as data grows. Gaussian processes…

Machine Learning · Computer Science 2024-12-17 Weibin Chen , Azhir Mahmood , Michel Tsamados , So Takao

Bayesian deep learning all too often underfits so that the Bayesian prediction is less accurate than a simple point estimate. Uncertainty quantification then comes at the cost of accuracy. For linearized models, the null space of the…

Machine Learning · Computer Science 2024-10-23 Marco Miani , Hrittik Roy , Søren Hauberg

Accurate state estimates are required for increasingly complex systems, to enable, for example, feedback control. However, available state estimation schemes are not necessarily real-time feasible for certain large-scale systems. Therefore,…

Systems and Control · Electrical Eng. & Systems 2024-10-24 S. A. N. Nouwens , M. M. Paulides , W. P. M. H. Heemels

In this paper we extend the work of Smith and Papamichail (1999) and present fast approximate Bayesian algorithms for learning in complex scenarios where at any time frame, the relationships between explanatory state space variables can be…

Machine Learning · Computer Science 2013-01-30 Raffaella Settimi , Jim Q. Smith , A. S. Gargoum

In this paper we address the problem of estimating the posterior distribution of the static parameters of a continuous time state space model with discrete time observations by an algorithm that combines the Kalman filter and a particle…

Computation · Statistics 2019-05-22 Jian He , Asma Khedher , Peter Spreij

State-space models are used to describe and analyse dynamical systems. They are ubiquitously used in many scientific fields such as signal processing, finance and ecology to name a few. Particle filters are popular inferential methods used…

Computation · Statistics 2024-12-20 Alaa Amri

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

Statistics Theory · Mathematics 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

In many instances, the application of approximate Bayesian methods is hampered by two practical features: 1) the requirement to project the data down to low-dimensional summary, including the choice of this projection, which ultimately…

Methodology · Statistics 2020-06-26 David T. Frazier

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Bayesian inference is a powerful tool for parameter estimation and uncertainty quantification in dynamical systems. However, for nonlinear oscillator networks such as Kuramoto models, widely used to study synchronization phenomena in…

Applications · Statistics 2026-03-24 Emma Hannula , Jana de Wiljes , Matthew T. Moores , Heikki Haario , Lassi Roininen

Latent space models are popular for analyzing dynamic network data. We propose a variational approach to estimate the model parameters as well as the latent positions of the nodes in the network. The variational approach is much faster than…

Methodology · Statistics 2021-06-01 Yan Liu , Yuguo Chen