English
Related papers

Related papers: Enhancing Computational Efficiency in State-Space …

200 papers

Bayesian analysis of state-space models includes computing the posterior distribution of the system's parameters as well as filtering, smoothing, and predicting the system's latent states. When the latent states wander around $\mathbb{R}^n$…

Methodology · Statistics 2013-12-24 Jesse Windle , Carlos M. Carvalho

We present a scalable approach to performing approximate fully Bayesian inference in generic state space models. The proposed method is an alternative to particle MCMC that provides fully Bayesian inference of both the dynamic latent states…

Machine Learning · Statistics 2019-02-13 Marcel Hirt , Petros Dellaportas

Bayesian optimization (BO) is a sample-efficient global optimization algorithm for black-box functions which are expensive to evaluate. Existing literature on model based optimization in conditional parameter spaces are usually built on…

Machine Learning · Statistics 2020-10-08 Xingchen Ma , Matthew B. Blaschko

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

Machine Learning · Statistics 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa

Approximate Bayesian computation (ABC) has become an essential tool for the analysis of complex stochastic models when the likelihood function is numerically unavailable. However, the well-established statistical method of empirical…

Computation · Statistics 2015-06-05 K. L. Mengersen , P. Pudlo , C. P. Robert

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that…

Systems and Control · Computer Science 2015-06-30 Henri Nurminen , Tohid Ardeshiri , Robert Piché , Fredrik Gustafsson

Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization problem. Recently,…

Optimization and Control · Mathematics 2022-04-01 Tianyi Chen , Yuejiao Sun , Quan Xiao , Wotao Yin

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

We consider jointly estimating the coefficient matrix and the error precision matrix in high-dimensional multivariate linear regression models. Bayesian methods in this context often face computational challenges, leading to previous…

Methodology · Statistics 2025-08-25 Xuan Cao , Kyoungjae Lee

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

In light transport simulation, Markov chain Monte Carlo methods are particularly effective at exploring regions with complex lighting characteristics. However, estimator variance is a central concern across Monte Carlo methods in general.…

Computational Engineering, Finance, and Science · Computer Science 2026-05-12 Sascha Holl , Gurprit Singh , Hans-Peter Seidel

Bayesian analysis methods often use some form of iterative simulation such as Monte Carlo computation. Models that involve discrete variables can sometime pose a challenge, either because the methods used do not support such variables (e.g.…

Methodology · Statistics 2022-09-14 Wen Zhang , Jeffrey Pullin , Lyle Gurrin , Damjan Vukcevic

Introduction. Reservoir computing is a growing paradigm for simplified training of recurrent neural networks, with a high potential for hardware implementations. Numerous experiments in optics and electronics yield comparable performance to…

Neural and Evolutionary Computing · Computer Science 2020-04-07 Piotr Antonik , Nicolas Marsal , Daniel Brunner , Damien Rontani

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

The initialization of the state estimation in a localization scenario based on ranging and dead reckoning is studied. Specifically, we start with a cooperative localization setup and consider the problem of recursively arriving at a…

Robotics · Computer Science 2013-07-04 John-Olof Nilsson , Peter Händel

Optimizing expensive black-box objectives over mixed search spaces is a common challenge across the natural sciences. Bayesian optimization (BO) offers sample-efficient strategies through probabilistic surrogate models and acquisition…

Machine Learning · Computer Science 2026-04-10 Yuhao Zhang , Ti John , Matthias Stosiek , Patrick Rinke

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the…

Machine Learning · Computer Science 2018-03-29 Paul Rolland , Jonathan Scarlett , Ilija Bogunovic , Volkan Cevher

In computational mechanics, multiple models are often present to describe a physical system. While Bayesian model selection is a helpful tool to compare these models using measurement data, it requires the computationally expensive…

Computation · Statistics 2025-04-14 Subhayan De , Reza Farzad , Patrick T. Brewick , Erik A. Johnson , Steven F. Wojtkiewicz

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

Reinforcement learning (RL) aims to find an optimal policy by interaction with an environment. Consequently, learning complex behavior requires a vast number of samples, which can be prohibitive in practice. Nevertheless, instead of…

Machine Learning · Computer Science 2021-11-23 Sarah Müller , Alexander von Rohr , Sebastian Trimpe