English
Related papers

Related papers: Bayesian learning of noisy Markov decision process…

200 papers

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their versatility in sampling from complicated probability distributions. However, as the dimension of the distribution gets larger, the computational costs for a satisfactory…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-01 Hector J. Hortua , Riccardo Volpi , Dimitri Marinelli , Luigi Malago

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

Most successful applications of deep learning involve similar training and test conditions. However, tasks such as biological sequence design involve searching for sequences that improve desirable properties beyond previously known values,…

Machine Learning · Computer Science 2025-05-27 Sophia Hager , Aleem Khan , Andrew Wang , Nicholas Andrews

Resistive memory technologies promise to be a key component in unlocking the next generation of intelligent in-memory computing systems that can act and learn locally at the edge. However, current approaches to in-memory machine learning…

Emerging Technologies · Computer Science 2020-01-31 Thomas Dalgaty , Niccolo Castellani , Damien Querlioz , Elisa Vianello

Many robotic tasks, such as human-robot interactions or the handling of fragile objects, require tight control and limitation of appearing forces and moments alongside sensible motion control to achieve safe yet high-performance operation.…

Robotics · Computer Science 2023-03-09 Janine Matschek , Johanna Bethge , Rolf Findeisen

Bayesian inference applied to microseismic activity monitoring allows the accurate location of microseismic events from recorded seismograms and the estimation of the associated uncertainties. However, the forward modelling of these…

Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from…

Computation · Statistics 2017-12-21 Luca Martino , Victor Elvira , Gustau Camps-Valls

We consider the situation where a temporal process is composed of contiguous segments with differing slopes and replicated noise-corrupted time series measurements are observed. The unknown mean of the data generating process is modelled as…

The Bayesian approach to inverse problems typically relies on posterior sampling approaches, such as Markov chain Monte Carlo, for which the generation of each sample requires one or more evaluations of the parameter-to-observable map or…

Computation · Statistics 2014-12-23 Jinglai Li , Youssef M. Marzouk

To understand how rich dynamics emerge in neural populations, we require models exhibiting a wide range of activity patterns while remaining interpretable in terms of connectivity and single-neuron dynamics. However, it has been challenging…

Neurons and Cognition · Quantitative Biology 2020-03-10 Alexandre René , André Longtin , Jakob H. Macke

Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while…

Systems and Control · Electrical Eng. & Systems 2024-04-19 Sebastian Hirt , Maik Pfefferkorn , Ali Mesbah , Rolf Findeisen

Bayesian formulations of inverse problems are attractive for their ability to incorporate prior knowledge and update probabilistic models as new data become available. Markov chain Monte Carlo (MCMC) methods sample posterior probability…

Geophysics · Physics 2025-05-07 Giovanni Angelo Meles , Stefano Marelli , Niklas Linde

Rich data generating mechanisms are ubiquitous in this age of information and require complex statistical models to draw meaningful inference. While Bayesian analysis has seen enormous development in the last 30 years, benefitting from the…

Computation · Statistics 2022-10-20 Radu V. Craiu , Evgeny Levi

Meta-reinforcement learning trains a single reinforcement learning agent on a distribution of tasks to quickly generalize to new tasks outside of the training set at test time. From a Bayesian perspective, one can interpret this as…

Machine Learning · Computer Science 2025-11-20 Joery A. de Vries , Jinke He , Mathijs M. de Weerdt , Matthijs T. J. Spaan

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

Machine Learning · Computer Science 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

We consider the problem of inferring a latent function in a probabilistic model of data. When dependencies of the latent function are specified by a Gaussian process and the data likelihood is complex, efficient computation often involve…

Machine Learning · Statistics 2018-07-23 Martin Tegner , Benjamin Bloem-Reddy , Stephen Roberts

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior…

Machine Learning · Statistics 2013-08-26 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

Computational level explanations based on optimal feedback control with signal-dependent noise have been able to account for a vast array of phenomena in human sensorimotor behavior. However, commonly a cost function needs to be assumed for…

Machine Learning · Computer Science 2021-10-22 Matthias Schultheis , Dominik Straub , Constantin A. Rothkopf

Classical parameter-space Bayesian inference for Bayesian neural networks (BNNs) suffers from several unresolved prior issues, such as knowledge encoding intractability and pathological behaviours in deep networks, which can lead to…

Machine Learning · Computer Science 2024-10-11 Mengjing Wu , Junyu Xuan , Jie Lu