English
Related papers

Related papers: Learning in Volatile Environments with the Bayes F…

200 papers

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

Animals exhibit an innate ability to learn regularities of the world through interaction. By performing experiments in their environment, they are able to discern the causal factors of variation and infer how they affect the world's…

Machine Learning · Computer Science 2021-08-10 Sumedh A. Sontakke , Arash Mehrjou , Laurent Itti , Bernhard Schölkopf

Unsupervised reinforcement learning aims at learning a generalist policy in a reward-free manner for fast adaptation to downstream tasks. Most of the existing methods propose to provide an intrinsic reward based on surprise. Maximizing or…

Machine Learning · Computer Science 2022-10-14 Andrew Zhao , Matthieu Gaetan Lin , Yangguang Li , Yong-Jin Liu , Gao Huang

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by the goal of…

Neural and Evolutionary Computing · Computer Science 2022-11-02 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

In this thesis, we introduce Bayesian filtering as a principled framework for tackling diverse sequential machine learning problems, including online (continual) learning, prequential (one-step-ahead) forecasting, and contextual bandits. To…

Machine Learning · Statistics 2025-05-13 Gerardo Duran-Martin

Bayesian active learning relies on the precise quantification of predictive uncertainty to explore unknown function landscapes. While Gaussian process surrogates are the standard for such tasks, an underappreciated fact is that their…

Machine Learning · Computer Science 2026-02-03 Sanna Jarl , Maria Bånkestad , Jonathan J. S. Scragg , Jens Sjölund

Hierarchical Bayesian networks and neural networks with stochastic hidden units are commonly perceived as two separate types of models. We show that either of these types of models can often be transformed into an instance of the other, by…

Machine Learning · Computer Science 2015-01-23 Diederik P. Kingma , Max Welling

We study the problem of non-Bayesian social learning with uncertain models, in which a network of agents seek to cooperatively identify the state of the world based on a sequence of observed signals. In contrast with the existing…

Optimization and Control · Mathematics 2019-09-11 César A. Uribe , James Z. Hare , Lance Kaplan , Ali Jadbabaie

Bayesian neural networks with latent variables are scalable and flexible probabilistic models: They account for uncertainty in the estimation of the network weights and, by making use of latent variables, can capture complex noise patterns…

Machine Learning · Statistics 2018-06-19 Stefan Depeweg , José Miguel Hernández-Lobato , Finale Doshi-Velez , Steffen Udluft

We study online Bayesian persuasion problems in which an informed sender repeatedly faces a receiver with the goal of influencing their behavior through the provision of payoff-relevant information. Previous works assume that the sender has…

Computer Science and Game Theory · Computer Science 2024-11-12 Francesco Bacchiocchi , Matteo Bollini , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

This paper introduces a novel Bayesian approach to detect changes in the variance of a Gaussian sequence model, focusing on quantifying the uncertainty in the change point locations and providing a scalable algorithm for inference. Such a…

Methodology · Statistics 2025-03-04 Lorenzo Cappello , Oscar Hernan Madrid Padilla

With the resurgence of interest in neural networks, representation learning has re-emerged as a central focus in artificial intelligence. Representation learning refers to the discovery of useful encodings of data that make domain-relevant…

Machine Learning · Computer Science 2016-12-19 Karl Ridgeway

To make informed decisions in natural environments that change over time, humans must update their beliefs as new observations are gathered. Studies exploring human inference as a dynamical process that unfolds in time have focused on…

Neurons and Cognition · Quantitative Biology 2022-03-03 Arthur Prat-Carrabin , Robert C. Wilson , Jonathan D. Cohen , Rava Azeredo da Silveira

This article addresses the challenge of adapting data-based models over time. We propose a novel two-fold modelling architecture designed to correct plant-model mismatch caused by two types of uncertainty. Out-of-domain uncertainty arises…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Laura Boca de Giuli , Alessio La Bella , Riccardo Scattolini

Continual learning aims to learn new tasks without forgetting previously learned ones. This is especially challenging when one cannot access data from previous tasks and when the model has a fixed capacity. Current regularization-based…

Machine Learning · Computer Science 2020-02-21 Sayna Ebrahimi , Mohamed Elhoseiny , Trevor Darrell , Marcus Rohrbach

Real-world data contains aleatoric uncertainty - irreducible noise arising from imperfect measurements or from incomplete knowledge about the data generation process. Mean-variance estimation networks can learn this type of uncertainty but…

Machine Learning · Computer Science 2026-05-29 Jiaxiang Yi , Miguel A. Bessa

This paper introduces a variational formulation of natural selection, paying special attention to the nature of "things" and the way that different "kinds" of "things" are individuated from - and influence - each other. We use the Bayesian…

Populations and Evolution · Quantitative Biology 2023-07-05 Karl Friston , Daniel Ari Friedman , Axel Constant , V. Bleu Knight , Thomas Parr , John O. Campbell

Traditional imitation learning provides a set of methods and algorithms to learn a reward function or policy from expert demonstrations. Learning from demonstration has been shown to be advantageous for navigation tasks as it allows for…

Robotics · Computer Science 2021-08-03 Christian Ellis , Maggie Wigness , John G. Rogers , Craig Lennon , Lance Fiondella

It is crucial for robots to be aware of the presence of constraints in order to acquire safe policies. However, explicitly specifying all constraints in an environment can be a challenging task. State-of-the-art constraint inference…

Robotics · Computer Science 2024-03-06 Dimitris Papadimitriou , Daniel S. Brown

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz