English
Related papers

Related papers: Knowing when we do not know: Bayesian continual le…

200 papers

This paper develops a Bayesian framework for robust causal inference from longitudinal observational data. Many contemporary methods rely on structural assumptions, such as factor models, to adjust for unobserved confounding, but they can…

Methodology · Statistics 2025-11-20 Angelos Alexopoulos , Nikolaos Demiris

We consider a human-assisted autonomy sensor fusion for dynamic target localization in a Bayesian framework. Autonomous sensor-based tracking systems can suffer from observability and target detection failure. Humans possess valuable…

Robotics · Computer Science 2024-10-08 Min-Won Seo , Solmaz S. Kia

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, useful broad structural judgements may be elicited from…

Methodology · Statistics 2024-04-30 Jack Jewson , Jim Q. Smith , Chris Holmes

Despite AI's impressive achievements, including recent advances in generative and large language models, there remains a significant gap in the ability of AI systems to handle uncertainty and generalize beyond their training data. AI models…

Artificial Intelligence · Computer Science 2025-06-30 Shireen Kudukkil Manchingal , Andrew Bradley , Julian F. P. Kooij , Keivan Shariatmadar , Neil Yorke-Smith , Fabio Cuzzolin

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

Bayesian active learning relies on the precise quantification of predictive uncertainty to explore unknown function landscapes. While Gaussian process surrogates are the standard for such tasks, an underappreciated fact is that their…

Machine Learning · Computer Science 2026-02-03 Sanna Jarl , Maria Bånkestad , Jonathan J. S. Scragg , Jens Sjölund

We present an empirical analysis of the state-of-the-art systems for referring expression recognition -- the task of identifying the object in an image referred to by a natural language expression -- with the goal of gaining insight into…

Computation and Language · Computer Science 2018-05-31 Volkan Cirik , Louis-Philippe Morency , Taylor Berg-Kirkpatrick

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

Machine Learning · Statistics 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and…

Machine Learning · Statistics 2021-03-02 Binh Tang , David S. Matteson

In multi-task learning, a learner is given a collection of prediction tasks and needs to solve all of them. In contrast to previous work, which required that annotated training data is available for all tasks, we consider a new setting, in…

Machine Learning · Statistics 2017-06-09 Anastasia Pentina , Christoph H. Lampert

In this paper, we present a Bayesian view on model-based reinforcement learning. We use expert knowledge to impose structure on the transition model and present an efficient learning scheme based on variational inference. This scheme is…

Machine Learning · Computer Science 2019-07-12 Markus Kaiser , Clemens Otte , Thomas Runkler , Carl Henrik Ek

Despite overwhelming achievements in recognition accuracy, extending an open-set capability -- ability to identify when the question is out of scope -- remains greatly challenging in a scalable machine learning inference. A recent research…

Machine Learning · Computer Science 2021-11-01 Pisit Nakjai , Jiradej Ponsawat , Tatpong Katanyukul

While deep learning has led to remarkable advances across diverse applications, it struggles in domains where the data distribution changes over the course of learning. In stark contrast, biological neural networks continually adapt to…

Machine Learning · Computer Science 2017-06-14 Friedemann Zenke , Ben Poole , Surya Ganguli

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

Autonomous agents operating in sequential decision-making tasks under uncertainty can benefit from external action suggestions, which provide valuable guidance but inherently vary in reliability. Existing methods for incorporating such…

Artificial Intelligence · Computer Science 2026-05-26 Dylan M. Asmar , Mykel J. Kochenderfer

Biological synapses effortlessly balance memory retention and flexibility, yet artificial neural networks still struggle with the extremes of catastrophic forgetting and catastrophic remembering. Here, we introduce Metaplasticity from…

Machine Learning · Computer Science 2025-04-21 Djohan Bonnet , Kellian Cottart , Tifenn Hirtzlin , Tarcisius Januel , Thomas Dalgaty , Elisa Vianello , Damien Querlioz

Current works in human emotion recognition follow the traditional closed learning approach governed by rigid rules without any consideration of novelty. Classification models are trained on some collected datasets and expected to have the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Mijanur Palash , Bharat Bhargava

Much of human learning and inference can be framed within the computational problem of relational generalization. In this project, we propose a Bayesian model that generalizes relational knowledge to novel environments by analogically…

Artificial Intelligence · Computer Science 2020-06-09 Ruairidh M. Battleday , Thomas L. Griffiths