English
Related papers

Related papers: Bayesian Reinforcement Learning with Limited Cogni…

200 papers

Artificial intelligence algorithms are capable of fantastic exploits, yet they are still grossly inefficient compared with the brain's ability to learn from few exemplars or solve problems that have not been explicitly defined. What is the…

Neurons and Cognition · Quantitative Biology 2018-10-08 Aurelio Cortese , Benedetto De Martino , Mitsuo Kawato

The ability of an AI agent to assist other agents, such as humans, is an important and challenging goal, which requires the assisting agent to reason about the behavior and infer the goals of the assisted agent. Training such an ability by…

Artificial Intelligence · Computer Science 2021-10-05 Antti Keurulainen , Isak Westerlund , Samuel Kaski , Alexander Ilin

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen

We apply the PAC-Bayes theory to the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-bounds) and explicit trade-off…

Machine Learning · Computer Science 2023-02-16 Michael Sucker , Peter Ochs

There is a strong link between the general concept of intelligence and the ability to collect and use information. The theory of Bayes-adaptive exploration offers an attractive optimality framework for training machines to perform complex…

Machine Learning · Statistics 2021-09-20 Luca Ambrogioni

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

Theory refinement is the task of updating a domain theory in the light of new cases, to be done automatically or with some expert assistance. The problem of theory refinement under uncertainty is reviewed here in the context of Bayesian…

Artificial Intelligence · Computer Science 2013-03-26 Wray L. Buntine

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with…

Machine Learning · Statistics 2011-12-30 Neil Houlsby , Ferenc Huszár , Zoubin Ghahramani , Máté Lengyel

Active learning agents typically employ a query selection algorithm which solely considers the agent's learning objectives. However, this may be insufficient in more realistic human domains. This work uses imitation learning to enable an…

Machine Learning · Computer Science 2019-07-02 Kalesha Bullard , Yannick Schroecker , Sonia Chernova

We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ilya Nemenman

This paper proposes an online tree-based Bayesian approach for reinforcement learning. For inference, we employ a generalised context tree model. This defines a distribution on multivariate Gaussian piecewise-linear models, which can be…

Machine Learning · Statistics 2014-05-05 Nikolaos Tziortziotis , Christos Dimitrakakis , Konstantinos Blekas

We use Bayesian optimization to learn curricula for word representation learning, optimizing performance on downstream tasks that depend on the learned representations as features. The curricula are modeled by a linear ranking function…

Computation and Language · Computer Science 2016-06-22 Yulia Tsvetkov , Manaal Faruqui , Wang Ling , Brian MacWhinney , Chris Dyer

While the Bayesian decision-theoretic framework offers an elegant solution to the problem of decision making under uncertainty, one question is how to appropriately select the prior distribution. One idea is to employ a worst-case prior.…

Machine Learning · Computer Science 2023-02-22 Thomas Kleine Buening , Christos Dimitrakakis , Hannes Eriksson , Divya Grover , Emilio Jorge

Learning to act in an environment to maximise rewards is among the brain's key functions. This process has often been conceptualised within the framework of reinforcement learning, which has also gained prominence in machine learning and…

Machine Learning · Computer Science 2021-09-22 Emma L. Roscow , Raymond Chua , Rui Ponte Costa , Matt W. Jones , Nathan Lepora

Predicting the outcomes of cyber-physical systems with multiple human interactions is a challenging problem. This article reviews a game theoretical approach to address this issue, where reinforcement learning is employed to predict the…

Multiagent Systems · Computer Science 2019-10-14 Mert Albaba , Yildiray Yildiz

Learning-based methods for inverse problems, adapting to the data's inherent structure, have become ubiquitous in the last decade. Besides empirical investigations of their often remarkable performance, an increasing number of works…

Numerical Analysis · Mathematics 2023-07-21 Clemens Arndt , Sören Dittmer , Nick Heilenkötter , Meira Iske , Tobias Kluth , Judith Nickel

A fundamental challenge in developing general learning algorithms is their tendency to forget past knowledge when adapting to new data. Addressing this problem requires a principled understanding of forgetting; yet, despite decades of…

Machine Learning · Computer Science 2026-02-03 Ben Sanati , Thomas L. Lee , Trevor McInroe , Aidan Scannell , Nikolay Malkin , David Abel , Amos Storkey

We use the PAC-Bayesian theory for the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-Bayesian bounds) and explicit…

Machine Learning · Computer Science 2025-02-26 Michael Sucker , Jalal Fadili , Peter Ochs

While reinforcement learning has achieved remarkable successes in several domains, its real-world application is limited due to many methods failing to generalise to unfamiliar conditions. In this work, we consider the problem of…

Artificial Intelligence · Computer Science 2023-10-26 Michael Beukman , Devon Jarvis , Richard Klein , Steven James , Benjamin Rosman

Recent progress in Learning by Reading and Machine Reading systems has significantly increased the capacity of knowledge-based systems to learn new facts. In this work, we discuss the problem of selecting a set of learning requests for…

Artificial Intelligence · Computer Science 2025-02-18 Abhishek Sharma