English
Related papers

Related papers: Beyond Bayes-optimality: meta-learning what you kn…

200 papers

Learning to control a safety-critical system with latent dynamics (e.g. for deep brain stimulation) requires taking calculated risks to gain information as efficiently as possible. To address this problem, we present a…

Machine Learning · Computer Science 2020-07-09 Mariah L. Schrum , Mark Connolly , Eric Cole , Mihir Ghetiya , Robert Gross , Matthew C. Gombolay

The human-agent team, which is a problem in which humans and autonomous agents collaborate to achieve one task, is typical in human-AI collaboration. For effective collaboration, humans want to have an effective plan, but in realistic…

Artificial Intelligence · Computer Science 2021-09-02 Ryo Nakahashi , Seiji Yamada

Biological and artificial learning agents face numerous choices about how to learn, ranging from hyperparameter selection to aspects of task distributions like curricula. Understanding how to make these meta-learning choices could offer…

Neural and Evolutionary Computing · Computer Science 2024-07-16 Rodrigo Carrasco-Davis , Javier Masís , Andrew M. Saxe

Data-efficient learning algorithms are essential in many practical applications for which data collection is expensive, e.g., for the optimal deployment of wireless systems in unknown propagation scenarios. Meta-learning can address this…

Machine Learning · Computer Science 2022-05-25 Ivana Nikoloska , Osvaldo Simeone

We use optimism to introduce generic asymptotically optimal reinforcement learning agents. They achieve, with an arbitrary finite or compact class of environments, asymptotically optimal behavior. Furthermore, in the finite deterministic…

Artificial Intelligence · Computer Science 2013-05-17 Peter Sunehag , Marcus Hutter

In robotics, optimizing controller parameters under safety constraints is an important challenge. Safe Bayesian optimization (BO) quantifies uncertainty in the objective and constraints to safely guide exploration in such settings.…

Machine Learning · Computer Science 2023-06-13 Jonas Rothfuss , Christopher Koenig , Alisa Rupenyan , Andreas Krause

For effective human-agent teaming, robots and other artificial intelligence (AI) agents must infer their human partner's abilities and behavioral response patterns and adapt accordingly. Most prior works make the unrealistic assumption that…

Robotics · Computer Science 2024-03-26 Manisha Natarajan , Chunyue Xue , Sanne van Waveren , Karen Feigh , Matthew Gombolay

We introduce a unified probabilistic framework for solving sequential decision making problems ranging from Bayesian optimisation to contextual bandits and reinforcement learning. This is accomplished by a probabilistic model-based approach…

We propose and analyze a continuous-time robust reinforcement learning framework for optimal stopping under ambiguity. In this framework, an agent chooses a robust exploratory stopping time motivated by two objectives: robust…

Optimization and Control · Mathematics 2026-04-17 Junyan Ye , Hoi Ying Wong , Kyunghyun Park

Despite remarkable achievements in artificial intelligence, the deployability of learning-enabled systems in high-stakes real-world environments still faces persistent challenges. For example, in safety-critical domains like autonomous…

Artificial Intelligence · Computer Science 2023-12-19 Minjae Cho , Chuangchuang Sun

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

Classical Bayesian persuasion studies how a sender influences receivers through carefully designed signaling policies within a single strategic interaction. In many real-world environments, such interactions are repeated across multiple…

Computer Science and Game Theory · Computer Science 2026-03-24 Ata Poyraz Turna , Asrin Efe Yorulmaz , Tamer Başar

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Meta-learning owns unique effectiveness and swiftness in tackling emerging tasks with limited data. Its broad applicability is revealed by viewing it as a bi-level optimization problem. The resultant algorithmic viewpoint however, faces…

Machine Learning · Computer Science 2023-12-22 Yilang Zhang , Bingcong Li , Shijian Gao , Georgios B. Giannakis

Reinforcement learners can attain high reward through novel unintended strategies. We study a Bayesian mitigation for general environments: we expand the agent's subjective reward range to include a large negative value $-L$, while the true…

Machine Learning · Computer Science 2026-04-16 Aram Ebtekar , Michael K. Cohen

Meta-learning automatically infers an inductive bias by observing data from a number of related tasks. The inductive bias is encoded by hyperparameters that determine aspects of the model class or training algorithm, such as initialization…

Machine Learning · Computer Science 2020-11-10 Sharu Theresa Jose , Osvaldo Simeone , Giuseppe Durisi

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

Machine Learning · Computer Science 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth

In recent years, meta-learning, in which a model is trained on a family of tasks (i.e. a task distribution), has emerged as an approach to training neural networks to perform tasks that were previously assumed to require structured…

Machine Learning · Computer Science 2021-03-19 Sreejan Kumar , Ishita Dasgupta , Jonathan D. Cohen , Nathaniel D. Daw , Thomas L. Griffiths

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

Machine Learning · Computer Science 2025-07-21 Thomas Banker , Ali Mesbah

Metacognition, defined as the awareness and regulation of one's cognitive processes, is central to human adaptability in unknown situations. In contrast, current autonomous agents often struggle in novel environments due to their limited…

Machine Learning · Computer Science 2025-11-18 Rodolfo Valiente , Praveen K. Pilly