English
Related papers

Related papers: Boundedly Rational Meta-Learning in Sequential Con…

200 papers

Multimodal meta-learning is a recent problem that extends conventional few-shot meta-learning by generalizing its setup to diverse multimodal task distributions. This setup makes a step towards mimicking how humans make use of a diverse set…

Machine Learning · Computer Science 2021-10-28 Milad Abdollahzadeh , Touba Malekzadeh , Ngai-Man Cheung

Understanding the sequence of cognitive operations that underlie decision-making is a fundamental challenge in cognitive neuroscience. Traditional approaches often rely on group-level statistics, which obscure trial-by-trial variations in…

Neurons and Cognition · Quantitative Biology 2025-04-15 Rick den Otter , Gabriel Weindel , Sjoerd Stuit , Leendert van Maanen

Given data on the choices made by consumers for different offer sets, a key challenge is to develop parsimonious models that describe and predict consumer choice behavior while being amenable to prescriptive tasks such as pricing and…

Machine Learning · Statistics 2025-04-15 Yanqiu Ruan , Xiaobo Li , Karthyek Murthy , Karthik Natarajan

Users often struggle to locate an item within an information architecture, particularly when links are ambiguous or deeply nested in hierarchies. Information scent has been used to explain why users select incorrect links, but this concept…

Human-Computer Interaction · Computer Science 2026-03-13 Xiaofu Jin , Yunpeng Bai , Antti Oulasvirta

When dealing with data from distinct locations, machine learning algorithms tend to demonstrate an implicit preference of some locations over the others, which constitutes biases that sabotage the spatial fairness of the algorithm. This…

Machine Learning · Computer Science 2024-02-22 Weiye Chen , Yiqun Xie , Xiaowei Jia , Erhu He , Han Bao , Bang An , Xun Zhou

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

While sequential decision-making environments often involve high-dimensional observations, not all features of these observations are relevant for control. In particular, the observation space may capture factors of the environment which…

Machine Learning · Computer Science 2025-03-28 Alexander Levine , Peter Stone , Amy Zhang

There is growing evidence that pretrained language models improve task-specific fine-tuning not just for the languages seen in pretraining, but also for new languages and even non-linguistic data. What is the nature of this surprising…

Computation and Language · Computer Science 2021-04-20 Zhengxuan Wu , Nelson F. Liu , Christopher Potts

Rather than learning new control policies for each new task, it is possible, when tasks share some structure, to compose a "meta-policy" from previously learned policies. This paper reports results from experiments using Deep Reinforcement…

Artificial Intelligence · Computer Science 2017-11-07 Richard Liaw , Sanjay Krishnan , Animesh Garg , Daniel Crankshaw , Joseph E. Gonzalez , Ken Goldberg

In this paper, we study a transfer reinforcement learning problem where the state transitions and rewards are affected by the environmental context. Specifically, we consider a demonstrator agent that has access to a context-aware policy…

Machine Learning · Computer Science 2020-03-11 Yan Zhang , Michael M. Zavlanos

Recent work in the behavioural sciences has begun to overturn the long-held belief that human decision making is irrational, suboptimal and subject to biases. This turn to the rational suggests that human decision making may be a better…

Machine Learning · Computer Science 2020-06-09 Haiyang Chen , Hyung Jin Chang , Andrew Howes

Robust environment perception is essential for decision-making on robots operating in complex domains. Intelligent task execution requires principled treatment of uncertainty sources in a robot's observation model. This is important not…

In many stochastic service systems, decision-makers find themselves making a sequence of decisions, with the number of decisions being unpredictable. To enhance these decisions, it is crucial to uncover the causal impact these decisions…

Methodology · Statistics 2023-07-18 Juan C. David Gomez , Amy L. Cochran , Gabriel Zayas-Caban

Many important behavior changes are frictionful; they require individuals to expend effort over a long period with little immediate gratification. Here, an artificial intelligence (AI) agent can provide personalized interventions to help…

Artificial Intelligence · Computer Science 2024-01-29 Eura Nofshin , Siddharth Swaroop , Weiwei Pan , Susan Murphy , Finale Doshi-Velez

Meta-learning has proven to be successful for few-shot learning across the regression, classification, and reinforcement learning paradigms. Recent approaches have adopted Bayesian interpretations to improve gradient-based meta-learners by…

Machine Learning · Computer Science 2020-12-01 Amrith Setlur , Saket Dingliwal , Barnabas Poczos

Biological agents, such as humans and animals, are capable of making decisions out of a very large number of choices in a limited time. They can do so because they use their prior knowledge to find a solution that is not necessarily optimal…

Robotics · Computer Science 2023-08-01 Durgakant Pushp , Junhong Xu , Lantao Liu

We develop a hierarchical Bayesian dynamic game for competitive inventory and pricing under incomplete information. Two firms repeatedly choose order quantities and prices while facing two layers of uncertainty: unknown market demand and…

Methodology · Statistics 2026-03-09 Debashis Chatterjee

Recommender systems rely heavily on user feedback to learn effective user and item representations. Despite their widespread adoption, limited attention has been given to the uncertainty inherent in the feedback used to train these systems.…

Information Retrieval · Computer Science 2025-05-06 Bruno Sguerra , Viet-Anh Tran , Romain Hennequin , Manuel Moussallam

This paper introduces the concept of travel behavior embeddings, a method for re-representing discrete variables that are typically used in travel demand modeling, such as mode, trip purpose, education level, family type or occupation. This…

Econometrics · Economics 2019-09-15 Francisco C. Pereira

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu