English
Related papers

Related papers: Have I done enough planning or should I plan more?

200 papers

Machine learning has made major advances in categorizing objects in images, yet the best algorithms miss important aspects of how people learn and think about categories. People can learn richer concepts from fewer examples, including…

Machine Learning · Computer Science 2019-07-30 Brenden M. Lake , Steven T. Piantadosi

The bias/variance tradeoff is fundamental to learning: increasing a model's complexity can improve its fit on training data, but potentially worsens performance on future samples. Remarkably, however, the human brain effortlessly handles a…

Neurons and Cognition · Quantitative Biology 2012-10-18 David Balduzzi

We designed a grid world task to study human planning and re-planning behavior in an unknown stochastic environment. In our grid world, participants were asked to travel from a random starting point to a random goal position while…

Machine Learning · Statistics 2017-09-29 Pegah Fakhari , Arash Khodadadi , Jerome Busemeyer

Meta-learning, the notion of learning to learn, enables learning systems to quickly and flexibly solve new tasks. This usually involves defining a set of outer-loop meta-parameters that are then used to update a set of inner-loop…

Machine Learning · Computer Science 2023-03-17 Chris Lu , Sebastian Towers , Jakob Foerster

Machine learning methods adapt the parameters of a model, constrained to lie in a given model class, by using a fixed learning procedure based on data or active observations. Adaptation is done on a per-task basis, and retraining is needed…

Machine Learning · Computer Science 2021-10-22 Osvaldo Simeone , Sangwoo Park , Joonhyuk Kang

Agents that interact with other agents often do not know a priori what the other agents' strategies are, but have to maximise their own online return while interacting with and learning about others. The optimal adaptive behaviour under…

Machine Learning · Computer Science 2022-04-19 Luisa Zintgraf , Sam Devlin , Kamil Ciosek , Shimon Whiteson , Katja Hofmann

Large language models (LLMs) can achieve strong reasoning performance with sufficient computation, but they do not inherently know how much computation a task requires. We study budgeted inference-time reasoning for multiple tasks under a…

Artificial Intelligence · Computer Science 2026-01-08 Muyang Zhao , Qi Qi , Hao Sun

The Availability bias, manifested in the over-representation of extreme eventualities in decision-making, is a well-known cognitive bias, and is generally taken as evidence of human irrationality. In this work, we present the first…

Neurons and Cognition · Quantitative Biology 2018-01-31 Ardavan S. Nobandegani , Kevin da Silva Castanheira , A. Ross Otto , Thomas R. Shultz

Some of the most powerful reinforcement learning frameworks use planning for action selection. Interestingly, their planning horizon is either fixed or determined arbitrarily by the state visitation history. Here, we expand beyond the naive…

Machine Learning · Computer Science 2023-01-19 Aviv Rosenberg , Assaf Hallak , Shie Mannor , Gal Chechik , Gal Dalal

When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as medical doctors,…

Machine Learning · Computer Science 2021-04-13 Julian Skirzyński , Frederic Becker , Falk Lieder

In model-based reinforcement learning, the agent interleaves between model learning and planning. These two components are inextricably intertwined. If the model is not able to provide sensible long-term prediction, the executed planner…

Machine Learning · Statistics 2019-03-19 Nan Rosemary Ke , Amanpreet Singh , Ahmed Touati , Anirudh Goyal , Yoshua Bengio , Devi Parikh , Dhruv Batra

Despite the recent progress in deep learning and reinforcement learning, transfer and generalization of skills learned on specific tasks is very limited compared to human (or animal) intelligence. The lifelong, incremental building of…

Artificial Intelligence · Computer Science 2022-08-10 Louis Annabi

When people receive advice while making difficult decisions, they often make better decisions in the moment and also increase their knowledge in the process. However, such incidental learning can only occur when people cognitively engage…

Human-Computer Interaction · Computer Science 2022-02-14 Krzysztof Z. Gajos , Lena Mamykina

The true potential of human-AI collaboration lies in exploiting the complementary capabilities of humans and AI to achieve a joint performance superior to that of the individual AI or human, i.e., to achieve complementary team performance…

Artificial Intelligence · Computer Science 2023-10-04 Max Schemmer , Andrea Bartos , Philipp Spitzer , Patrick Hemmer , Niklas Kühl , Jonas Liebschner , Gerhard Satzger

Humans can continuously learn new knowledge. However, machine learning models suffer from drastic dropping in performance on previous tasks after learning new tasks. Cognitive science points out that the competition of similar knowledge is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Runqi Wang , Yuxiang Bao , Baochang Zhang , Jianzhuang Liu , Wentao Zhu , Guodong Guo

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

Machine Learning · Computer Science 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

In many machine learning applications, there are multiple decision-makers involved, both automated and human. The interaction between these agents often goes unaddressed in algorithmic development. In this work, we explore a simple version…

Machine Learning · Statistics 2018-09-10 David Madras , Toniann Pitassi , Richard Zemel

All biological and artificial agents must learn and make decisions given limits on their ability to process information. As such, a general theory of adaptive behavior should be able to account for the complex interactions between an…

Machine Learning · Computer Science 2023-05-08 Dilip Arumugam , Mark K. Ho , Noah D. Goodman , Benjamin Van Roy

To achieve the ambitious goals of artificial intelligence, reinforcement learning must include planning with a model of the world that is abstract in state and time. Deep learning has made progress with state abstraction, but temporal…

Deep neural networks have shown superior performance in many regimes to remember familiar patterns with large amounts of data. However, the standard supervised deep learning paradigm is still limited when facing the need to learn new…

Machine Learning · Computer Science 2018-11-16 Jing Shi , Jiaming Xu , Yiqun Yao , Bo Xu