English
Related papers

Related papers: Thalamocortical contribution to solving credit ass…

200 papers

Oftentimes, environments for sequential decision-making problems can be quite sparse in the provision of evaluative feedback to guide reinforcement-learning agents. In the extreme case, long trajectories of behavior are merely punctuated…

Machine Learning · Computer Science 2023-08-22 Akash Velu , Skanda Vaidyanath , Dilip Arumugam

A quantitative understanding of how sensory signals are transformed into motor outputs places useful constraints on brain function and helps reveal the brain's underlying computations. We investigate how the nematode C. elegans responds to…

Neurons and Cognition · Quantitative Biology 2020-08-18 Mochi Liu , Anuj K Sharma , Joshua W Shaevitz , Andrew M Leifer

In the rapidly evolving field of multi-agent reinforcement learning (MARL), understanding the dynamics of open systems is crucial. Openness in MARL refers to the dynam-ic nature of agent populations, tasks, and agent types with-in a system.…

Machine Learning · Computer Science 2025-11-03 Alireza Saleh Abadi , Leen-Kiat Soh

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

Machine Learning · Computer Science 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

Convolutional Neural Networks experience catastrophic forgetting when optimized on a sequence of learning problems: as they meet the objective of the current training examples, their performance on previous tasks drops drastically. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Davide Abati , Jakub Tomczak , Tijmen Blankevoort , Simone Calderara , Rita Cucchiara , Babak Ehteshami Bejnordi

The mammalian brain is a metabolically expensive device, and evolutionary pressures have presumably driven it to make productive use of its resources. For sensory areas, this concept has been expressed more formally as an optimality…

Neurons and Cognition · Quantitative Biology 2016-03-02 Deep Ganguli , Eero P. Simoncelli

Deep reinforcement Learning (DRL) offers a powerful framework for training AI agents to coordinate with human partners. However, DRL faces two critical challenges in human-AI coordination (HAIC): sparse rewards and unpredictable human…

Artificial Intelligence · Computer Science 2025-08-04 Xin Hao , Bahareh Nakisa , Mohmmad Naim Rastgoo , Gaoyang Pang

Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In this paper, we use…

Machine Learning · Computer Science 2019-03-26 Xiao Li , Calin Belta

In reinforcement learning (RL), different reward functions can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the…

Machine Learning · Computer Science 2025-02-25 Grigorii Veviurko , Wendelin Böhmer , Mathijs de Weerdt

Cooperative multi-agent policy gradient (MAPG) algorithms have recently attracted wide attention and are regarded as a general scheme for the multi-agent system. Credit assignment plays an important role in MAPG and can induce cooperation…

Machine Learning · Computer Science 2023-03-07 Wubing Chen , Wenbin Li , Xiao Liu , Shangdong Yang , Yang Gao

Deciding how to distribute work between humans and AI systems is a central challenge in organisational design. Most approaches treat this as a binary choice, yet the operational reality is richer: humans and AI routinely share tasks or take…

Artificial Intelligence · Computer Science 2026-05-19 Vicente Pelechano , Antoni Mestre , Manoli Albert , Miriam Gil

Meta-learning agents excel at rapidly learning new tasks from open-ended task distributions; yet, they forget what they learn about each task as soon as the next begins. When tasks reoccur - as they do in natural environments - metalearning…

Contextual bandit learning is a reinforcement learning problem where the learner repeatedly receives a set of features (context), takes an action and receives a reward based on the action and context. We consider this problem under a…

Machine Learning · Computer Science 2012-03-05 Alekh Agarwal , Miroslav Dudík , Satyen Kale , John Langford , Robert E. Schapire

We study the restless contextual multi-play multi-armed bandit (MP-MAB) problem for channel allocation in the opportunity spectrum access (OSA) scenario. Most existing MP-MAB methods are impractical for real-world OSA systems as they assume…

Machine Learning · Computer Science 2026-05-26 Ruiyu Li , Guangxia Li , Xiao Lu , Jichao Liu , Yan Jin

A central problem in business concerns the optimal allocation of limited resources to a set of available tasks, where the payoff of these tasks is inherently uncertain. In credit card fraud detection, for instance, a bank can only assign a…

Machine Learning · Computer Science 2022-02-10 Toon Vanderschueren , Bart Baesens , Tim Verdonck , Wouter Verbeke

Working memory is a promising paradigm for assessing cognitive ergonomics of brain states in brain-computer interfaces(BCIs). This study decodes these states with a focus on environmental illumination effects via two distinct working memory…

Neurons and Cognition · Quantitative Biology 2025-12-22 Jiajia Li , Tian Guo , Fan Li , Huichao Ding , Guozheng Xu , Jian Song

Developing reliable mechanisms for continuous local learning is a central challenge faced by biological and artificial systems. Yet, how the environmental factors and structural constraints on the learning network influence the optimal…

Neurons and Cognition · Quantitative Biology 2024-03-21 Emmanouil Giannakakis , Sina Khajehabdollahi , Anna Levina

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

Machine Learning · Computer Science 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He

Collaboration with artificial intelligence (AI) has improved human decision-making across various domains by leveraging the complementary capabilities of humans and AI. Yet, humans systematically overrely on AI advice, even when their…

Human-Computer Interaction · Computer Science 2026-05-15 Joshua Holstein , Patrick Hemmer , Gerhard Satzger , Wei Sun

Neural circuits exhibit remarkable computational flexibility, enabling adaptive responses to noisy and ever-changing environmental cues. A fundamental question in neuroscience concerns how a wide range of behaviors can emerge from a…

Statistical Mechanics · Physics 2025-09-18 Giacomo Barzon , Daniel M. Busiello , Giorgio Nicoletti