English
Related papers

Related papers: Credit Assignment: Challenges and Opportunities in…

200 papers

Measuring GUI task difficulty is crucial for user behavior analysis and agent capability evaluation. Yet, existing benchmarks typically quantify difficulty based on motor actions (e.g., step counts), overlooking the cognitive demands…

Human-Computer Interaction · Computer Science 2025-11-13 Yiwen Yin , Zhian Hu , Xiaoxi Xu , Chun Yu , Xintong Wu , Wenyu Fan , Yuanchun Shi

Credit assignment in Meta-reinforcement learning (Meta-RL) is still poorly understood. Existing methods either neglect credit assignment to pre-adaptation behavior or implement it naively. This leads to poor sample-efficiency during…

Machine Learning · Computer Science 2022-02-14 Jonas Rothfuss , Dennis Lee , Ignasi Clavera , Tamim Asfour , Pieter Abbeel

Imitation Learning (IL) is an appealing approach to learn desirable autonomous behavior. However, directing IL to achieve arbitrary goals is difficult. In contrast, planning-based algorithms use dynamics models and reward functions to…

Machine Learning · Computer Science 2019-10-02 Nicholas Rhinehart , Rowan McAllister , Sergey Levine

This paper explores the integration of Explainable Automated Machine Learning (AutoML) in the realm of financial engineering, specifically focusing on its application in credit decision-making. The rapid evolution of Artificial Intelligence…

Risk Management · Quantitative Finance 2024-02-07 Marc Schmitt

Reinforcement learning for multi-step reasoning with large language models (LLMs) typically relies on sparse terminal rewards, which creates a poorly conditioned credit-assignment problem: the final feedback is propagated uniformly across…

Machine Learning · Computer Science 2026-05-26 Fei Ding , Yongkang Zhang , youwei wang , Zijian Zeng

When people receive advice while making difficult decisions, they often make better decisions in the moment and also increase their knowledge in the process. However, such incidental learning can only occur when people cognitively engage…

Human-Computer Interaction · Computer Science 2022-02-14 Krzysztof Z. Gajos , Lena Mamykina

Cognitive functions in current artificial intelligence networks are tied to the exponential increase in network scale, whereas the human brain can continuously learn hundreds of cognitive functions with remarkably low energy consumption.…

Artificial Intelligence · Computer Science 2025-04-09 Bing Han , Feifei Zhao , Yinqian Sun , Wenxuan Pan , Yi Zeng

Causal models provide rich descriptions of complex systems as sets of mechanisms by which each variable is influenced by its direct causes. They support reasoning about manipulating parts of the system and thus hold promise for addressing…

Machine Learning · Computer Science 2024-06-21 Julius von Kügelgen

Continual learning addresses the problem of continuously acquiring and transferring knowledge without catastrophic forgetting of old concepts. While humans achieve continual learning via diverse neurocognitive mechanisms, there is a…

Machine Learning · Computer Science 2023-12-07 Xiaoqian Liu , Junge Zhang , Mingyi Zhang , Peipei Yang

Behavioural cloning has been extensively used to train agents and is recognized as a fast and solid approach to teach general behaviours based on expert trajectories. Such method follows the supervised learning paradigm and it strongly…

Artificial Intelligence · Computer Science 2022-01-20 Federico Malato , Joona Jehkonen , Ville Hautamäki

When a student fails an exam, do we tend to blame their effort or the test's difficulty? Attribution, defined as how reasons are assigned to event outcomes, shapes perceptions, reinforces stereotypes, and influences decisions. Attribution…

Computation and Language · Computer Science 2026-04-30 Chahat Raj , Mahika Banerjee , Jinhao Pan , Aylin Caliskan , Antonios Anastasopoulos , Ziwei Zhu

Decision support systems enhanced by Artificial Intelligence (AI) are increasingly being used in high-stakes scenarios where errors or biased outcomes can have significant consequences. In this work, we explore the conditions under which…

Human-Computer Interaction · Computer Science 2025-05-20 Marina Estévez-Almenzar , Ricardo Baeza-Yates , Carlos Castillo

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

Artificial Intelligence · Computer Science 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

Recent advances in machine learning have made it possible to train artificially intelligent agents that perform with super-human accuracy on a great diversity of complex tasks. However, the process of training these capabilities often…

Machine Learning · Computer Science 2021-10-27 Daniel Weitekamp , Christopher MacLellan , Erik Harpstead , Kenneth Koedinger

Learning motor skills for sports or performance driving is often done with professional instruction from expert human teachers, whose availability is limited. Our goal is to enable automated teaching via a learned model that interacts with…

Animal brains evolved to optimize behavior in dynamically changing environments, selecting actions that maximize future rewards. A large body of experimental work indicates that such optimization changes the wiring of neural circuits,…

Neurons and Cognition · Quantitative Biology 2021-04-06 Mien Brabeeba Wang , Michael M. Halassa

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

Machine Learning · Computer Science 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

Consider a scenario in which we have a huge labeled dataset ${\cal D}$ and a limited time to train some given learner using ${\cal D}$. Since we may not be able to use the whole dataset, how should we proceed? Questions of this nature…

Machine Learning · Computer Science 2022-02-07 Sergio Filho , Eduardo Laber , Pedro Lazera , Marco Molinaro

AI-assisted decision making becomes increasingly prevalent, yet individuals often fail to utilize AI-based decision aids appropriately especially when the AI explanations are absent, potentially as they do not %understand reflect on AI's…

Human-Computer Interaction · Computer Science 2025-02-18 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ziang Xiao , Ming Yin

Learning for animals or humans is the process that leads to behaviors better adapted to the environment. This process highly depends on the individual that learns and is usually observed only through the individual's actions. This article…

Machine Learning · Statistics 2025-02-20 Julien Aubert , Louis Köhler , Luc Lehéricy , Giulia Mezzadri , Patricia Reynaud-Bouret