English
Related papers

Related papers: Improving Human Sequential Decision-Making with Re…

200 papers

As AI becomes more prevalent throughout society, effective methods of integrating humans and AI systems that leverage their respective strengths and mitigate risk have become an important priority. In this paper, we introduce the paradigm…

Machine Learning · Computer Science 2023-10-24 Jiayi Wang , Zhengling Qi , Chengchun Shi

When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as medical doctors,…

Machine Learning · Computer Science 2021-04-13 Julian Skirzyński , Frederic Becker , Falk Lieder

Most artificial intelligence models have limiting ability to solve new tasks faster, without forgetting previously acquired knowledge. The recently emerging paradigm of continual learning aims to solve this issue, in which the model learns…

Machine Learning · Computer Science 2018-06-01 Ju Xu , Zhanxing Zhu

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

Training automated agents to complete complex tasks in interactive environments is challenging: reinforcement learning requires careful hand-engineering of reward functions, imitation learning requires specialized infrastructure and access…

Machine Learning · Computer Science 2023-02-21 Olivia Watkins , Trevor Darrell , Pieter Abbeel , Jacob Andreas , Abhishek Gupta

A central concern in an interactive intelligent system is optimization of its actions, to be maximally helpful to its human user. In recommender systems for instance, the action is to choose what to recommend, and the optimization task is…

Human-Computer Interaction · Computer Science 2020-05-05 Fabio Colella , Pedram Daee , Jussi Jokinen , Antti Oulasvirta , Samuel Kaski

Imagine if AI decision-support tools not only complemented our ability to make accurate decisions, but also improved our skills, boosted collaboration, and elevated the joy we derive from our tasks. Despite the potential to optimize a broad…

Human-Computer Interaction · Computer Science 2024-04-16 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Susan A. Murphy , Krzysztof Z. Gajos

We study reinforcement learning from human feedback in general Markov decision processes, where agents learn from trajectory-level preference comparisons. A central challenge in this setting is to design algorithms that select informative…

Machine Learning · Computer Science 2025-12-05 Andreas Schlaginhaufen , Reda Ouhamma , Maryam Kamgarpour

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

Algorithms are used to aid human decision makers by making predictions and recommending decisions. Currently, these algorithms are trained to optimize prediction accuracy. What if they were optimized to control final decisions? In this…

Artificial Intelligence · Computer Science 2023-03-27 Ruqing Xu , Sarah Dean

In order to speed-up classification models when facing a large number of categories, one usual approach consists in organizing the categories in a particular structure, this structure being then used as a way to speed-up the prediction…

Machine Learning · Computer Science 2015-11-26 Aurélia Léon , Ludovic Denoyer

The field of reinforcement learning offers a large variety of concepts and methods to tackle sequential decision-making problems. This variety has become so large that choosing an algorithm for a task at hand can be challenging. In this…

AI systems increasingly assist human decision making by producing preliminary assessments of complex inputs. However, such AI-generated assessments can often be noisy or systematically biased, raising a central question: how should costly…

Machine Learning · Statistics 2026-03-17 Lezhi Tan , Naomi Sagan , Lihua Lei , Jose Blanchet

Autocomplete suggestions are fundamental to modern text entry systems, with applications in domains such as messaging and email composition. Typically, autocomplete suggestions are generated from a language model with a confidence…

Computation and Language · Computer Science 2024-06-18 Rohan Chitnis , Shentao Yang , Alborz Geramifard

One explanation for how people can plan efficiently despite limited cognitive resources is that we possess a set of adaptive planning strategies and know when and how to use them. But how are these strategies acquired? While previous…

Artificial Intelligence · Computer Science 2024-12-05 Ruiqi He , Falk Lieder

Humans rely more and more on systems with AI components. The AI community typically treats human inputs as a given and optimizes AI models only. This thinking is one-sided and it neglects the fact that humans can learn, too. In this work,…

Human-Computer Interaction · Computer Science 2020-09-22 Johannes Schneider

AI systems are increasingly used to assist humans in sequential decision-making tasks, yet determining when and how an AI assistant should intervene remains a fundamental challenge. A potential baseline is to recommend the optimal action…

Artificial Intelligence · Computer Science 2026-04-17 Saumik Narayanan , Raja Panjwani , Siddhartha Sen , Chien-Ju Ho

Reinforcement learning (RL) requires skillful definition and remarkable computational efforts to solve optimization and control problems, which could impair its prospect. Introducing human guidance into reinforcement learning is a promising…

Machine Learning · Computer Science 2022-11-30 Jingda Wu , Zhiyu Huang , Wenhui Huang , Chen Lv

This paper adds to the efforts of evolutionary ethics to naturalize morality by providing specific insights derived from a computational ethics view. We propose a stylized model of human decision-making, which is based on Reinforcement…

Computers and Society · Computer Science 2023-07-24 Eduardo C. Garrido-Merchán , Sara Lumbreras-Sancho

Artificial Intelligence is being employed by humans to collaboratively solve complicated tasks for search and rescue, manufacturing, etc. Efficient teamwork can be achieved by understanding user preferences and recommending different…

Information Retrieval · Computer Science 2023-01-20 Lakshita Dodeja , Pradyumna Tambwekar , Erin Hedlund-Botti , Matthew Gombolay