English
Related papers

Related papers: Same Performance, Hidden Bias: Evaluating Hypothes…

200 papers

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren

This paper presents a hypothesis-driven approach to improve AI-supported decision-making that is based on the Evaluative AI paradigm - a conceptual framework that proposes providing users with evidence for or against a given hypothesis. We…

Artificial Intelligence · Computer Science 2025-08-28 Thao Le , Tim Miller , Liz Sonenberg , Ronal Singh , H. Peter Soyer

With a vast number of items, web-pages, and news to choose from, online services and the customers both benefit tremendously from personalized recommender systems. Such systems however provide great opportunities for targeted…

Information Retrieval · Computer Science 2015-04-16 Subhashini Krishnasamy , Rajat Sen , Sewoong Oh , Sanjay Shakkottai

There has been growing attention on fairness considerations recently, especially in the context of intelligent decision making systems. Explainable recommendation systems, in particular, may suffer from both explanation bias and performance…

Information Retrieval · Computer Science 2020-06-30 Zuohui Fu , Yikun Xian , Ruoyuan Gao , Jieyu Zhao , Qiaoying Huang , Yingqiang Ge , Shuyuan Xu , Shijie Geng , Chirag Shah , Yongfeng Zhang , Gerard de Melo

The use of Artificial Intelligence (AI), or more generally data-driven algorithms, has become ubiquitous in today's society. Yet, in many cases and especially when stakes are high, humans still make final decisions. The critical question,…

Artificial Intelligence · Computer Science 2024-10-15 Eli Ben-Michael , D. James Greiner , Melody Huang , Kosuke Imai , Zhichao Jiang , Sooahn Shin

Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systematically examine human preferences for collaborative agents. We…

Artificial Intelligence · Computer Science 2025-10-28 Lukas William Mayer , Sheer Karny , Jackie Ayoub , Miao Song , Danyang Tian , Ehsan Moradi-Pari , Mark Steyvers

This paper proposes a new approach to training recommender systems called deviation-based learning. The recommender and rational users have different knowledge. The recommender learns user knowledge by observing what action users take upon…

Theoretical Economics · Economics 2022-08-22 Junpei Komiyama , Shunya Noda

Behavioral scientists have classically documented aversion to algorithmic decision aids, from simple linear models to AI. Sentiment, however, is changing and possibly accelerating AI helper usage. AI assistance is, arguably, most valuable…

Artificial Intelligence · Computer Science 2023-07-28 Nikolos Gurney , John H. Miller , David V. Pynadath

Cognitive biases have been studied in psychology, sociology, and behavioral economics for decades. Traditionally, they have been considered a negative human trait that leads to inferior decision-making, reinforcement of stereotypes, or can…

Information Retrieval · Computer Science 2024-09-02 Markus Schedl , Oleg Lesota , Stefan Brandl , Mohammad Lotfi , Gustavo Junior Escobedo Ticona , Shahed Masoudian

AI assistance in decision-making has become popular, yet people's inappropriate reliance on AI often leads to unsatisfactory human-AI collaboration performance. In this paper, through three pre-registered, randomized human subject…

Human-Computer Interaction · Computer Science 2024-01-17 Zhuoran Lu , Dakuo Wang , Ming Yin

Artificial Intelligence (AI) has been used extensively in automatic decision making in a broad variety of scenarios, ranging from credit ratings for loans to recommendations of movies. Traditional design guidelines for AI models focus…

Artificial Intelligence · Computer Science 2018-09-27 Marisa Vasconcelos , Carlos Cardonha , Bernardo Gonçalves

The promise of human-AI teaming lies in humans and AI working together to achieve performance levels neither could accomplish alone. Effective communication between AI and humans is crucial for teamwork, enabling users to efficiently…

Human-Computer Interaction · Computer Science 2025-08-13 Tina Behzad , Nikolos Gurney , Ning Wang , David V. Pynadath

The desirable properties of explanations in information systems have fueled the demands for transparency in artificial intelligence (AI) outputs. To address these demands, the field of explainable AI (XAI) has put forth methods that can…

Human-Computer Interaction · Computer Science 2025-04-22 Felix Haag

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers…

Human-Computer Interaction · Computer Science 2022-04-06 Charvi Rastogi , Yunfeng Zhang , Dennis Wei , Kush R. Varshney , Amit Dhurandhar , Richard Tomsett

Data-driven predictions are often perceived as inaccurate in hindsight due to behavioral responses. In this study, we explore the role of interface design choices in shaping individuals' decision-making processes in response to predictions…

Human-Computer Interaction · Computer Science 2024-04-29 Dongping Zhang , Jason Hartline , Jessica Hullman

A central concern in an interactive intelligent system is optimization of its actions, to be maximally helpful to its human user. In recommender systems for instance, the action is to choose what to recommend, and the optimization task is…

Human-Computer Interaction · Computer Science 2020-05-05 Fabio Colella , Pedram Daee , Jussi Jokinen , Antti Oulasvirta , Samuel Kaski

Human decision-making is strongly influenced by cognitive biases, particularly under conditions of uncertainty and risk. While prior work has examined bias in single-step decisions with immediate outcomes and in human interaction with a…

Human-Computer Interaction · Computer Science 2026-03-25 Teerthaa Parakh , Karen M. Feigh

Recommender systems daily influence our decisions on the Internet. While considerable attention has been given to issues such as recommendation accuracy and user privacy, the long-term mutual feedback between a recommender system and the…

Information Retrieval · Computer Science 2015-08-10 An Zeng , Chi Ho Yeung , Matus Medo , Yi-Cheng Zhang

Recommender systems rely heavily on the predictive accuracy of the learning algorithm. Most work on improving accuracy has focused on the learning algorithm itself. We argue that this algorithmic focus is myopic. In particular, since…

Human-Computer Interaction · Computer Science 2018-02-22 Tobias Schnabel , Paul N. Bennett , Thorsten Joachims

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley