English
Related papers

Related papers: Confounding-Robust Policy Improvement with Human-A…

200 papers

On a variety of complex decision-making tasks, from doctors prescribing treatment to judges setting bail, machine learning algorithms have been shown to outperform expert human judgments. One complication, however, is that it is often…

Methodology · Statistics 2018-05-07 Jongbin Jung , Ravi Shroff , Avi Feller , Sharad Goel

The study of human-robot interaction is fundamental to the design and use of robotics in real-world applications. Robots will need to predict and adapt to the actions of human collaborators in order to achieve good performance and improve…

We develop a novel method for personalized off-policy learning in scenarios with unobserved confounding. Thereby, we address a key limitation of standard policy learning: standard policy learning assumes unconfoundedness, meaning that no…

Machine Learning · Computer Science 2026-02-18 Konstantin Hess , Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

AI systems are being deployed to support human decision making in high-stakes domains. In many cases, the human and AI form a team, in which the human makes decisions after reviewing the AI's inferences. A successful partnership requires…

Human-Computer Interaction · Computer Science 2019-06-06 Gagan Bansal , Besmira Nushi , Ece Kamar , Dan Weld , Walter Lasecki , Eric Horvitz

Recommender systems may be confounded by various types of confounding factors (also called confounders) that may lead to inaccurate recommendations and sacrificed recommendation performance. Current approaches to solving the problem usually…

Information Retrieval · Computer Science 2023-08-15 Shuyuan Xu , Juntao Tan , Shelby Heinecke , Jia Li , Yongfeng Zhang

Collaboration with artificial intelligence (AI) has improved human decision-making across various domains by leveraging the complementary capabilities of humans and AI. Yet, humans systematically overrely on AI advice, even when their…

Human-Computer Interaction · Computer Science 2026-05-15 Joshua Holstein , Patrick Hemmer , Gerhard Satzger , Wei Sun

Artificial intelligence (AI) models trained on published scientific findings have been used to invent valuable materials and targeted therapies, but they typically ignore the human scientists who continually alter the landscape of…

Artificial Intelligence · Computer Science 2023-06-05 Jamshid Sourati , James Evans

Predictive algorithms inform consequential decisions in settings with selective labels: outcomes are observed only for units selected by past decision makers. This creates an identification problem under unobserved confounding -- when…

Econometrics · Economics 2025-11-07 Ashesh Rambachan , Amanda Coston , Edward Kennedy

Unmeasured confounding is a major challenge for identifying causal relationships from non-experimental data. Here, we propose a method that can accommodate unmeasured discrete confounding. Extending recent identifiability results in deep…

Machine Learning · Computer Science 2024-08-13 Patrick Burauel , Frederick Eberhardt , Michel Besserve

Assured AI in unrestricted settings is a critical problem. Our framework addresses AI assurance challenges lying at the intersection of domain adaptation, fairness, and counterfactuals analysis, operating via the discovery and intervention…

Machine Learning · Computer Science 2021-11-19 William Paul , Philippe Burlina

Deferring systems extend supervised Machine Learning (ML) models with the possibility to defer predictions to human experts. However, evaluating the impact of a deferring strategy on system accuracy is still an overlooked area. This paper…

Machine Learning · Computer Science 2025-04-08 Filippo Palomba , Andrea Pugnana , José Manuel Alvarez , Salvatore Ruggieri

Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by…

Human-Computer Interaction · Computer Science 2024-05-09 Katelyn Morrison , Philipp Spitzer , Violet Turri , Michelle Feng , Niklas Kühl , Adam Perer

As Artificial Intelligence (AI) increasingly supports human decision-making, its vulnerability to adversarial attacks grows. However, the existing adversarial analysis predominantly focuses on fully autonomous AI systems, where decisions…

Human-Computer Interaction · Computer Science 2025-09-29 Shutong Fan , Lan Zhang , Xiaoyong Yuan

In recent years, the rapid development of AI systems has brought about the benefits of intelligent services but also concerns about security and reliability. By fostering appropriate user reliance on an AI system, both complementary team…

Artificial Intelligence · Computer Science 2025-01-22 Gaole He , Patrick Hemmer , Michael Vössing , Max Schemmer , Ujwal Gadiraju

Causal approaches to fairness have seen substantial recent interest, both from the machine learning community and from wider parties interested in ethical prediction algorithms. In no small part, this has been due to the fact that causal…

Machine Learning · Computer Science 2019-08-17 Niki Kilbertus , Philip J. Ball , Matt J. Kusner , Adrian Weller , Ricardo Silva

This position paper explores the broad landscape of AI potentiality in the context of cybersecurity, with a particular emphasis on its possible risk factors with awareness, which can be managed by incorporating human experts in the loop,…

Cryptography and Security · Computer Science 2023-10-20 Iqbal H. Sarker , Helge Janicke , Nazeeruddin Mohammad , Paul Watters , Surya Nepal

Powerful predictive AI systems have demonstrated great potential in augmenting human decision making. Recent empirical work has argued that the vision for optimal human-AI collaboration requires 'appropriate reliance' of humans on AI…

Artificial Intelligence · Computer Science 2024-09-24 Gaole He , Abri Bharos , Ujwal Gadiraju

When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as medical doctors,…

Machine Learning · Computer Science 2021-04-13 Julian Skirzyński , Frederic Becker , Falk Lieder

Unobserved confounding arises when an unmeasured feature influences both the treatment and the outcome, leading to biased causal effect estimates. This issue undermines observational studies in fields like economics, medicine, ecology or…

Machine Learning · Computer Science 2025-09-09 Alexander Merkov , David Rohde , Alexandre Gilotte , Benjamin Heymann

High-stakes applications rely on combining Artificial Intelligence (AI) and humans for responsive and reliable decision making. For example, content moderation in social media platforms often employs an AI-human pipeline to promptly remove…

Machine Learning · Computer Science 2025-08-14 Thodoris Lykouris , Wentao Weng