English
Related papers

Related papers: IROF: a low resource evaluation metric for explana…

200 papers

For randomized trials that use text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by trained human raters. This process, the current…

Methodology · Statistics 2024-08-05 Reagan Mozer , Luke Miratrix

Prior work has identified a resilient phenomenon that threatens the performance of human-AI decision-making teams: overreliance, when people agree with an AI, even when it is incorrect. Surprisingly, overreliance does not reduce when the AI…

Human-Computer Interaction · Computer Science 2023-01-30 Helena Vasconcelos , Matthew Jörke , Madeleine Grunde-McLaughlin , Tobias Gerstenberg , Michael Bernstein , Ranjay Krishna

Despite increasing interest in the field of Interpretable Machine Learning (IML), a significant gap persists between the technical objectives targeted by researchers' methods and the high-level goals of consumers' use cases. In this work,…

Machine Learning · Computer Science 2021-07-30 Valerie Chen , Jeffrey Li , Joon Sik Kim , Gregory Plumb , Ameet Talwalkar

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Artificial intelligence (AI) has huge potential to improve the health and well-being of people, but adoption in clinical practice is still limited. Lack of transparency is identified as one of the main barriers to implementation, as…

Artificial Intelligence · Computer Science 2021-01-06 Aniek F. Markus , Jan A. Kors , Peter R. Rijnbeek

While a vast collection of explainable AI (XAI) algorithms have been developed in recent years, they are often criticized for significant gaps with how humans produce and consume explanations. As a result, current XAI techniques are often…

Artificial Intelligence · Computer Science 2023-08-08 Vivian Lai , Yiming Zhang , Chacha Chen , Q. Vera Liao , Chenhao Tan

Machine Learning (ML) has been increasingly used to aid humans to make better and faster decisions. However, non-technical humans-in-the-loop struggle to comprehend the rationale behind model predictions, hindering trust in algorithmic…

Machine Learning · Computer Science 2020-12-04 Vladimir Balayan , Pedro Saleiro , Catarina Belém , Ludwig Krippahl , Pedro Bizarro

There is a growing interest within the AI research community to develop autonomous systems capable of explaining their behavior to users. One aspect of the explanation generation problem that has yet to receive much attention is the task of…

Artificial Intelligence · Computer Science 2018-02-21 Sarath Sreedharan , Siddharth Srivastava , Subbarao Kambhampati

Several explainable AI methods allow a Machine Learning user to get insights on the classification process of a black-box model in the form of local linear explanations. With such information, the user can judge which features are locally…

Machine Learning · Computer Science 2023-02-16 Francesco Lomuscio , Paolo Bajardi , Alan Perotti , Elvio G. Amparore

Benchmarking heuristic algorithms is vital to understand under which conditions and on what kind of problems certain algorithms perform well. In most current research into heuristic optimization algorithms, only a very limited number of…

Neural and Evolutionary Computing · Computer Science 2024-02-26 Niki van Stein , Diederick Vermetten , Anna V. Kononova , Thomas Bäck

Many researchers have suggested that local post-hoc explanation algorithms can be used to gain insights into the behavior of complex machine learning models. However, theoretical guarantees about such algorithms only exist for simple…

Machine Learning · Computer Science 2025-08-18 Eric Günther , Balázs Szabados , Robi Bhattacharjee , Sebastian Bordt , Ulrike von Luxburg

Machine learning based image classification algorithms, such as deep neural network approaches, will be increasingly employed in critical settings such as quality control in industry, where transparency and comprehensibility of decisions…

Machine Learning · Computer Science 2022-03-18 Dennis Müller , Michael März , Stephan Scheele , Ute Schmid

Explainability is a critical factor in enhancing the trustworthiness and acceptance of artificial intelligence (AI) in healthcare, where decisions directly impact patient outcomes. Despite advancements in AI interpretability, clear…

Artificial Intelligence · Computer Science 2025-05-15 Michail Mamalakis , Héloïse de Vareilles , Graham Murray , Pietro Lio , John Suckling

Information retrieval has long focused on ranking documents by semantic relatedness. Yet many real-world information needs demand more: enforcement of logical constraints, multi-step inference, and synthesis of multiple pieces of evidence.…

Information Retrieval · Computer Science 2026-02-04 Mohanna Hoveyda , Panagiotis Efstratiadis , Arjen de Vries , Maarten de Rijke

We present a comprehensive framework for applying rigorous statistical techniques from econometrics to analyze and improve machine learning systems. We introduce key statistical methods such as Ordinary Least Squares (OLS) regression,…

Machine Learning · Computer Science 2024-10-03 Michaël Soumm

Patients increasingly rely on online reviews when choosing healthcare providers, yet the sheer volume of these reviews can hinder effective decision-making. This paper summarises a mixed-methods study aimed at evaluating a proposed…

Computers and Society · Computer Science 2026-03-03 Eman Alamoudi , Ellis Solaiman

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts…

Machine Learning · Computer Science 2022-12-08 Yuying Zhao , Yu Wang , Tyler Derr

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

Machine Learning · Computer Science 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

Ensuring fairness of machine learning systems is a human-in-the-loop process. It relies on developers, users, and the general public to identify fairness problems and make improvements. To facilitate the process we need effective, unbiased,…

Human-Computer Interaction · Computer Science 2019-01-24 Jonathan Dodge , Q. Vera Liao , Yunfeng Zhang , Rachel K. E. Bellamy , Casey Dugan

In estimating the effects of a treatment/policy with a network, an unit is subject to two types of treatment: one is the direct treatment on the unit itself, and the other is the indirect treatment (i.e., network/spillover influence)…

Methodology · Statistics 2025-06-16 Myoung-jae Lee