English
Related papers

Related papers: IROF: a low resource evaluation metric for explana…

200 papers

With the recent advances in the field of artificial intelligence, an increasing number of decision-making tasks are delegated to software systems. A key requirement for the success and adoption of such systems is that users must trust…

Artificial Intelligence · Computer Science 2020-06-17 Ingrid Nunes , Dietmar Jannach

Feature based explanations, that provide importance of each feature towards the model prediction, is arguably one of the most intuitive ways to explain a model. In this paper, we establish a novel set of evaluation criteria for such feature…

Machine Learning · Computer Science 2021-04-12 Cheng-Yu Hsieh , Chih-Kuan Yeh , Xuanqing Liu , Pradeep Ravikumar , Seungyeon Kim , Sanjiv Kumar , Cho-Jui Hsieh

Test collections are information-retrieval tools that allow researchers to quickly and easily evaluate ranking algorithms. While test collections have become an integral part of IR research, the process of data creation involves significant…

Information Retrieval · Computer Science 2025-07-15 Rikiya Takehi , Ellen M. Voorhees , Tetsuya Sakai , Ian Soboroff

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Explainability of algorithmic decision-making systems is both a regulatory objective and an area of intense research. The article argues that a crucial condition for the acceptability of algorithmic decision-making systems is that decisions…

Computers and Society · Computer Science 2026-03-03 Sarra Tajouri , Yves Meinard , Alexis Tsoukiàs , Thierry Kirat

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

The treatment of fairness in decision-making literature usually involves quantifying fairness using objective measures. This work takes a critical stance to highlight the limitations of these approaches (group fairness and individual…

Computers and Society · Computer Science 2024-07-03 Sarra Tajouri , Alexis Tsoukiàs

Biased human decisions have consequential impacts across various domains, yielding unfair treatment of individuals and resulting in suboptimal outcomes for organizations and society. In recognition of this fact, organizations regularly…

Machine Learning · Computer Science 2024-12-11 Wanxue Dong , Maria De-Arteaga , Maytal Saar-Tsechansky

The thesis explores the role machine learning methods play in creating intuitive computational models of neural processing. Combined with interpretability techniques, machine learning could replace human modeler and shift the focus of human…

Neurons and Cognition · Quantitative Biology 2020-10-20 Ilya Kuzovkin

The performance of machine learning models can be impacted by changes in data over time. A promising approach to address this challenge is invariant learning, with a particular focus on a method known as invariant risk minimization (IRM).…

Machine Learning · Computer Science 2024-04-09 Wenlu Tang , Zicheng Liu

Explanations in Machine Learning come in many forms, but a consensus regarding their desired properties is yet to emerge. In this paper we introduce a taxonomy and a set of descriptors that can be used to characterise and systematically…

Machine Learning · Computer Science 2019-12-12 Kacper Sokol , Peter Flach

Machine Learning algorithms are ubiquitous in key decision-making contexts such as justice, healthcare and finance, which has spawned a great demand for fairness in these procedures. However, the theoretical properties of such models in…

Machine Learning · Statistics 2026-01-14 Arturo Pérez-Peralta , Sandra Benítez-Peña , Rosa E. Lillo

Understanding a Reinforcement Learning (RL) policy is crucial for ensuring that autonomous agents behave according to human expectations. This goal can be achieved using Explainable Reinforcement Learning (XRL) techniques. Although textual…

Artificial Intelligence · Computer Science 2026-01-07 Ahmad Terra , Mohit Ahmed , Rafia Inam , Elena Fersman , Martin Törngren

Machine learning (ML) has seen significant growth in both popularity and importance. The high prediction accuracy of ML models is often achieved through complex black-box architectures that are difficult to interpret. This interpretability…

Machine Learning · Statistics 2024-07-29 David Köhler , David Rügamer , Matthias Schmid

Automated decision-making systems are becoming increasingly ubiquitous, which creates an immediate need for their interpretability and explainability. However, it remains unclear whether users know what insights an explanation offers and,…

Human-Computer Interaction · Computer Science 2024-09-27 Yueqing Xuan , Edward Small , Kacper Sokol , Danula Hettiachchi , Mark Sanderson

Reputation is crucial to enabling human or software agents to select among alternative providers. Although several effective reputation assessment methods exist, they typically distil reputation into a numerical representation, with no…

Artificial Intelligence · Computer Science 2020-06-17 Ingrid Nunes , Phillip Taylor , Lina Barakat , Nathan Griffiths , Simon Miles

As AI technology is increasingly applied to high-impact, high-risk domains, there have been a number of new methods aimed at making AI models more human interpretable. Despite the recent growth of interpretability work, there is a lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Sunnie S. Y. Kim , Nicole Meister , Vikram V. Ramaswamy , Ruth Fong , Olga Russakovsky

Machine-learning models have demonstrated great success in learning complex patterns that enable them to make predictions about unobserved data. In addition to using models for prediction, the ability to interpret what a model has learned…

Machine Learning · Statistics 2019-11-15 W. James Murdoch , Chandan Singh , Karl Kumbier , Reza Abbasi-Asl , Bin Yu

Current machine learning models are evaluated through behavioral snapshots, with benchmark accuracies, win rates and outcome-based metrics. Model explanations and evaluations, however, are fundamentally intertwined: understanding why a…

Computers and Society · Computer Science 2026-05-08 Isabelle Lee , Emmy Liu , Cathy Jiao , Brihi Joshi , Dani Yogatama , Fazl Barez , Michael Saxon

Operations Research (OR) relies on expert-driven modeling-a slow and fragile process ill-suited to novel scenarios. While large language models (LLMs) can automatically translate natural language into optimization models, existing…

Computation and Language · Computer Science 2026-02-05 Yifan Shi , Jialong Shi , Jiayi Wang , Ye Fan , Jianyong Sun