English
Related papers

Related papers: Explainable Benchmarking through the Lense of Conc…

200 papers

Predictive Process Analytics is becoming an essential aid for organizations, providing online operational support of their processes. However, process stakeholders need to be provided with an explanation of the reasons why a given process…

Reasoning is central to a wide range of intellectual activities, and while the capabilities of large language models (LLMs) continue to advance, their performance in reasoning tasks remains limited. The processes and mechanisms underlying…

Artificial Intelligence · Computer Science 2024-10-07 Ippei Fujisawa , Sensho Nobe , Hiroki Seto , Rina Onda , Yoshiaki Uchida , Hiroki Ikoma , Pei-Chun Chien , Ryota Kanai

Because high-quality data is like oxygen for AI systems, effectively eliciting information from crowdsourcing workers has become a first-order problem for developing high-performance machine learning algorithms. Two prevalent paradigms,…

Machine Learning · Computer Science 2024-02-22 Shengwei Xu , Yichi Zhang , Paul Resnick , Grant Schoenebeck

Despite the growing body of work on explainable machine learning in time series classification (TSC), it remains unclear how to evaluate different explainability methods. Resorting to qualitative assessment and user studies to evaluate…

Machine Learning · Computer Science 2023-10-24 Jacqueline Höllig , Steffen Thoma , Florian Grimm

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover…

Machine Learning · Computer Science 2024-09-26 Ahmet Kapkiç , Pratanu Mandal , Shu Wan , Paras Sheth , Abhinav Gorantla , Yoonhyuk Choi , Huan Liu , K. Selçuk Candan

Although a recent shift has been made in the field of predictive process monitoring to use models from the explainable artificial intelligence field, the evaluation still occurs mainly through performance-based metrics, thus not accounting…

Machine Learning · Computer Science 2023-08-01 Alexander Stevens , Johannes De Smedt

As recommendation is essentially a comparative (or ranking) process, a good explanation should illustrate to users why an item is believed to be better than another, i.e., comparative explanations about the recommended items. Ideally, after…

Information Retrieval · Computer Science 2022-04-26 Aobo Yang , Nan Wang , Renqin Cai , Hongbo Deng , Hongning Wang

Existing research on fairness-aware recommendation has mainly focused on the quantification of fairness and the development of fair recommendation models, neither of which studies a more substantial problem--identifying the underlying…

Information Retrieval · Computer Science 2022-06-07 Yingqiang Ge , Juntao Tan , Yan Zhu , Yinglong Xia , Jiebo Luo , Shuchang Liu , Zuohui Fu , Shijie Geng , Zelong Li , Yongfeng Zhang

Explanations in Machine Learning come in many forms, but a consensus regarding their desired properties is yet to emerge. In this paper we introduce a taxonomy and a set of descriptors that can be used to characterise and systematically…

Machine Learning · Computer Science 2019-12-12 Kacper Sokol , Peter Flach

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts…

Machine Learning · Computer Science 2022-12-08 Yuying Zhao , Yu Wang , Tyler Derr

Concept-based explanations work by mapping complex model computations to human-understandable concepts. Evaluating such explanations is very difficult, as it includes not only the quality of the induced space of possible concepts but also…

Computation and Language · Computer Science 2025-06-05 Antonin Poché , Alon Jacovi , Agustin Martin Picard , Victor Boutin , Fanny Jourdan

While there are a plethora of methods for link prediction in knowledge graphs, state-of-the-art approaches are often black box, obfuscating model reasoning and thereby limiting the ability of users to make informed decisions about model…

Machine Learning · Computer Science 2024-06-05 Niraj Kumar-Singh , Gustavo Polleti , Saee Paliwal , Rachel Hodos-Nkhereanye

Large Language Models have demonstrated remarkable capabilities in natural language processing, yet their decision-making processes often lack transparency. This opaqueness raises significant concerns regarding trust, bias, and model…

Predictive Business Process Monitoring is becoming an essential aid for organizations, providing online operational support of their processes. This paper tackles the fundamental problem of equipping predictive business process monitoring…

Machine Learning · Computer Science 2020-09-18 Riccardo Galanti , Bernat Coma-Puig , Massimiliano de Leoni , Josep Carmona , Nicolò Navarin

We present ESGBench, a benchmark dataset and evaluation framework designed to assess explainable ESG question answering systems using corporate sustainability reports. The benchmark consists of domain-grounded questions across multiple ESG…

Computation and Language · Computer Science 2025-11-21 Sherine George , Nithish Saji

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

Artificial Intelligence · Computer Science 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

Explaining deep neural networks is challenging, due to their large size and non-linearity. In this paper, we introduce a concept-based explanation method, in order to explain the prediction for an individual class, as well as contrasting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Rudolf Herdt , Daniel Otero Baguer

Explainability is one of the key ethical concepts in the design of AI systems. However, attempts to operationalize this concept thus far have tended to focus on approaches such as new software for model interpretability or guidelines with…

Computers and Society · Computer Science 2020-10-06 Ben Zevenbergen , Allison Woodruff , Patrick Gage Kelley