English
Related papers

Related papers: MeLIME: Meaningful Local Explanation for Machine L…

200 papers

Active learning has long been a topic of study in machine learning. However, as increasingly complex and opaque models have become standard practice, the process of active learning, too, has become more opaque. There has been little…

Machine Learning · Statistics 2018-06-26 Richard L. Phillips , Kyu Hyun Chang , Sorelle A. Friedler

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

eXplainable artificial intelligence (XAI) methods have emerged to convert the black box of machine learning (ML) models into a more digestible form. These methods help to communicate how the model works with the aim of making ML models more…

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

While deep learning makes significant achievements in Artificial Intelligence (AI), the lack of transparency has limited its broad application in various vertical domains. Explainability is not only a gateway between AI and real world, but…

Machine Learning · Computer Science 2020-04-28 Sheng Shi , Yangzhou Du , Wei Fan

Explainability algorithms such as LIME have enabled machine learning systems to adopt transparency and fairness, which are important qualities in commercial use cases. However, recent work has shown that LIME's naive sampling strategy can…

Machine Learning · Computer Science 2021-03-23 Sean Saito , Eugene Chua , Nicholas Capel , Rocco Hu

Multimodal Large Language Models (MLLMs) are evaluated on various benchmarks, such as image captioning, visual question answering, and reasoning. However, many of these benchmarks include overly simple or uninformative samples, complicating…

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

Explainable artificial intelligence provides tools to better understand predictive models and their decisions, but many such methods are limited to producing insights with respect to a single class. When generating explanations for several…

Machine Learning · Computer Science 2025-02-27 Kacper Sokol , Peter Flach

The landscape in the context of several signal processing applications and even education appears to be significantly affected by the emergence of machine learning (ML) and in particular deep learning (DL).The main reason for this is the…

Signal Processing · Electrical Eng. & Systems 2023-02-07 Manish Narwaria

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Multimodal models are critical for music understanding tasks, as they capture the complex interplay between audio and lyrics. However, as these models become more prevalent, the need for explainability grows-understanding how these systems…

Recently, Logic Explained Networks (LENs) have been proposed as explainable-by-design neural models providing logic explanations for their predictions. However, these models have only been applied to vision and tabular data, and they mostly…

Computation and Language · Computer Science 2023-09-28 Rishabh Jain , Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Davide Buffelli , Pietro Lio

Predictions obtained by, e.g., artificial neural networks have a high accuracy but humans often perceive the models as black boxes. Insights about the decision making are mostly opaque for humans. Particularly understanding the decision…

Machine Learning · Computer Science 2021-01-21 Nadia Burkart , Marco F. Huber

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an…

Machine Learning · Computer Science 2019-10-03 Zijian Zhang , Fan Yang , Haofan Wang , Xia Hu

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

Machine Learning · Computer Science 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

The increasing difficulty to distinguish language-model-generated from human-written text has led to the development of detectors of machine-generated text (MGT). However, in many contexts, a black-box prediction is not sufficient, it is…

Machine Learning · Computer Science 2026-01-21 Loris Schoenegger , Yuxi Xia , Benjamin Roth