English
Related papers

Related papers: Contextual Local Explanation for Black Box Classif…

200 papers

When predictive models are used to support complex and important decisions, the ability to explain a model's reasoning can increase trust, expose hidden biases, and reduce vulnerability to adversarial attacks. However, attempts at…

Machine Learning · Computer Science 2019-07-11 Dimitris Bertsimas , Arthur Delarue , Patrick Jaillet , Sebastien Martin

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Large Vision Language Models (VLMs), such as CLIP, have significantly contributed to various computer vision tasks, including object recognition and object detection. Their open vocabulary feature enhances their value. However, their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Ali Rasekh , Sepehr Kazemi Ranjbar , Milad Heidari , Wolfgang Nejdl

The ability to interpret machine learning models has become increasingly important now that machine learning is used to inform consequential decisions. We propose an approach called model extraction for interpreting complex, blackbox…

Machine Learning · Computer Science 2018-03-14 Osbert Bastani , Carolyn Kim , Hamsa Bastani

Modern time series classifiers display impressive predictive capabilities, yet their decision-making processes mostly remain black boxes to the user. At the same time, model-agnostic explainers, such as the recently proposed SHAP, promise…

Machine Learning · Computer Science 2023-11-21 Felix Mujkanovic , Vanja Doskoč , Martin Schirneck , Patrick Schäfer , Tobias Friedrich

In machine learning (ML), it is in general challenging to provide a detailed explanation on how a trained model arrives at its prediction. Thus, usually we are left with a black-box, which from a scientific standpoint is not satisfactory.…

Materials Science · Physics 2021-04-22 Luca M. Ghiringhelli

In the last years many accurate decision support systems have been constructed as black boxes, that is as systems that hide their internal logic to the user. This lack of explanation constitutes both a practical and an ethical issue. The…

Computers and Society · Computer Science 2018-06-22 Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Dino Pedreschi , Fosca Giannotti

In-context learning (ICL) has emerged as a successful paradigm for leveraging large language models (LLMs). However, it often struggles to generalize beyond the distribution of the provided demonstrations. A recent advancement in enhancing…

Computation and Language · Computer Science 2025-06-04 Ukyo Honda , Tatsushi Oka

Text classifiers built on Pre-trained Language Models (PLMs) have achieved remarkable progress in various tasks including sentiment analysis, natural language inference, and question-answering. However, the occurrence of uncertain…

Computation and Language · Computer Science 2023-06-07 Jiazheng Li , Zhaoyue Sun , Bin Liang , Lin Gui , Yulan He

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of achieving the…

Machine Learning · Computer Science 2020-02-14 Gabriel Terejanu , Jawad Chowdhury , Rezaur Rashid , Asif Chowdhury

Active learning has long been a topic of study in machine learning. However, as increasingly complex and opaque models have become standard practice, the process of active learning, too, has become more opaque. There has been little…

Machine Learning · Statistics 2018-06-26 Richard L. Phillips , Kyu Hyun Chang , Sorelle A. Friedler

We present a novel method - LIBRE - to learn an interpretable classifier, which materializes as a set of Boolean rules. LIBRE uses an ensemble of bottom-up weak learners operating on a random subset of features, which allows for the…

Machine Learning · Computer Science 2019-11-18 Graziano Mita , Paolo Papotti , Maurizio Filippone , Pietro Michiardi

The ubiquity of machine learning based predictive models in modern society naturally leads people to ask how trustworthy those models are? In predictive modeling, it is quite common to induce a trade-off between accuracy and…

Machine Learning · Computer Science 2019-04-05 John Mitros , Brian Mac Namee

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in…

Machine Learning · Computer Science 2022-07-04 Vinitra Swamy , Bahar Radmehr , Natasa Krco , Mirko Marras , Tanja Käser

Hydrocarbon prospect risking is a critical application in geophysics predicting well outcomes from a variety of data including geological, geophysical, and other information modalities. Traditional routines require interpreters to go…

Machine Learning · Computer Science 2022-12-16 Ahmad Mustafa , Ghassan AlRegib

In many high-risk machine learning applications it is essential for a model to indicate when it is uncertain about a prediction. While large language models (LLMs) can reach and even surpass human-level accuracy on a variety of benchmarks,…

Computation and Language · Computer Science 2024-06-06 Evan Becker , Stefano Soatto

Algorithms are powerful and necessary tools behind a large part of the information we use every day. However, they may introduce new sources of bias, discrimination and other unfair practices that affect people who are unaware of it.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Francesco Ventura , Tania Cerquitelli