English
Related papers

Related papers: FOCUS: Flexible Optimizable Counterfactual Explana…

200 papers

LLMs can be unpredictable, as even slight alterations to the prompt can cause the output to change in unexpected ways. Thus, the ability of models to accurately explain their behavior is critical, especially in high-stakes settings. One…

Computation and Language · Computer Science 2025-11-26 Marvin Limpijankit , Yanda Chen , Melanie Subbiah , Nicholas Deas , Kathleen McKeown

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Machine learning (ML) applications have automated numerous real-life tasks, improving both private and public life. However, the black-box nature of many state-of-the-art models poses the challenge of model verification; how can one be sure…

Machine Learning · Computer Science 2022-01-19 Ioannis Papantonis , Vaishak Belle

Tree ensembles, such as random forests and boosted trees, are renowned for their high prediction performance. However, their interpretability is critically limited due to the enormous complexity. In this study, we present a method to make a…

Machine Learning · Statistics 2017-03-01 Satoshi Hara , Kohei Hayashi

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical…

As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of…

Machine Learning · Computer Science 2022-12-16 Martin Pawelczyk , Chirag Agarwal , Shalmali Joshi , Sohini Upadhyay , Himabindu Lakkaraju

Recent years have witnessed a fast-growing interest in computing explanations for Machine Learning (ML) models predictions. For non-interpretable ML models, the most commonly used approaches for computing explanations are heuristic in…

Machine Learning · Computer Science 2019-07-05 Alexey Ignatiev , Nina Narodytska , Joao Marques-Silva

In recent years, explainability in machine learning has gained importance. In this context, counterfactual explanation (CE), which is an explanation method that uses examples, has attracted attention. However, it has been pointed out that…

Machine Learning · Computer Science 2025-02-04 Keita Kinjo

Ensembles of decision trees perform well on many problems, but are not interpretable. In contrast to existing approaches in interpretability that focus on explaining relationships between features and predictions, we propose an alternative…

Machine Learning · Statistics 2020-08-26 Sarah Tan , Matvey Soloviev , Giles Hooker , Martin T. Wells

Counterfactual Explanations are becoming a de-facto standard in post-hoc interpretable machine learning. For a given classifier and an instance classified in an undesired class, its counterfactual explanation corresponds to small…

Machine Learning · Computer Science 2024-01-17 Veronica Piccialli , Dolores Romero Morales , Cecilia Salvatore

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

We consider finding a counterfactual explanation for a classification or regression forest, such as a random forest. This requires solving an optimization problem to find the closest input instance to a given instance for which the forest…

Machine Learning · Computer Science 2023-03-07 Miguel Á. Carreira-Perpiñán , Suryabhan Singh Hada

The interpretability of models has become a crucial issue in Machine Learning because of algorithmic decisions' growing impact on real-world applications. Tree ensemble methods, such as Random Forests or XgBoost, are powerful learning tools…

Optimization and Control · Mathematics 2024-01-19 Giulia Di Teodoro , Marta Monaci , Laura Palagi

Counterfactual explanations are a central tool in interpretable machine learning, yet computing them exactly for complex models remains challenging. For tree ensembles, predictions are piecewise constant over a large collection of…

Machine Learning · Computer Science 2026-05-08 Awa Khouna , Julien Ferry , Thibaut Vidal

Counterfactuals are widely used to explain ML model predictions by providing alternative scenarios for obtaining the more desired predictions. They can be generated by a variety of methods that optimize different, sometimes conflicting,…

Machine Learning · Computer Science 2024-08-05 Ignacy Stępka , Mateusz Lango , Jerzy Stefanowski

The advent of Machine Learning as a Service (MLaaS) has heightened the trade-off between model explainability and security. In particular, explainability techniques, such as counterfactual explanations, inadvertently increase the risk of…

Machine Learning · Computer Science 2025-10-24 Awa Khouna , Julien Ferry , Thibaut Vidal

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

Interpretability research takes counterfactual theories of causality for granted. Most causal methods rely on counterfactual interventions to inputs or the activations of particular model components, followed by observations of the change…

Machine Learning · Computer Science 2024-07-08 Aaron Mueller

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent