English
Related papers

Related papers: Explanations Go Linear: Post-hoc Explainability fo…

200 papers

One approach for interpreting black-box machine learning models is to find a global approximation of the model using simple interpretable functions, which is called a metamodel (a model of the model). Approximating the black-box with a…

Machine Learning · Computer Science 2023-02-10 Mahed Abroshan , Saumitra Mishra , Mohammad Mahdi Khalili

Saliency post-hoc explainability methods are important tools for understanding increasingly complex NLP models. While these methods can reflect the model's reasoning, they may not align with human intuition, making the explanations not…

Computation and Language · Computer Science 2024-08-20 Lucas E. Resck , Marcos M. Raimundo , Jorge Poco

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

Optimizing instructions for large language models (LLMs) is critical for harnessing their full potential in complex and diverse tasks. However, relying solely on white-box approaches demands extensive computational resources and offers…

Computation and Language · Computer Science 2025-06-30 Yanwei Ren , Liu Liu , Baosheng Yu , Jiayan Qiu , Quan Chen

Post-hoc explanation methods for black-box models often struggle with faithfulness and human interpretability due to the lack of explainability in current neural architectures. Meanwhile, B-cos networks have been introduced to improve model…

Computation and Language · Computer Science 2025-12-10 Yifan Wang , Sukrut Rao , Ji-Ung Lee , Mayank Jobanputra , Vera Demberg

Prototype-based explanations offer an intuitive, example-based approach to support the interpretability of machine learning black box classifiers but often lack feature-level granularity. We introduce a framework that integrates feature…

Machine Learning · Computer Science 2026-05-22 Jacek Karolczak , Jerzy Stefanowski

In this paper, we introduce ILLUME, a unified multimodal large language model (MLLM) that seamlessly integrates multimodal understanding and generation capabilities within a single large language model through a unified next-token…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Chunwei Wang , Guansong Lu , Junwei Yang , Runhui Huang , Jianhua Han , Lu Hou , Wei Zhang , Hang Xu

As the use of deep neural networks continues to grow, understanding their behaviour has become more crucial than ever. Post-hoc explainability methods are a potential solution, but their reliability is being called into question. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Lenka Tětková , Lars Kai Hansen

Numerous algorithms have been proposed for detecting anomalies (outliers, novelties) in an unsupervised manner. Unfortunately, it is not trivial, in general, to understand why a given sample (record) is labelled as an anomaly and thus…

Machine Learning · Computer Science 2021-10-19 Nikolaos Myrtakis , Ioannis Tsamardinos , Vassilis Christophides

Recent Meta-Black-Box Optimization (MetaBBO) approaches have shown possibility of enhancing the optimization performance through learning meta-level policies to dynamically configure low-level optimizers. However, existing MetaBBO…

Machine Learning · Computer Science 2025-03-25 Zeyuan Ma , Zhiyang Huang , Jiacheng Chen , Zhiguang Cao , Yue-Jiao Gong

Explainable AI is an evolving area that deals with understanding the decision making of machine learning models so that these models are more transparent, accountable, and understandable for humans. In particular, post-hoc model-agnostic…

Machine Learning · Computer Science 2023-07-04 Praharsh Nanavati , Ranjitha Prasad

A new approach to the local and global explanation is proposed. It is based on selecting a convex hull constructed for the finite number of points around an explained instance. The convex hull allows us to consider a dual representation of…

Machine Learning · Computer Science 2024-01-30 Andrei V. Konstantinov , Boris V. Kozlov , Stanislav R. Kirpichenko , Lev V. Utkin

Counterfactual explanations offer an intuitive and straightforward way to explain black-box models and offer algorithmic recourse to individuals. To address the need for plausible explanations, existing work has primarily relied on…

Machine Learning · Computer Science 2023-12-19 Patrick Altmeyer , Mojtaba Farmanbar , Arie van Deursen , Cynthia C. S. Liem

Complex deep learning models show high prediction tasks in various clinical prediction tasks but their inherent complexity makes it more challenging to explain model predictions for clinicians and healthcare providers. Existing research on…

Machine Learning · Computer Science 2026-02-06 Sayantan Kumar , Sean C. Yu , Thomas Kannampallil , Zachary Abrams , Andrew Michelson , Philip R. O. Payne

Clinical decisions are high-stakes and require explicit justification, making model interpretability essential for auditing deep clinical models prior to deployment. As the ecosystem of model architectures and explainability methods…

Machine Learning · Computer Science 2026-03-27 Yongda Fan , John Wu , Andrea Fitzpatrick , Naveen Baskaran , Jimeng Sun , Adam Cross

Active learning has long been a topic of study in machine learning. However, as increasingly complex and opaque models have become standard practice, the process of active learning, too, has become more opaque. There has been little…

Machine Learning · Statistics 2018-06-26 Richard L. Phillips , Kyu Hyun Chang , Sorelle A. Friedler

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

Universal multimodal embedding (UME) maps heterogeneous inputs into a shared retrieval space with a single model. Recent approaches improve UME by generating explicit chain-of-thought (CoT) rationales before extracting embeddings, enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenwei He , Xiangzhao Hao , Tianyu Yang , Yuxiang Ma , Yuheng Jia , Lingxiang Wu , Chaoyang Zhao , Haiyun Guo , Jinqiao Wang

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

To verify and validate networks, it is essential to gain insight into their decisions, limitations as well as possible shortcomings of training data. In this work, we propose a post-hoc, optimization based visual explanation method, which…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Jörg Wagner , Jan Mathias Köhler , Tobias Gindele , Leon Hetzel , Jakob Thaddäus Wiedemer , Sven Behnke