English
Related papers

Related papers: Learning to Explain: A Model-Agnostic Framework fo…

200 papers

Despite the significant improvements that representation learning via self-supervision has led to when learning from unlabeled data, no methods exist that explain what influences the learned representation. We address this need through our…

Many applications of data-driven models demand transparency of decisions, especially in health care, criminal justice, and other high-stakes environments. Modern trends in machine learning research have led to algorithms that are…

Machine Learning · Computer Science 2022-05-09 Zachariah Carmichael , Walter J. Scheirer

Understanding the interpretation of machine learning (ML) models has been of paramount importance when making decisions with societal impacts such as transport control, financial activities, and medical diagnosis. While current model…

Human-Computer Interaction · Computer Science 2024-05-07 Jun Yuan , Gromit Yeuk-Yin Chan , Brian Barr , Kyle Overton , Kim Rees , Luis Gustavo Nonato , Enrico Bertini , Claudio T. Silva

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

Explainable AI (XAI) has unfolded in two distinct research directions with, on the one hand, post-hoc methods that explain the predictions of a pre-trained black-box model and, on the other hand, self-explainable models (SEMs) which are…

Machine Learning · Computer Science 2024-06-06 Srishti Gautam , Ahcene Boubekki , Marina M. C. Höhne , Michael C. Kampffmeyer

With the advancement of technology for artificial intelligence (AI) based solutions and analytics compute engines, machine learning (ML) models are getting more complex day by day. Most of these models are generally used as a black box…

Machine Learning · Computer Science 2022-10-11 P. Sai Ram Aditya , Mayukha Pal

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

Most existing interpretable methods explain a black-box model in a post-hoc manner, which uses simpler models or data analysis techniques to interpret the predictions after the model is learned. However, they (a) may derive contradictory…

Machine Learning · Computer Science 2020-01-22 Mengzhuo Guo , Qingpeng Zhang , Xiuwu Liao , Daniel Dajun Zeng

LangXAI is a framework that integrates Explainable Artificial Intelligence (XAI) with advanced vision models to generate textual explanations for visual recognition tasks. Despite XAI advancements, an understanding gap persists for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Truong Thanh Hung Nguyen , Tobias Clement , Phuc Truong Loc Nguyen , Nils Kemmerzell , Van Binh Truong , Vo Thanh Khang Nguyen , Mohamed Abdelaal , Hung Cao

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

Explainable deep learning models are advantageous in many situations. Prior work mostly provide unimodal explanations through post-hoc approaches not part of the original system design. Explanation mechanisms also ignore useful textual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Varun Nagaraj Rao , Xingjian Zhen , Karen Hovsepian , Mingwei Shen

Self-explaining deep models are designed to learn the latent concept-based explanations implicitly during training, which eliminates the requirement of any post-hoc explanation generation technique. In this work, we propose one such model…

Machine Learning · Computer Science 2021-12-02 Anirban Sarkar , Deepak Vijaykeerthy , Anindya Sarkar , Vineeth N Balasubramanian

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in…

Machine Learning · Computer Science 2022-07-04 Vinitra Swamy , Bahar Radmehr , Natasa Krco , Mirko Marras , Tanja Käser

Post-hoc explanations for black box models have been studied extensively in classification and regression settings. However, explanations for models that output similarity between two inputs have received comparatively lesser attention. In…

Machine Learning · Computer Science 2022-02-03 Karthikeyan Natesan Ramamurthy , Amit Dhurandhar , Dennis Wei , Zaid Bin Tariq

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Explainability techniques for data-driven predictive models based on artificial intelligence and machine learning algorithms allow us to better understand the operation of such systems and help to hold them accountable. New transparency…

Machine Learning · Computer Science 2022-09-09 Kacper Sokol , Alexander Hepburn , Raul Santos-Rodriguez , Peter Flach

The rapid growth of AI has led to more complex deep learning models, often operating as opaque "black boxes" with limited transparency in their decision-making. This lack of interpretability poses challenges, especially in high-stakes…

Machine Learning · Computer Science 2025-02-05 Vinay Kumar Sankarapu , Chintan Chitroda , Yashwardhan Rathore , Neeraj Kumar Singh , Pratinav Seth

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

We present the Explabox: an open-source toolkit for transparent and responsible machine learning (ML) model development and usage. Explabox aids in achieving explainable, fair and robust models by employing a four-step strategy: explore,…

Machine Learning · Computer Science 2024-11-26 Marcel Robeer , Michiel Bron , Elize Herrewijnen , Riwish Hoeseni , Floris Bex