English
Related papers

Related papers: Causal Abstraction: A Theoretical Foundation for M…

200 papers

What is it to interpret the outputs of an opaque machine learning model. One approach is to develop interpretable machine learning techniques. These techniques aim to show how machine learning models function by providing either model…

Machine Learning · Computer Science 2024-09-06 Andrew Smart , Atoosa Kasirzadeh

We argue that existing definitions of interpretability are not actionable in that they fail to inform users about general, sound, and robust interpretable model design. This makes current interpretability research fundamentally ill-posed.…

Machine Learning · Computer Science 2025-08-04 Pietro Barbiero , Mateo Espinosa Zarlenga , Alberto Termine , Mateja Jamnik , Giuseppe Marra

Causal relationships form the basis for reasoning and decision-making in Artificial Intelligence systems. To exploit the large volume of textual data available today, the automatic discovery of causal relationships from text has emerged as…

Computation and Language · Computer Science 2020-11-30 Farhad Moghimifar , Afshin Rahimi , Mahsa Baktashmotlagh , Xue Li

Artificial Intelligence models are becoming increasingly more powerful and accurate, supporting or even replacing humans' decision making. But with increased power and accuracy also comes higher complexity, making it hard for users to…

Artificial Intelligence · Computer Science 2019-07-10 Vivian S. Silva , André Freitas , Siegfried Handschuh

Interpretability research on large language models (LLMs) has yielded important insights into model behaviour, yet recurring pitfalls persist: findings that do not generalise, and causal interpretations that outrun the evidence. Our…

Machine Learning · Computer Science 2026-03-20 Shruti Joshi , Aaron Mueller , David Klindt , Wieland Brendel , Patrik Reizinger , Dhanya Sridhar

Despite their impact on the society, deep neural networks are often regarded as black-box models due to their intricate structures and the absence of explanations for their decisions. This opacity poses a significant challenge to AI systems…

Machine Learning · Computer Science 2024-07-18 Biagio La Rosa

As two sides of the same coin, causality and explainable artificial intelligence (xAI) were initially proposed and developed with different goals. However, the latter can only be complete when seen through the lens of the causality…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Pedro C. Neto , Tiago Gonçalves , João Ribeiro Pinto , Wilson Silva , Ana F. Sequeira , Arun Ross , Jaime S. Cardoso

Causal inference is a study of causal relationships between events and the statistical study of inferring these relationships through interventions and other statistical techniques. Causal reasoning is any line of work toward determining…

Software Engineering · Computer Science 2023-04-03 Patrick Chadbourne , Nasir Eisty

Mechanistic interpretability is the program of explaining what AI systems are doing in terms of their internal mechanisms. I analyze some aspects of the program, along with setting out some concrete challenges and assessing progress to…

Artificial Intelligence · Computer Science 2025-01-28 David J. Chalmers

Neural networks are growing more capable on their own, but we do not understand their neural mechanisms. Understanding these mechanisms' decision-making processes, or mechanistic interpretability, enables (1) accountability and control in…

Computation and Language · Computer Science 2026-03-02 Mason Kadem , Rong Zheng

As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models.…

Computation and Language · Computer Science 2024-03-19 Siwen Luo , Hamish Ivison , Caren Han , Josiah Poon

Causal reasoning is a cornerstone of human intelligence and a critical capability for artificial systems aiming to achieve advanced understanding and decision-making. This thesis delves into various dimensions of causal reasoning and…

Computation and Language · Computer Science 2025-04-22 Zhijing Jin

Computationally explicit hypotheses of brain function derived from machine learning (ML)-based models have recently revolutionized neuroscience. Despite the unprecedented ability of these artificial neural networks (ANNs) to capture…

Neurons and Cognition · Quantitative Biology 2023-12-12 Kohitij Kar , Simon Kornblith , Evelina Fedorenko

The interpretability of deep neural networks has attracted increasing attention in recent years, and several methods have been created to interpret the "black box" model. Fundamental limitations remain, however, that impede the pace of…

Machine Learning · Computer Science 2023-12-05 Hao Xu , Yuntian Chen , Dongxiao Zhang

A long-held objective in AI is to build systems that understand concepts in a humanlike way. Setting aside the difficulty of building such a system, even trying to evaluate one is a challenge, due to present-day AI's relative opacity and…

Artificial Intelligence · Computer Science 2022-06-29 Victor Vikram Odouard , Melanie Mitchell

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

From self-driving vehicles and back-flipping robots to virtual assistants who book our next appointment at the hair salon or at that restaurant for dinner - machine learning systems are becoming increasingly ubiquitous. The main reason for…

Machine Learning · Computer Science 2018-08-16 Milo Honegger

As Artificial Intelligence (AI) systems increasingly influence decision-making across various fields, the need to attribute responsibility for undesirable outcomes has become essential, though complicated by the complex interplay between…

Artificial Intelligence · Computer Science 2024-11-06 Yahang Qi , Bernhard Schölkopf , Zhijing Jin

Approximations during program analysis are a necessary evil, as they ensure essential properties, such as soundness and termination of the analysis, but they also imply not always producing useful results. Automatic techniques have been…

Programming Languages · Computer Science 2018-12-18 Isabel Garcia-Contreras , Jose F. Morales , Manuel V. Hermenegildo

Causality has gained popularity in recent years. It has helped improve the performance, reliability, and interpretability of machine learning models. However, recent literature on explainable artificial intelligence (XAI) has faced…

Artificial Intelligence · Computer Science 2025-07-11 Samuel Reyd , Ada Diaconescu , Jean-Louis Dessalles