English
Related papers

Related papers: A Formal Framework to Characterize Interpretabilit…

200 papers

This technical report presents a general framework for parsing a variety of grammar formalisms. We develop a grammar formalism, called an Abstract Grammar, which is general enough to represent grammars at many levels of the hierarchy,…

Computation and Language · Computer Science 2018-01-22 Daniel Harasim , Chris Bruno , Eva Portelance , Martin Rohrmeier , Timothy J. O'Donnell

Formal methods were frequently shown to be effective and, perhaps because of that, practitioners are interested in using them more often. Still, these methods are far less applied than expected, particularly, in critical domains where they…

Software Engineering · Computer Science 2023-08-23 Mario Gleirscher , Jaco van de Pol , Jim Woodcock

In recent years, machine learning researchers have focused on methods to construct flexible and interpretable prediction models. However, an interpretability evaluation, a relationship between generalization performance and an…

Machine Learning · Computer Science 2019-10-08 Jinwei Zhao , Qizhou Wang , Yufei Wang , Yu Liu , Zhenghao Shi , Xinhong Hei

The lack of interpretability has hindered the large-scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based…

Machine Learning · Computer Science 2021-11-18 Hangcheng Dong , Bingguo Liu , Fengdong Chen , Dong Ye , Guodong Liu

The use of models, even if efficient, must be accompanied by an understanding at all levels of the process that transforms data (upstream and downstream). Thus, needs increase to define the relationships between individual data and the…

Machine Learning · Statistics 2022-09-02 Dimitri Delcaillau , Antoine Ly , Alize Papp , Franck Vermet

Decisions by Machine Learning (ML) models have become ubiquitous. Trusting these decisions requires understanding how algorithms take them. Hence interpretability methods for ML are an active focus of research. A central problem in this…

Machine Learning · Computer Science 2019-01-25 Philipp Schmidt , Felix Biessmann

Inner Interpretability is a promising emerging field tasked with uncovering the inner mechanisms of AI systems, though how to develop these mechanistic theories is still much debated. Moreover, recent critiques raise issues that question…

Artificial Intelligence · Computer Science 2024-08-01 Martina G. Vilas , Federico Adolfi , David Poeppel , Gemma Roig

Learning to solve long horizon temporally extended tasks with reinforcement learning has been a challenge for several years now. We believe that it is important to leverage both the hierarchical structure of complex tasks and to use expert…

Machine Learning · Computer Science 2022-10-18 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational…

Machine Learning · Computer Science 2018-06-27 Anirban Mukhopadhyay

Abstraction is a fundamental tool for reasoning about complex systems. Program abstraction has been utilized to great effect for analyzing deterministic programs. At the heart of program abstraction is the relationship between a concrete…

Artificial Intelligence · Computer Science 2017-07-17 Steven Holtzen , Todd Millstein , Guy Van den Broeck

The combination of argumentation and probability paves the way to new accounts of qualitative and quantitative uncertainty, thereby offering new theoretical and applicative opportunities. Due to a variety of interests, probabilistic…

Artificial Intelligence · Computer Science 2018-03-12 Regis Riveret , Pietro Baroni , Yang Gao , Guido Governatori , Antonino Rotolo , Giovanni Sartor

The field of machine learning has seen tremendous progress in recent years, with deep learning models delivering exceptional performance across a range of tasks. However, these models often come at the cost of interpretability, as they…

Machine Learning · Computer Science 2024-01-08 Shun Liu

Process science is a highly interdisciplinary field of research. Despite numerous proposals, process science lacks an adequate understanding of the core concepts of the field, including notions such as process, event, and system. A more…

Databases · Computer Science 2024-04-02 Peter Fettke , Wolfgang Reisig

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regarding their opacity,…

Machine Learning · Computer Science 2023-08-17 Munib Mesinovic , Peter Watkinson , Tingting Zhu

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

This paper proposes a new framework for learning a rule ensemble model that is both accurate and interpretable. A rule ensemble is an interpretable model based on the linear combination of weighted rules. In practice, we often face the…

Machine Learning · Computer Science 2023-06-21 Kentaro Kanamori

Quality aspects such as ethics, fairness, and transparency have been proven to be essential for trustworthy software systems. Explainability has been identified not only as a means to achieve all these three aspects in systems, but also as…

Software Engineering · Computer Science 2022-04-08 Larissa Chazette , Jil Klünder , Merve Balci , Kurt Schneider

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

Modelling qualitative uncertainty in formal argumentation is essential both for practical applications and theoretical understanding. Yet, most of the existing works focus on \textit{abstract} models for arguing with uncertainty. Following…

Artificial Intelligence · Computer Science 2026-02-18 Carlo Proietti , Antonio Yuste-Ginel