English
Related papers

Related papers: Modeling Disclosive Transparency in NLP Applicatio…

200 papers

The impressive capabilities of deep learning models are often counterbalanced by their inherent opacity, commonly termed the "black box" problem, which impedes their widespread acceptance in high-trust domains. In response, the intersecting…

Machine Learning · Computer Science 2025-09-16 Mitali Raj

Model robustness to bias is often determined by the generalization on carefully designed out-of-distribution datasets. Recent debiasing methods in natural language understanding (NLU) improve performance on such datasets by pressuring…

Computation and Language · Computer Science 2021-09-10 Michael Mendelson , Yonatan Belinkov

A central goal of explainable artificial intelligence (XAI) is to improve the trust relationship in human-AI interaction. One assumption underlying research in transparent AI systems is that explanations help to better assess predictions of…

Artificial Intelligence · Computer Science 2021-06-23 Felix Biessmann , Viktor Treu

Despite widespread calls for transparent artificial intelligence systems, the term is too overburdened with disparate meanings to express precise policy aims or to orient concrete lines of research. Consequently, stakeholders often talk…

Computers and Society · Computer Science 2023-03-10 Alex Mei , Michael Saxon , Shiyu Chang , Zachary C. Lipton , William Yang Wang

Explainability is highly-desired in Machine Learning (ML) systems supporting high-stakes policy decisions in areas such as health, criminal justice, education, and employment. While the field of explainable ML has expanded in recent years,…

Machine Learning · Computer Science 2023-02-21 Kasun Amarasinghe , Kit Rodolfa , Hemank Lamba , Rayid Ghani

While natural-language explanations from large language models (LLMs) are widely adopted to improve transparency and trust, their impact on objective human-AI team performance remains poorly understood. We identify a Persuasion Paradox:…

Human-Computer Interaction · Computer Science 2026-04-07 Ruth Cohen , Lu Feng , Ayala Bloch , Sarit Kraus

The lack of interpretability has hindered the large-scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based…

Machine Learning · Computer Science 2021-11-18 Hangcheng Dong , Bingguo Liu , Fengdong Chen , Dong Ye , Guodong Liu

Issues regarding explainable AI involve four components: users, laws & regulations, explanations and algorithms. Together these components provide a context in which explanation methods can be evaluated regarding their adequacy. The goal of…

Artificial Intelligence · Computer Science 2018-03-30 Gabrielle Ras , Marcel van Gerven , Pim Haselager

Predictive Process Monitoring (PPM) often uses deep learning models to predict the future behavior of ongoing processes, such as predicting process outcomes. While these models achieve high accuracy, their lack of interpretability…

Artificial Intelligence · Computer Science 2025-06-23 Soobin Chae , Suhwan Lee , Hanna Hauptmann , Hajo A. Reijers , Xixi Lu

Machine learning (ML) models, demonstrably powerful, suffer from a lack of interpretability. The absence of transparency, often referred to as the black box nature of ML models, undermines trust and urges the need for efforts to enhance…

Machine Learning · Computer Science 2024-06-25 Fatima Ezzeddine

Human users increasingly communicate with large language models (LLMs), but LLMs suffer from frequent overconfidence in their output, even when its accuracy is questionable, which undermines their trustworthiness and perceived legitimacy.…

Computation and Language · Computer Science 2026-02-23 Dennis Ulmer , Alexandra Lorson , Ivan Titov , Christian Hardmeier

This paper contributes with a pragmatic evaluation framework for explainable Machine Learning (ML) models for clinical decision support. The study revealed a more nuanced role for ML explanation models, when these are pragmatically embedded…

Artificial Intelligence · Computer Science 2022-12-22 Oskar Wysocki , Jessica Katharine Davies , Markel Vigo , Anne Caroline Armstrong , Dónal Landers , Rebecca Lee , André Freitas

Explainability is important for the transparency of autonomous and intelligent systems and for helping to support the development of appropriate levels of trust. There has been considerable work on developing approaches for explaining…

Artificial Intelligence · Computer Science 2025-02-17 Michael Winikoff , John Thangarajah , Sebastian Rodriguez

The increasing reliance on Deep Learning models, combined with their inherent lack of transparency, has spurred the development of a novel field of study known as eXplainable AI (XAI) methods. These methods seek to enhance the trust of…

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li

The rapid integration of artificial intelligence (AI) into various industries has introduced new challenges in governance and regulation, particularly regarding the understanding of complex AI systems. A critical demand from decision-makers…

Machine Learning · Computer Science 2024-11-08 Cristian Munoz , Kleyton da Costa , Bernardo Modenesi , Adriano Koshiyama

With the rise of increasingly powerful and user-facing NLP systems, there is growing interest in assessing whether they have a good representation of uncertainty by evaluating the quality of their predictive distribution over outcomes. We…

Computation and Language · Computer Science 2024-02-27 Joris Baan , Raquel Fernández , Barbara Plank , Wilker Aziz

Explainable machine learning offers the potential to provide stakeholders with insights into model behavior by using various methods such as feature importance scores, counterfactual explanations, or influential training data. Yet there is…

There is a disconnect between explanatory artificial intelligence (XAI) methods and the types of explanations that are useful for and demanded by society (policy makers, government officials, etc.) Questions that experts in artificial…

Artificial Intelligence · Computer Science 2019-01-23 Leilani H. Gilpin , Cecilia Testart , Nathaniel Fruchter , Julius Adebayo

The emergence of tools based on artificial intelligence has also led to the need of producing explanations which are understandable by a human being. In most approaches, the system is considered a black box, making it difficult to generate…

Artificial Intelligence · Computer Science 2024-10-23 Germán Vidal