English
Related papers

Related papers: LLMs for Explainable AI: A Comprehensive Survey

200 papers

Large Language Models (LLMs) are playing an increasingly important role in physics research by assisting with symbolic manipulation, numerical computation, and scientific reasoning. However, ensuring the reliability, transparency, and…

Artificial Intelligence · Computer Science 2025-08-19 Yinggan Xu , Hana Kimlee , Yijia Xiao , Di Luo

Interpretable machine learning aims to provide transparent models whose decision-making processes can be readily understood by humans. Recent advances in rule-based approaches, such as expressive Boolean formulas (BoolXAI), offer faithful…

Artificial Intelligence · Computer Science 2026-05-13 Du Cheng , Serdar Kadioglu , Xin Wang

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

Large Language Models (LLMs) are increasingly used to translate the technical outputs of eXplainable Artificial Intelligence (XAI) methods into accessible natural-language explanations. However, existing approaches often lack guarantees of…

Large language models (LLMs) have led to breakthroughs in language tasks, yet the internal mechanisms that enable their remarkable generalization and reasoning abilities remain opaque. This lack of transparency presents challenges such as…

Computation and Language · Computer Science 2024-04-17 Haiyan Zhao , Fan Yang , Bo Shen , Himabindu Lakkaraju , Mengnan Du

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

Machine Learning · Computer Science 2024-04-04 Anna Kruspe

Over the last few years there has been rapid research growth into eXplainable Artificial Intelligence (XAI) and the closely aligned Interpretable Machine Learning (IML). Drivers for this growth include recent legislative changes and…

Artificial Intelligence · Computer Science 2021-07-08 Richard Dazeley , Peter Vamplew , Cameron Foale , Charlotte Young , Sunil Aryal , Francisco Cruz

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

Large language models have exhibited impressive performance across a broad range of downstream tasks in natural language processing. However, how a language model predicts the next token and generates content is not generally understandable…

The era of Large Language Models (LLMs) presents a new opportunity for interpretability--agentic interpretability: a multi-turn conversation with an LLM wherein the LLM proactively assists human understanding by developing and leveraging a…

Artificial Intelligence · Computer Science 2025-06-17 Been Kim , John Hewitt , Neel Nanda , Noah Fiedel , Oyvind Tafjord

Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of…

Human-Computer Interaction · Computer Science 2026-05-25 Laura R. Marusich , Mary Grace Kozuch Dhooghe , Jonathan Z. Bakdash , Murat Kantarcioglu

EXplainable machine learning (XML) has recently emerged to address the mystery mechanisms of machine learning (ML) systems by interpreting their 'black box' results. Despite the development of various explanation methods, determining the…

Human-Computer Interaction · Computer Science 2025-03-03 Bo Wang , Yiqiao Li , Jianlong Zhou , Fang Chen

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

In recent years, machine learning (ML) has become a key enabling technology for the sciences and industry. Especially through improvements in methodology, the availability of large databases and increased computational power, today's ML…

Artificial Intelligence · Computer Science 2019-09-27 Wojciech Samek , Klaus-Robert Müller

While Large Language Models (LLMs) have achieved strong performance across many NLP tasks, their opaque internal mechanisms hinder trustworthiness and safe deployment. Existing surveys in explainable AI largely focus on post-hoc explanation…

Computation and Language · Computer Science 2026-04-21 Yutong Gao , Qinglin Meng , Yuan Zhou , Liangming Pan

The rise of large language models (LLMs) has revolutionized the way that we interact with artificial intelligence systems through natural language. However, LLMs often misinterpret user queries because of their uncertain intention, leading…

Computation and Language · Computer Science 2024-02-07 Jing-Cheng Pang , Heng-Bo Fan , Pengyuan Wang , Jia-Hao Xiao , Nan Tang , Si-Hang Yang , Chengxing Jia , Sheng-Jun Huang , Yang Yu

Although large language models (LLMs) have demonstrated impressive potential on simple tasks, their breadth of scope, lack of transparency, and insufficient controllability can make them less effective when assisting humans on more complex…

Human-Computer Interaction · Computer Science 2022-03-21 Tongshuang Wu , Michael Terry , Carrie J. Cai

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

Computation and Language · Computer Science 2024-06-12 Sylvio Barbon Junior , Paolo Ceravolo , Sven Groppe , Mustafa Jarrar , Samira Maghool , Florence Sèdes , Soror Sahri , Maurice Van Keulen

Artificial Intelligence (AI) is rapidly expanding and integrating more into daily life to automate tasks, guide decision making, and enhance efficiency. However, complex AI models, which make decisions without providing clear explanations…

Software Engineering · Computer Science 2025-09-03 Lakshit Arora , Sanjay Surendranath Girija , Shashank Kapoor , Aman Raj , Dipen Pradhan , Ankit Shetgaonkar

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique