English
Related papers

Related papers: Explainability for Large Language Models: A Survey

200 papers

With the advent of larger and more complex deep learning models, such as in Natural Language Processing (NLP), model qualities like explainability and interpretability, albeit highly desirable, are becoming harder challenges to tackle and…

Computation and Language · Computer Science 2024-01-30 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Conventional predictive modeling of parametric relationships in manufacturing processes is limited by the subjectivity of human expertise and intuition on the one hand and by the cost and time of experimental data generation on the other…

Computation and Language · Computer Science 2025-06-26 Kiarash Naghavi Khanghah , Anandkumar Patel , Rajiv Malhotra , Hongyi Xu

Large Language Models (LLMs) demonstrate remarkable capabilities, but their training on massive corpora poses significant risks from memorized sensitive information. To mitigate these issues and align with legal standards, unlearning has…

Computation and Language · Computer Science 2025-11-18 Ruichen Qiu , Jiajun Tan , Jiayue Pu , Honglin Wang , Xiao-Shan Gao , Fei Sun

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Explainability techniques are crucial in gaining insights into the reasons behind the predictions of deep learning models, which have not yet been applied to chemical language models. We propose an explainable AI technique that attributes…

Machine Learning · Computer Science 2023-05-29 Stefan Hödl , William Robinson , Yoram Bachrach , Wilhelm Huck , Tal Kachman

This paper investigates whether recent advances in Large Language Models (LLMs) can assist in translating human explanations into a format that can robustly support learning Linear Temporal Logic (LTL) from demonstrations. Both LLMs and…

Artificial Intelligence · Computer Science 2024-04-04 Ashutosh Gupta , John Komp , Abhay Singh Rajput , Krishna Shankaranarayanan , Ashutosh Trivedi , Namrita Varshney

Explainable AI (XAI) refers to techniques that provide human-understandable insights into the workings of AI models. Recently, the focus of XAI is being extended toward explaining Large Language Models (LLMs). This extension calls for a…

Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamental types, which is characterized by its particular-to-general thinking process and the…

Computation and Language · Computer Science 2026-04-14 Kedi Chen , Dezhao Ruan , Yuhao Dan , Yaoting Wang , Siyu Yan , Xuecheng Wu , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Biqing Qi , Linyang Li , Qipeng Guo , Xiaoming Shi , Wei Zhang

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

Large Language Models (LLMs) are known to be vulnerable to backdoor attacks, where triggers embedded in poisoned samples can maliciously alter LLMs' behaviors. In this paper, we move beyond attacking LLMs and instead examine backdoor…

Cryptography and Security · Computer Science 2025-02-18 Huaizhi Ge , Yiming Li , Qifan Wang , Yongfeng Zhang , Ruixiang Tang

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for the adaptability of…

Computation and Language · Computer Science 2024-07-12 Nicholas Kroeger , Dan Ley , Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

Large language models (LLMs) process and predict sequences containing text to answer questions, and address tasks including document summarization, providing recommendations, writing software and solving quantitative problems. We provide a…

Numerical Analysis · Mathematics 2026-02-02 Ricardo Baptista , Andrew Stuart , Son Tran

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng

Topic modelling, as a well-established unsupervised technique, has found extensive use in automatically detecting significant topics within a corpus of documents. However, classic topic modelling approaches (e.g., LDA) have certain…

Computation and Language · Computer Science 2024-03-27 Yida Mu , Chun Dong , Kalina Bontcheva , Xingyi Song

The remarkable performance of large language models (LLMs) in content generation, coding, and common-sense reasoning has spurred widespread integration into many facets of society. However, integration of LLMs raises valid questions on…

Computation and Language · Computer Science 2025-07-03 Ola Shorinwa , Zhiting Mei , Justin Lidard , Allen Z. Ren , Anirudha Majumdar

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

Computation and Language · Computer Science 2025-09-22 Yangyi Li , Mengdi Huai

Large Language Models (LLMs) have become valuable assets in mental health, showing promise in both classification tasks and counseling applications. This paper offers a perspective on using LLMs in mental health applications. It discusses…

Computation and Language · Computer Science 2023-12-19 Shaoxiong Ji , Tianlin Zhang , Kailai Yang , Sophia Ananiadou , Erik Cambria

Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and…

Computation and Language · Computer Science 2025-05-28 Moxin Li , Yong Zhao , Wenxuan Zhang , Shuaiyi Li , Wenya Xie , See-Kiong Ng , Tat-Seng Chua , Yang Deng

The era of Large Language Models (LLMs) presents a new opportunity for interpretability--agentic interpretability: a multi-turn conversation with an LLM wherein the LLM proactively assists human understanding by developing and leveraging a…

Artificial Intelligence · Computer Science 2025-06-17 Been Kim , John Hewitt , Neel Nanda , Noah Fiedel , Oyvind Tafjord

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed