English
Related papers

Related papers: Explaining Large Language Models with gSMILE

200 papers

This study explores the explainability capabilities of large language models (LLMs), when employed to autonomously generate machine learning (ML) solutions. We examine two classification tasks: (i) a binary classification problem focused on…

Despite the success of Large Language Models (LLMs) on various tasks following human instructions, controlling model generation at inference time poses a persistent challenge. In this paper, we introduce Ctrl-G, an adaptable framework that…

Computation and Language · Computer Science 2024-08-20 Honghua Zhang , Po-Nien Kung , Masahiro Yoshida , Guy Van den Broeck , Nanyun Peng

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Software languages evolve over time for reasons such as feature additions. When grammars evolve, textual instances that originally conformed to them may become outdated. While model-driven engineering provides many techniques for…

Software Engineering · Computer Science 2026-02-13 Weixing Zhang , Bowen Jiang , Yuhong Fu , Anne Koziolek , Regina Hebig , Daniel Strüber

Generative Pretrained Transformers (GPTs) are foundational Large Language Models (LLMs) for text generation. However, individual LLMs often produce inconsistent outputs and exhibit biases, limiting their representation of diverse language…

Computation and Language · Computer Science 2025-08-06 Mari Ashiga , Wei Jie , Fan Wu , Vardan Voskanyan , Fateme Dinmohammadi , Paul Brookes , Jingzhi Gong , Zheng Wang

The rise of large language models (LLMs) is revolutionizing information retrieval, question answering, summarization, and code generation tasks. However, in addition to confidently presenting factually inaccurate information at times (known…

Artificial Intelligence · Computer Science 2023-04-26 Henry Gilbert , Michael Sandborn , Douglas C. Schmidt , Jesse Spencer-Smith , Jules White

The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods…

Computation and Language · Computer Science 2025-08-27 Angela Yifei Yuan , Haoyi Li , Soyeon Caren Han , Christopher Leckie

In this paper, we introduce ILLUME, a unified multimodal large language model (MLLM) that seamlessly integrates multimodal understanding and generation capabilities within a single large language model through a unified next-token…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Chunwei Wang , Guansong Lu , Junwei Yang , Runhui Huang , Jianhua Han , Lu Hou , Wei Zhang , Hang Xu

Large Language Models (LLMs) demonstrate strong conversational abilities. In this Working Paper, we study them in the context of debating in two ways: their ability to perform in a structured debate along with a dataset of arguments to use…

Information Retrieval · Computer Science 2025-07-15 Anthony Miyaguchi , Conor Johnston , Aaryan Potdar

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

While Large Language Models (LLMs) have achieved strong performance across many NLP tasks, their opaque internal mechanisms hinder trustworthiness and safe deployment. Existing surveys in explainable AI largely focus on post-hoc explanation…

Computation and Language · Computer Science 2026-04-21 Yutong Gao , Qinglin Meng , Yuan Zhou , Liangming Pan

There is a growing literature on reasoning by large language models (LLMs), but the discussion on the uncertainty in their responses is still lacking. Our aim is to assess the extent of confidence that LLMs have in their answers and how it…

Computation and Language · Computer Science 2024-12-23 Yudi Pawitan , Chris Holmes

In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, GPT-4o, Claude 3.5 Sonnet, Claude 3 Opus, Gemini 1.5 Pro, Llama 3, and Llama 3.1 in solving some selected undergraduate-level…

Artificial Intelligence · Computer Science 2024-08-16 Usman Syed , Ethan Light , Xingang Guo , Huan Zhang , Lianhui Qin , Yanfeng Ouyang , Bin Hu

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

General purpose Large Language Models (LLM) such as the Generative Pretrained Transformer (GPT) and Large Language Model Meta AI (LLaMA) have attracted much attention in recent years. There is strong evidence that these models can perform…

Computation and Language · Computer Science 2024-04-25 Hossein Salami , Brandye Smith-Goettler , Vijay Yadav

Sensitive information detection is crucial in content moderation to maintain safe online communities. Assisting in this traditionally manual process could relieve human moderators from overwhelming and tedious tasks, allowing them to focus…

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

Computation and Language · Computer Science 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri