English
Related papers

Related papers: Benchmarking Faithfulness: Towards Accurate Natura…

200 papers

Natural language explanations in visual question answering (VQA-NLE) aim to make black-box models more transparent by elucidating their decision-making processes. However, we find that existing VQA-NLE systems can produce inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Yahsin Yeh , Yilun Wu , Bokai Ruan , Honghan Shuai

Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing post-hoc methods…

Computation and Language · Computer Science 2023-12-22 Chengen Lai , Shengli Song , Shiqi Meng , Jingyang Li , Sitong Yan , Guangneng Hu

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

Large Language Models (LLMs) are increasingly used as powerful tools for several high-stakes natural language processing (NLP) applications. Recent prompting works claim to elicit intermediate reasoning steps and key tokens that serve as…

Computation and Language · Computer Science 2023-11-08 Sree Harsha Tanneru , Chirag Agarwal , Himabindu Lakkaraju

End-to-end neural Natural Language Processing (NLP) models are notoriously difficult to understand. This has given rise to numerous efforts towards model explainability in recent years. One desideratum of model explanation is faithfulness,…

Computation and Language · Computer Science 2024-01-17 Qing Lyu , Marianna Apidianaki , Chris Callison-Burch

Recent years have witnessed the emergence of a variety of post-hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it remains an open…

Computation and Language · Computer Science 2022-04-04 Fan Yin , Zhouxing Shi , Cho-Jui Hsieh , Kai-Wei Chang

Recent breakthroughs in NLP research, such as the advent of Transformer models have indisputably contributed to major advancements in several tasks. However, few works research robustness and explainability issues of their evaluation…

Computation and Language · Computer Science 2022-10-31 Maria Lymperaiou , George Manoliadis , Orfeas Menis Mastromichalakis , Edmund G. Dervakos , Giorgos Stamou

Prior work shows that Large Language Models (LLMs) can transform Explainable AI (XAI) outputs into Natural Language Explanations (NLEs) that score highly on quality metrics such as plausibility, coherence, and comprehensibility. But does…

Computation and Language · Computer Science 2026-05-27 Fabian Lukassen , Jan Herrmann , Christoph Weisser , Alexander Silbersdorff , Benjamin Saefken , Thomas Kneib

Large Language Models (LLMs) can generate plausible free text self-explanations to justify their answers. However, these natural language explanations may not accurately reflect the model's actual reasoning process, pinpointing a lack of…

Computation and Language · Computer Science 2026-01-30 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Sarath Chandar , Marie-Jeanne Lesot

Large language models (LLMs) often generate content with unsupported or unverifiable content, known as "hallucinations." To address this, retrieval-augmented LLMs are employed to include citations in their content, grounding the content in…

Information Retrieval · Computer Science 2024-08-23 Weijia Zhang , Mohammad Aliannejadi , Jiahuan Pei , Yifei Yuan , Jia-Hong Huang , Evangelos Kanoulas

Natural Language Explanations (NLE) aim at supplementing the prediction of a model with human-friendly natural text. Existing NLE approaches involve training separate models for each downstream task. In this work, we propose Uni-NLX, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Fawaz Sammani , Nikos Deligiannis

As Graph Neural Networks (GNNs) become more pervasive, it becomes paramount to build reliable tools for explaining their predictions. A core desideratum is that explanations are \textit{faithful}, \ie that they portray an accurate picture…

Machine Learning · Computer Science 2025-04-11 Steve Azzolin , Antonio Longa , Stefano Teso , Andrea Passerini

Large language models (LLMs) are capable of generating plausible explanations of how they arrived at an answer to a question. However, these explanations can misrepresent the model's "reasoning" process, i.e., they can be unfaithful. This,…

Computation and Language · Computer Science 2025-05-21 Katie Matton , Robert Osazuwa Ness , John Guttag , Emre Kıcıman

Natural Language Generation (NLG) has made great progress in recent years due to the development of deep learning techniques such as pre-trained language models. This advancement has resulted in more fluent, coherent and even properties…

Computation and Language · Computer Science 2022-03-11 Wei Li , Wenhao Wu , Moye Chen , Jiachen Liu , Xinyan Xiao , Hua Wu

While Large Language Models (LLMs) have found success in real-world applications, their underlying explanatory process is still poorly understood. This paper proposes IBE-Eval, a framework inspired by philosophical accounts on Inference to…

Computation and Language · Computer Science 2025-03-04 Dhairya Dalal , Marco Valentino , André Freitas , Paul Buitelaar

Natural language explanations play a fundamental role in Natural Language Inference (NLI) by revealing how premises logically entail hypotheses. Recent work has shown that the interaction of large language models (LLMs) with theorem provers…

Computation and Language · Computer Science 2025-06-02 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Natural language explanations (NLEs) are a special form of data annotation in which annotators identify rationales (most significant text tokens) when assigning labels to data instances, and write out explanations for the labels in natural…

Computation and Language · Computer Science 2020-12-17 Xinyan Zhao , V. G. Vinod Vydiswaran

As Natural Language Processing (NLP) models continue to evolve and become integral to high-stakes applications, ensuring their interpretability remains a critical challenge. Given the growing variety of explainability methods and diverse…

Computation and Language · Computer Science 2025-05-05 Mahdi Dhaini , Kafaite Zahra Hussain , Efstratios Zaradoukas , Gjergji Kasneci

Recent advancements in language and vision assistants have showcased impressive capabilities but suffer from a lack of transparency, limiting broader research and reproducibility. While open-source models handle general image tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Geewook Kim , Minjoon Seo

Vision-language models (VLMs) have made significant progress in recent visual-question-answering (VQA) benchmarks that evaluate complex visio-linguistic reasoning. However, are these models truly effective? In this work, we show that VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Baiqi Li , Zhiqiu Lin , Wenxuan Peng , Jean de Dieu Nyandwi , Daniel Jiang , Zixian Ma , Simran Khanuja , Ranjay Krishna , Graham Neubig , Deva Ramanan