English
Related papers

Related papers: On Sample Based Explanation Methods for NLP:Effici…

200 papers

While Large Language Models (LLMs) have found success in real-world applications, their underlying explanatory process is still poorly understood. This paper proposes IBE-Eval, a framework inspired by philosophical accounts on Inference to…

Computation and Language · Computer Science 2025-03-04 Dhairya Dalal , Marco Valentino , André Freitas , Paul Buitelaar

In order to ensure the reliability of the explanations of machine learning models, it is crucial to establish their advantages and limits and in which case each of these methods outperform. However, the current understanding of when and how…

Machine Learning · Computer Science 2025-02-12 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Sonali Parbhoo , Jesse Read

Massive language models are the core of modern NLP modeling and have been shown to encode impressive amounts of commonsense and factual information. However, that knowledge exists only within the latent parameters of the model, inaccessible…

Computation and Language · Computer Science 2020-07-03 Pat Verga , Haitian Sun , Livio Baldini Soares , William W. Cohen

While deep neural networks have achieved impressive performance on a range of NLP tasks, these data-hungry models heavily rely on labeled data, which restricts their applications in scenarios where data annotation is expensive. Natural…

Computation and Language · Computer Science 2020-02-17 Ziqi Wang , Yujia Qin , Wenxuan Zhou , Jun Yan , Qinyuan Ye , Leonardo Neves , Zhiyuan Liu , Xiang Ren

Explaining the decisions of AI has become vital for fostering appropriate user trust in these systems. This paper investigates explanations for a structured prediction task called ``text-to-SQL Semantic Parsing'', which translates a natural…

Information Retrieval · Computer Science 2024-11-26 Daking Rai , Rydia R. Weiland , Kayla Margaret Gabriella Herrera , Tyler H. Shaw , Ziyu Yao

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Many current NLP systems are built from language models trained to optimize unsupervised objectives on large amounts of raw text. Under what conditions might such a procedure acquire meaning? Our systematic experiments with synthetic data…

Computation and Language · Computer Science 2023-03-07 Zhaofeng Wu , William Merrill , Hao Peng , Iz Beltagy , Noah A. Smith

Although deep models achieve high predictive performance, it is difficult for humans to understand the predictions they made. Explainability is important for real-world applications to justify their reliability. Many example-based…

Machine Learning · Statistics 2021-12-08 Tomoharu Iwata , Yuya Yoshikawa

Worked examples are step-by-step solutions to problems in a specific domain, offered to students to acquire domain-specific problem-solving skills. The effectiveness of worked examples could be enhanced by combining them with…

Human-Computer Interaction · Computer Science 2026-05-22 Arun-Balajiee Lekshmi-Narayanan , Mohammad Hassany , Peter Brusilovsky

This paper addresses the generation of explanations with visual examples. Given an input sample, we build a system that not only classifies it to a specific category, but also outputs linguistic explanations and a set of visual examples…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Atsushi Kanehira , Tatsuya Harada

With the proliferation of models for natural language processing tasks, it is even harder to understand the differences between models and their relative merits. Simply looking at differences between holistic metrics such as accuracy, BLEU,…

Computation and Language · Computer Science 2020-12-10 Jinlan Fu , Pengfei Liu , Graham Neubig

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li

We introduce a set of resampling-based methods for quantifying uncertainty and statistical precision of evaluation metrics in multilingual and/or multitask NLP benchmarks. We show how experimental variation in performance scores arises from…

Computation and Language · Computer Science 2025-12-19 Jonne Sälevä , Duygu Ataman , Constantine Lignos

Text-to-speech models trained on large-scale datasets have demonstrated impressive in-context learning capabilities and naturalness. However, control of speaker identity and style in these models typically requires conditioning on reference…

Sound · Computer Science 2024-02-08 Dan Lyth , Simon King

Neuron Interpretation has gained traction in the field of interpretability, and have provided fine-grained insights into what a model learns and how language knowledge is distributed amongst its different components. However, the lack of…

Computation and Language · Computer Science 2023-11-07 Yimin Fan , Fahim Dalvi , Nadir Durrani , Hassan Sajjad

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating methodological…

Computation and Language · Computer Science 2025-10-14 Wenqing Zhang , Trang Nguyen , Elizabeth A. Stuart , Yiqun T. Chen

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

Information Retrieval · Computer Science 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

Given the complexity of combinations of tasks, languages, and domains in natural language processing (NLP) research, it is computationally prohibitive to exhaustively test newly proposed models on each possible experimental setting. In this…

Computation and Language · Computer Science 2020-05-05 Mengzhou Xia , Antonios Anastasopoulos , Ruochen Xu , Yiming Yang , Graham Neubig

In order to oversee advanced AI systems, it is important to understand their underlying decision-making process. When prompted, large language models (LLMs) can provide natural language explanations or reasoning traces that sound plausible…

Computation and Language · Computer Science 2024-06-10 Noah Y. Siegel , Oana-Maria Camburu , Nicolas Heess , Maria Perez-Ortiz

The scale and scope of scholarly articles today are overwhelming human researchers who seek to timely digest and synthesize knowledge. In this paper, we seek to develop natural language processing (NLP) models to accelerate the speed of…

Computation and Language · Computer Science 2020-06-17 Victor Zitian Chen , Felipe Montano-Campos , Wlodek Zadrozny