English
Related papers

Related papers: Evaluating and Modeling Attribution for Cross-Ling…

200 papers

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular…

Computation and Language · Computer Science 2023-04-07 Zhichao Duan , Xiuxing Li , Zhengyan Zhang , Zhenyu Li , Ning Liu , Jianyong Wang

The increasing demand for the deployment of LLMs in information-seeking scenarios has spurred efforts in creating verifiable systems, which generate responses to queries along with supporting evidence. In this paper, we explore the…

Computation and Language · Computer Science 2024-07-24 Constanza Fierro , Reinald Kim Amplayo , Fantine Huot , Nicola De Cao , Joshua Maynez , Shashi Narayan , Mirella Lapata

Most evaluations of attribution methods focus on the English language. In this work, we present a multilingual approach for evaluating attribution methods for the Natural Language Inference (NLI) task in terms of faithfulness and…

Computation and Language · Computer Science 2023-06-06 Kerem Zaman , Yonatan Belinkov

Automated fact-checking systems often struggle with trustworthiness, as their generated explanations can include hallucinations. In this work, we explore evidence attribution for fact-checking explanation generation. We introduce a novel…

Computation and Language · Computer Science 2025-02-12 Rui Xing , Timothy Baldwin , Jey Han Lau

As businesses, products, and services spring up around large language models, the trustworthiness of these models hinges on the verifiability of their outputs. However, methods for explaining language model outputs largely fall across two…

Computation and Language · Computer Science 2023-11-22 Theodora Worledge , Judy Hanwen Shen , Nicole Meister , Caleb Winston , Carlos Guestrin

In the constantly evolving field of cybersecurity, it is imperative for analysts to stay abreast of the latest attack trends and pertinent information that aids in the investigation and attribution of cyber-attacks. In this work, we…

Cryptography and Security · Computer Science 2024-08-13 Sampath Rajapaksha , Ruby Rani , Erisa Karafili

Despite the widespread adoption of autoregressive language models, explainability evaluation research has predominantly focused on span infilling and masked language models. Evaluating the faithfulness of an explanation method -- how…

Computation and Language · Computer Science 2025-03-11 Sepehr Kamahi , Yadollah Yaghoobzadeh

As Large Language Models (LLMs) have reached human-like fluency and coherence, distinguishing machine-generated text (MGT) from human-written content becomes increasingly difficult. While early efforts in MGT detection have focused on…

Computation and Language · Computer Science 2025-08-05 Lucio La Cava , Dominik Macko , Róbert Móro , Ivan Srba , Andrea Tagarelli

Large Language Models (LLMs) frequently hallucinate to long-form questions, producing plausible yet factually incorrect answers. A common mitigation strategy is to provide attribution to LLM outputs. However, existing benchmarks primarily…

Computation and Language · Computer Science 2025-10-09 Yitao Long , Tiansheng Hu , Yilun Zhao , Arman Cohan , Chen Zhao

Data attribution methods quantify the influence of training data on model outputs and are becoming increasingly relevant for a wide range of LLM research and applications, including dataset curation, model interpretability, data valuation.…

Computation and Language · Computer Science 2025-10-28 Cathy Jiao , Yijun Pan , Emily Xiao , Daisy Sheng , Niket Jain , Hanzhang Zhao , Ishita Dasgupta , Jiaqi W. Ma , Chenyan Xiong

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Multilingual Natural Language Generation (NLG) is challenging due to the lack of training data for low-resource languages. However, some low-resource languages have up to tens of millions of speakers globally, making it important to improve…

Computation and Language · Computer Science 2025-10-22 Aden Haussmann

Large language models (LLMs) power deep research agents that synthesize information from hundreds of web sources into cited reports, yet these citations cannot be reliably verified. Current approaches either trust models to self-cite…

Computation and Language · Computer Science 2026-05-08 Hailey Onweller , Elias Lumer , Austin Huber , Pia Ramchandani , Vamse Kumar Subbiah , Corey Feld

Despite substantial progress in multilingual extractive Question Answering (QA), models with high and uniformly distributed performance across languages remain challenging, especially for languages with limited resources. We study…

Computation and Language · Computer Science 2023-10-02 Casimiro Pio Carrino , Carlos Escolano , José A. R. Fonollosa

Grounded text generation models often produce content that deviates from their source material, requiring user verification to ensure accuracy. Existing attribution methods associate entire sentences with source documents, which can be…

Computation and Language · Computer Science 2025-06-03 Eran Hirsch , Aviv Slobodkin , David Wan , Elias Stengel-Eskin , Mohit Bansal , Ido Dagan

Large language model (LLM) hallucinations, meaning fluent but factually incorrect generations, fall into two types: faithfulness violations, where the model misuses provided context, and factuality violations, where answers reflect errors…

Computation and Language · Computer Science 2026-05-28 Ivo Brink , Alexander Boer , Dennis Ulmer

Parametric language models (LMs), which are trained on vast amounts of web data, exhibit remarkable flexibility and capability. However, they still face practical challenges such as hallucinations, difficulty in adapting to new data…

Computation and Language · Computer Science 2024-03-06 Akari Asai , Zexuan Zhong , Danqi Chen , Pang Wei Koh , Luke Zettlemoyer , Hannaneh Hajishirzi , Wen-tau Yih

This study investigates the attribution patterns underlying Chain-of-Thought (CoT) reasoning in multilingual LLMs. While prior works demonstrate the role of CoT prompting in improving task performance, there are concerns regarding the…

Computation and Language · Computer Science 2025-11-21 Jeremias Ferrao , Ezgi Basar , Khondoker Ittehadul Islam , Mahrokh Hassani

While attribution methods, such as Shapley values, are widely used to explain the importance of features or training data in traditional machine learning, their application to Large Language Models (LLMs), particularly within…

Machine Learning · Computer Science 2025-07-08 Ikhtiyor Nematov , Tarik Kalai , Elizaveta Kuzmenko , Gabriele Fugagnoli , Dimitris Sacharidis , Katja Hose , Tomer Sagi

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren