English
Related papers

Related papers: Verified Misguidance: Measuring Structural Citatio…

200 papers

Large language models (LLMs) increasingly answer queries by citing web sources, but existing evaluations emphasize answer correctness rather than evidence quality. We introduce SourceBench, a benchmark for measuring the quality of cited web…

Artificial Intelligence · Computer Science 2026-02-20 Hexi Jin , Stephen Liu , Yuheng Li , Simran Malik , Yiying Zhang

Large Language Models (LLMs) frequently hallucinate, impeding their reliability in mission-critical situations. One approach to address this issue is to provide citations to relevant sources alongside generated content, enhancing the…

Computation and Language · Computer Science 2024-07-16 Rami Aly , Zhiqiang Tang , Samson Tan , George Karypis

Large Language Model (LLM) can enhance its credibility and verifiability by generating text with citations. However, existing research on citation generation is predominantly limited to sentence-level statements, neglecting the significance…

Computation and Language · Computer Science 2026-02-03 Yilong Xu , Jinhua Gao , Xiaoming Yu , Baolong Bi , Huawei Shen , Xueqi Cheng

Enabling Large Language Models (LLMs) to generate citations in Question-Answering (QA) tasks is an emerging paradigm aimed at enhancing the verifiability of their responses when LLMs are utilizing external references to generate an answer.…

Computation and Language · Computer Science 2024-12-18 Jiajun Shen , Tong Zhou , Yubo Chen , Kang Liu

Large Language Models (LLMs) increasingly mediate access to scholarly information, yet their outputs are typically evaluated at the level of individual statements rather than knowledge structure. This paper introduces structural…

Social and Information Networks · Computer Science 2026-03-03 Moses Boudourides

The rapid advancement of large language models (LLMs) demands robust, unbiased, and scalable evaluation methods. However, human annotations are costly to scale, model-based evaluations are susceptible to stylistic biases, and…

Large language models (LLMs) are currently being used to answer medical questions across a variety of clinical domains. Recent top-performing commercial LLMs, in particular, are also capable of citing sources to support their responses. In…

Computation and Language · Computer Science 2024-02-06 Kevin Wu , Eric Wu , Ally Cassasola , Angela Zhang , Kevin Wei , Teresa Nguyen , Sith Riantawan , Patricia Shi Riantawan , Daniel E. Ho , James Zou

Fact tracing seeks to identify specific training examples that serve as the knowledge source for a given query. Existing approaches to fact tracing rely on assessing the similarity between each training sample and the query along a certain…

Computation and Language · Computer Science 2024-04-24 Si Chen , Feiyang Kang , Ning Yu , Ruoxi Jia

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs outputs, particularly in…

Computation and Language · Computer Science 2024-05-08 Danna Zheng , Danyang Liu , Mirella Lapata , Jeff Z. Pan

Large language models (LLMs) generate fluent text across a wide range of tasks, but the fabrication of non-existent academic citations remains a critical and well-documented failure mode. Building on prior work that frames hallucination and…

Computation and Language · Computer Science 2026-05-06 Junichiro Niimi

"Citizen queries" are questions asked by an individual about government policies, guidance, and services that are relevant to their circumstances, encompassing a range of topics including benefits, taxes, immigration, employment, public…

Computers and Society · Computer Science 2026-02-05 Neil Majithia , Rajat Shinde , Zo Chapman , Prajun Trital , Jordan Decker , Manil Maskey , Elena Simperl , Nigel Shadbolt

Perceived trustworthiness underpins how users navigate online information, yet it remains unclear whether large language models (LLMs),increasingly embedded in search, recommendation, and conversational systems, represent this construct in…

Artificial Intelligence · Computer Science 2026-01-19 Gerard Yeo , Svetlana Churina , Kokil Jaidka

While hallucinations of large language models could been alleviated through retrieval-augmented generation and citation generation, how the model utilizes internal knowledge is still opaque, and the trustworthiness of its generated answers…

Computation and Language · Computer Science 2025-04-22 Jiajun Shen , Tong Zhou , Yubo Chen , Delai Qiu , Shengping Liu , Kang Liu , Jun Zhao

With the advent of large language models (LLMs), managing scientific literature via LLMs has become a promising direction of research. However, existing approaches often overlook the rich structural and semantic relevance among scientific…

Social and Information Networks · Computer Science 2025-12-19 Jiasheng Zhang , Jialin Chen , Ali Maatouk , Ngoc Bui , Qianqian Xie , Leandros Tassiulas , Jie Shao , Hua Xu , Rex Ying

We introduce SciTrek, a diagnostic question-answering benchmark designed to probe long-context numerical reasoning in large language models (LLMs). Existing long-context benchmarks mostly focus on simple information retrieval, rely on…

Artificial Intelligence · Computer Science 2026-03-03 Miao Li , Alexander Gurung , Irina Saparina , Mirella Lapata

Multimodal Large Language Models (MLLMs) have advanced in integrating diverse modalities but frequently suffer from hallucination. A promising solution to mitigate this issue is to generate text with citations, providing a transparent chain…

Computation and Language · Computer Science 2025-05-21 Caiyu Hu , Yikai Zhang , Tinghui Zhu , Yiwei Ye , Yanghua Xiao

Thousands of new scientific papers are published each month. Such information overload complicates researcher efforts to stay current with the state-of-the-art as well as to verify and correctly attribute claims. We pose the following…

Computation and Language · Computer Science 2024-11-05 Ori Press , Andreas Hochlehnert , Ameya Prabhu , Vishaal Udandarao , Ofir Press , Matthias Bethge

Citation quality is crucial in information-seeking systems, directly influencing trust and the effectiveness of information access. Current evaluation frameworks, both human and automatic, mainly rely on Natural Language Inference (NLI) to…

Computation and Language · Computer Science 2025-06-03 Yumo Xu , Peng Qi , Jifan Chen , Kunlun Liu , Rujun Han , Lan Liu , Bonan Min , Vittorio Castelli , Arshit Gupta , Zhiguo Wang

Purpose. The increasing emphasis on data quantity in research infrastructures has highlighted the need for equally robust mechanisms ensuring data quality, particularly in bibliographic and citation datasets. This paper addresses the…

Digital Libraries · Computer Science 2025-04-17 Ivan Heibi , Silvio Peroni , Elia Rizzetto

As LLMs are deployed in high-stakes settings, users must judge the correctness of individual responses, often relying on model-generated justifications such as reasoning chains or explanations. Yet, no standard measure exists for whether…