English
Related papers

Related papers: Cite Pretrain: Retrieval-Free Knowledge Attributio…

200 papers

Large language models (LLMs) power deep research agents that synthesize information from hundreds of web sources into cited reports, yet these citations cannot be reliably verified. Current approaches either trust models to self-cite…

Computation and Language · Computer Science 2026-05-08 Hailey Onweller , Elias Lumer , Austin Huber , Pia Ramchandani , Vamse Kumar Subbiah , Corey Feld

Generating with citations is crucial for trustworthy Large Language Models (LLMs), yet even advanced LLMs often produce mismatched or irrelevant citations. Existing methods over-optimize citation fidelity while overlooking relevance to the…

Information Retrieval · Computer Science 2026-02-24 Yixing Peng , Licheng Zhang , Shancheng Fang , Yi Liu , Peijian Gu , Quan Wang

LLMs can help humans working with long documents, but are known to hallucinate. Attribution can increase trust in LLM responses: The LLM provides evidence that supports its response, which enhances verifiability. Existing approaches to…

Computation and Language · Computer Science 2024-10-24 Jan Buchmann , Xiao Liu , Iryna Gurevych

Evaluating large language models (LLMs) on question answering often relies on static benchmarks that reward memorization and understate the role of retrieval, failing to capture the dynamic nature of world knowledge. We present…

Computation and Language · Computer Science 2025-11-07 Heng Zhou , Ao Yu , Yuchen Fan , Jianing Shi , Li Kang , Hejia Geng , Yongting Zhang , Yutao Fan , Yuhao Wu , Tiancheng He , Yiran Qin , Lei Bai , Zhenfei Yin

The Retrieval-Augmented Language Model (RALM) has shown remarkable performance on knowledge-intensive tasks by incorporating external knowledge during inference, which mitigates the factual hallucinations inherited in large language models…

Computation and Language · Computer Science 2024-12-20 Yuan Xia , Jingbo Zhou , Zhenhui Shi , Jun Chen , Haifeng Huang

Citation practices are crucial in shaping the structure of scientific knowledge, yet they are often influenced by contemporary norms and biases. The emergence of Large Language Models (LLMs) introduces a new dynamic to these practices.…

Digital Libraries · Computer Science 2024-08-27 Andres Algaba , Carmen Mazijn , Vincent Holst , Floriano Tori , Sylvia Wenmackers , Vincent Ginis

Large Language Model (LLM) can enhance its credibility and verifiability by generating text with citations. However, existing research on citation generation is predominantly limited to sentence-level statements, neglecting the significance…

Computation and Language · Computer Science 2026-02-03 Yilong Xu , Jinhua Gao , Xiaoming Yu , Baolong Bi , Huawei Shen , Xueqi Cheng

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

Computation and Language · Computer Science 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Citation quality is crucial in information-seeking systems, directly influencing trust and the effectiveness of information access. Current evaluation frameworks, both human and automatic, mainly rely on Natural Language Inference (NLI) to…

Computation and Language · Computer Science 2025-06-03 Yumo Xu , Peng Qi , Jifan Chen , Kunlun Liu , Rujun Han , Lan Liu , Bonan Min , Vittorio Castelli , Arshit Gupta , Zhiguo Wang

Teaching large language models (LLMs) to generate text with citations to evidence sources can mitigate hallucinations and enhance verifiability in information-seeking systems. However, improving this capability requires high-quality…

Computation and Language · Computer Science 2024-10-18 Lei Huang , Xiaocheng Feng , Weitao Ma , Liang Zhao , Yuchun Fan , Weihong Zhong , Dongliang Xu , Qing Yang , Hongtao Liu , Bing Qin

Though current long-context large language models (LLMs) have demonstrated impressive capacities in answering user questions based on extensive text, the lack of citations in their responses makes user verification difficult, leading to…

Computation and Language · Computer Science 2024-09-11 Jiajie Zhang , Yushi Bai , Xin Lv , Wanjun Gu , Danqing Liu , Minhao Zou , Shulin Cao , Lei Hou , Yuxiao Dong , Ling Feng , Juanzi Li

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Predicting highly-cited papers is a long-standing challenge due to the complex interactions of research content, scholarly communities, and temporal dynamics. Recent advances in large language models (LLMs) raise the question of whether…

Applications · Statistics 2026-01-21 Zhanshuo Ye , Yiming Hou , Rui Pan , Tianchen Gao , Hansheng Wang

Thousands of new scientific papers are published each month. Such information overload complicates researcher efforts to stay current with the state-of-the-art as well as to verify and correctly attribute claims. We pose the following…

Computation and Language · Computer Science 2024-11-05 Ori Press , Andreas Hochlehnert , Ameya Prabhu , Vishaal Udandarao , Ofir Press , Matthias Bethge

Large Language Models (LLMs) bring transformative benefits alongside unique challenges, including intellectual property (IP) and ethical concerns. This position paper explores a novel angle to mitigate these risks, drawing parallels between…

Computation and Language · Computer Science 2024-04-02 Jie Huang , Kevin Chen-Chuan Chang

Retrieval augmentation is critical when Language Models (LMs) exploit non-parametric knowledge related to the query through external knowledge bases before reasoning. The retrieved information is incorporated into LMs as context alongside…

Information Retrieval · Computer Science 2024-11-21 Mingzhu Wang , Yuzhe Zhang , Qihang Zhao , Junyi Yang , Hong Zhang

Ensuring that Large Language Models (LLMs) generate text representative of diverse sub-populations is essential, particularly when key concepts related to under-represented groups are scarce in the training data. We address this challenge…

Computation and Language · Computer Science 2024-12-17 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their…

Computation and Language · Computer Science 2026-05-15 Zeyu Huang , Adhiguna Kuncoro , Qixuan Feng , Jiajun Shen , Lucio Dery , Arthur Szlam , Marc'Aurelio Ranzato

Large language models (LLMs) have been noted to fabricate scholarly citations, yet the scope of this behavior across providers, domains, and prompting conditions remains poorly quantified. We present one of the largest citation…

Computation and Language · Computer Science 2026-03-05 MZ Naser