English
Related papers

Related papers: Citation Failure: Definition, Analysis and Efficie…

200 papers

Large language models (LLMs) have emerged as versatile tools in various daily applications. However, they are fraught with issues that undermine their utility and trustworthiness. These include the incorporation of erroneous references…

Computation and Language · Computer Science 2023-09-13 Dongyub Lee , Taesun Whang , Chanhee Lee , Heuiseok Lim

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

Computation and Language · Computer Science 2026-02-12 Zhiyin Tan , Jennifer D'Souza

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

Retrieval-Augmented Generation (RAG) models are critically undermined by citation hallucinations, a deceptive failure where a model cites a source that fails to support its claim. While existing work attributes hallucination to a simple…

Computation and Language · Computer Science 2026-03-31 Maxime Dassen , Rebecca Kotula , Kenton Murray , Andrew Yates , Dawn Lawrie , Efsun Kayi , James Mayfield , Kevin Duh

Software engineers are increasingly adding semantic search capabilities to applications using a strategy known as Retrieval Augmented Generation (RAG). A RAG system involves finding documents that semantically match a query and then passing…

Software Engineering · Computer Science 2024-02-05 Scott Barnett , Stefanus Kurniawan , Srikanth Thudumu , Zach Brannelly , Mohamed Abdelrazek

Large language models (LLMs) are increasingly integrated into legal drafting and research workflows, where incorrect citations or fabricated precedents can cause serious professional harm. Existing legal benchmarks largely emphasize…

Computation and Language · Computer Science 2026-05-12 Sijia Chen , Hang Yin , Shunfan Zhou

Large language models (LLMs) show promise for automating software development by translating requirements into code. However, even advanced prompting workflows like progressive prompting often leave some requirements unmet. Although methods…

Software Engineering · Computer Science 2026-02-04 Jianru Shen , Zedong Peng , Lucy Owen

Misunderstandings arise not only in interpersonal communication but also between humans and Large Language Models (LLMs). Such discrepancies can make LLMs interpret seemingly unambiguous questions in unexpected ways, yielding incorrect…

Computation and Language · Computer Science 2024-04-22 Yihe Deng , Weitong Zhang , Zixiang Chen , Quanquan Gu

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user queries. These systems, however, remain…

Computation and Language · Computer Science 2025-05-26 Huichi Zhou , Kin-Hei Lee , Zhonghao Zhan , Yue Chen , Zhenhao Li , Zhaoyang Wang , Hamed Haddadi , Emine Yilmaz

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

Information Retrieval · Computer Science 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

Citing comprehensively and appropriately has become a challenging task with the explosive growth of scientific publications. Current citation recommendation systems aim to recommend a list of scientific papers for a given text context or a…

Information Retrieval · Computer Science 2024-03-05 Kehan Long , Shasha Li , Pancheng Wang , Chenlong Bao , Jintao Tang , Ting Wang

Large language models (LLMs) have emerged as a widely-used tool for information seeking, but their generated outputs are prone to hallucination. In this work, our aim is to allow LLMs to generate text with citations, improving their factual…

Computation and Language · Computer Science 2023-11-01 Tianyu Gao , Howard Yen , Jiatong Yu , Danqi Chen

While hallucinations of large language models could been alleviated through retrieval-augmented generation and citation generation, how the model utilizes internal knowledge is still opaque, and the trustworthiness of its generated answers…

Computation and Language · Computer Science 2025-04-22 Jiajun Shen , Tong Zhou , Yubo Chen , Delai Qiu , Shengping Liu , Kang Liu , Jun Zhao

Citation text plays a pivotal role in elucidating the connection between scientific documents, demanding an in-depth comprehension of the cited paper. Constructing citations is often time-consuming, requiring researchers to delve into…

Computation and Language · Computer Science 2024-04-23 Avinash Anand , Kritarth Prasad , Ujjwal Goel , Mohit Gupta , Naman Lal , Astha Verma , Rajiv Ratn Shah

LLMs are an integral component of retrieval-augmented generation (RAG) systems. While many studies focus on evaluating the overall quality of end-to-end RAG systems, there is a gap in understanding the appropriateness of LLMs for the RAG…

Computation and Language · Computer Science 2025-04-25 Maojia Song , Shang Hong Sim , Rishabh Bhardwaj , Hai Leong Chieu , Navonil Majumder , Soujanya Poria

Large Language Models (LLMs) have demonstrated strong potential across legal tasks, yet the problem of legal citation prediction remains under-explored. At its core, this task demands fine-grained contextual understanding and precise…

Computation and Language · Computer Science 2025-05-23 Jiuzhou Han , Paul Burgess , Ehsan Shareghi

Benchmarking modern large language models (LLMs) on complex and realistic tasks is critical to advancing their development. In this work, we evaluate the factual accuracy and citation performance of state-of-the-art LLMs on the task of…

Computation and Language · Computer Science 2024-12-25 Maya Patel , Aditi Anand

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

LongRecall. The completeness of machine-generated text, ensuring that it captures all relevant information, is crucial in domains such as medicine and law and in tasks like list-based question answering (QA), where omissions can have…

Computation and Language · Computer Science 2025-08-22 MohamamdJavad Ardestani , Ehsan Kamalloo , Davood Rafiei

Retrieval-augmented generation (RAG) systems rely on retrieval models for identifying relevant contexts and answer generation models for utilizing those contexts. However, retrievers exhibit imperfect recall and precision, limiting…

Computation and Language · Computer Science 2026-04-29 Jerry Huang , Siddarth Madala , Risham Sidhu , Cheng Niu , Hao Peng , Julia Hockenmaier , Tong Zhang