English
Related papers

Related papers: On the Role of Long-tail Knowledge in Retrieval Au…

200 papers

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Long-tail question answering presents significant challenges for large language models (LLMs) due to their limited ability to acquire and accurately recall less common knowledge. Retrieval-augmented generation (RAG) systems have shown great…

Computation and Language · Computer Science 2026-02-20 Yiming Zhang , Siyue Zhang , Junbo Zhao , Chen Zhao

Retrieval-Augmented Generation (RAG) significantly improves the performance of Large Language Models (LLMs) on knowledge-intensive tasks. However, varying response quality across LLMs under RAG necessitates intelligent routing mechanisms,…

Computation and Language · Computer Science 2025-10-20 Jiarui Zhang , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Guihai Chen

Large Language Models (LLMs) often struggle with dynamically changing knowledge and handling unknown static information. Retrieval-Augmented Generation (RAG) is employed to tackle these challenges and has a significant impact on improving…

Computation and Language · Computer Science 2025-09-18 Zhen Zhang , Xinyu Wang , Yong Jiang , Zile Qiao , Zhuo Chen , Guangyu Li , Feiteng Mu , Mengting Hu , Pengjun Xie , Fei Huang

The scaling of inference computation has unlocked the potential of long-context large language models (LLMs) across diverse settings. For knowledge-intensive tasks, the increased compute is often allocated to incorporate more external…

Computation and Language · Computer Science 2025-03-04 Zhenrui Yue , Honglei Zhuang , Aijun Bai , Kai Hui , Rolf Jagerman , Hansi Zeng , Zhen Qin , Dong Wang , Xuanhui Wang , Michael Bendersky

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

The ability to form, retrieve, and reason about memories in response to stimuli serves as the cornerstone for general intelligence - shaping entities capable of learning, adaptation, and intuitive insight. Large Language Models (LLMs) have…

Computation and Language · Computer Science 2024-09-25 Brendan Hogan Rappazzo , Yingheng Wang , Aaron Ferber , Carla Gomes

The advent of large language models (LLMs) has allowed numerous applications, including the generation of queried responses, to be leveraged in chatbots and other conversational assistants. Being trained on a plethora of data, LLMs often…

Computation and Language · Computer Science 2025-05-16 Deeksha Prahlad , Chanhee Lee , Dongha Kim , Hokeun Kim

Retrieval Augmented Generation (RAG) represents a significant advancement in artificial intelligence combining a retrieval phase with a generative phase, with the latter typically being powered by large language models (LLMs). The current…

Computation and Language · Computer Science 2024-06-24 Florin Cuconasu , Giovanni Trappolini , Nicola Tonellotto , Fabrizio Silvestri

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

Computation and Language · Computer Science 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

Computation and Language · Computer Science 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Large language models like ChatGPT are increasingly used in classrooms, but they often provide outdated or fabricated information that can mislead students. Retrieval Augmented Generation (RAG) improves reliability of LLMs by grounding…

Artificial Intelligence · Computer Science 2025-09-10 Amay Jain , Liu Cui , Si Chen

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

Information Retrieval · Computer Science 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

Qualitative data collection and analysis approaches, such as those employing interviews and focus groups, provide rich insights into customer attitudes, sentiment, and behavior. However, manually analyzing qualitative data requires…

Computers and Society · Computer Science 2024-08-21 Sreyoshi Bhaduri , Satya Kapoor , Alex Gil , Anshul Mittal , Rutu Mulkar

Recent studies show that Generative Relevance Feedback (GRF), using text generated by Large Language Models (LLMs), can enhance the effectiveness of query expansion. However, LLMs can generate irrelevant information that harms retrieval…

Information Retrieval · Computer Science 2023-06-19 Iain Mackie , Ivan Sekulic , Shubham Chatterjee , Jeffrey Dalton , Fabio Crestani

This study presents a method for implementing generative AI services by utilizing the Large Language Models (LLM) application architecture. With recent advancements in generative AI technology, LLMs have gained prominence across various…

Artificial Intelligence · Computer Science 2024-01-03 Cheonsu Jeong

Retrieval-Augmented Generation (RAG) has become a widely adopted paradigm for enhancing the reliability of large language models (LLMs). However, RAG systems are sensitive to retrieval strategies that rely on text chunking to construct…

Information Retrieval · Computer Science 2026-03-31 Sun Xu , Tongkai Xu , Baiheng Xie , Li Huang , Qiang Gao , Kunpeng Zhang

The rapid growth of medical knowledge and increasing complexity of clinical practice pose challenges. In this context, large language models (LLMs) have demonstrated value; however, inherent limitations remain. Retrieval-augmented…

The efficient processing of long context poses a serious challenge for large language models (LLMs). Recently, retrieval-augmented generation (RAG) has emerged as a promising strategy for this problem, as it enables LLMs to make selective…

Computation and Language · Computer Science 2025-02-18 Kun Luo , Zheng Liu , Peitian Zhang , Hongjin Qian , Jun Zhao , Kang Liu

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li