English
Related papers

Related papers: Optimization of Retrieval-Augmented Generation Con…

200 papers

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

This paper explores the impact of context selection on the efficiency of Large Language Models (LLMs) in generating Artificial Intelligence (AI) research leaderboards, a task defined as the extraction of (Task, Dataset, Metric, Score)…

Computation and Language · Computer Science 2024-07-03 Salomon Kabongo , Jennifer D'Souza , Sören Auer

Retrieval augmentation is critical when Language Models (LMs) exploit non-parametric knowledge related to the query through external knowledge bases before reasoning. The retrieved information is incorporated into LMs as context alongside…

Information Retrieval · Computer Science 2024-11-21 Mingzhu Wang , Yuzhe Zhang , Qihang Zhao , Junyi Yang , Hong Zhang

The integration of retrieved passages and large language models (LLMs), such as ChatGPTs, has significantly contributed to improving open-domain question answering. However, there is still a lack of exploration regarding the optimal…

Information Retrieval · Computer Science 2024-04-09 Ye Liu , Semih Yavuz , Rui Meng , Meghana Moorthy , Shafiq Joty , Caiming Xiong , Yingbo Zhou

This paper addresses the challenge of comprehending very long contexts in Large Language Models (LLMs) by proposing a method that emulates Retrieval Augmented Generation (RAG) through specialized prompt engineering and chain-of-thought…

Computation and Language · Computer Science 2025-02-19 Joon Park , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Extending the context window of large language models (LLMs) is getting popular recently, while the solution of augmenting LLMs with retrieval has existed for years. The natural questions are: i) Retrieval-augmentation versus long context…

Computation and Language · Computer Science 2024-01-24 Peng Xu , Wei Ping , Xianchao Wu , Lawrence McAfee , Chen Zhu , Zihan Liu , Sandeep Subramanian , Evelina Bakhturina , Mohammad Shoeybi , Bryan Catanzaro

Retrieval Augmented Generation (RAG) is a framework for incorporating external knowledge, usually in the form of a set of documents retrieved from a collection, as a part of a prompt to a large language model (LLM) to potentially improve…

Information Retrieval · Computer Science 2025-02-24 Fangzheng Tian , Debasis Ganguly , Craig Macdonald

Generating high-quality answers consistently by providing contextual information embedded in the prompt passed to the Large Language Model (LLM) is dependent on the quality of information retrieval. As the corpus of contextual information…

Information Retrieval · Computer Science 2024-08-01 Sai Ganesh , Anupam Purwar , Gautam B

Large language models (LLMs) have the remarkable ability to solve new tasks with just a few examples, but they need access to the right tools. Retrieval Augmented Generation (RAG) addresses this problem by retrieving a list of relevant…

Information Retrieval · Computer Science 2023-12-12 Raviteja Anantha , Tharun Bethi , Danil Vodianik , Srinivas Chappidi

This paper introduces a system that integrates large language models (LLMs) into the clinical trial retrieval process, enhancing the effectiveness of matching patients with eligible trials while maintaining information privacy and allowing…

Information Retrieval · Computer Science 2024-11-01 Georgios Peikos , Pranav Kasela , Gabriella Pasi

Reducing hallucinations in Large Language Models (LLMs) is essential for improving the accuracy of data extraction from large text corpora. Current methods, like prompt engineering and chain-of-thought prompting, focus on individual…

Artificial Intelligence · Computer Science 2026-04-03 Daniel Xie , Maxwell J. Jacobson , Adil Wazeer , Haiyan Wang , Xinghang Zhang , Yexiang Xue

Retrieval augmented generation (RAG) has been widely adopted to help Large Language Models (LLMs) to process tasks involving long documents. However, existing retrieval models are not designed for long document retrieval and fail to address…

Information Retrieval · Computer Science 2026-02-13 David Jiahao Fu , Lam Thanh Do , Jiayu Li , Kevin Chen-Chuan Chang

With the enhancement in the field of generative artificial intelligence (AI), contextual question answering has become extremely relevant. Attributing model generations to the input source document is essential to ensure trustworthiness and…

Computation and Language · Computer Science 2024-05-29 Anirudh Phukan , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami , Balaji Vasan Srinivasan

Question-answering (QA) is an important application of Information Retrieval (IR) and language models, and the latest trend is toward pre-trained large neural networks with embedding parameters. Augmenting QA performances with these LLMs…

Information Retrieval · Computer Science 2024-11-05 Lixiao Yang , Mengyang Xu , Weimao Ke

Large language models (LLMs) exhibit remarkable capabilities but often produce inaccurate responses, as they rely solely on their embedded knowledge. Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating an external…

Computation and Language · Computer Science 2024-09-25 Nitin Aravind Birur , Tanay Baswa , Divyanshu Kumar , Jatan Loya , Sahil Agarwal , Prashanth Harshangi

Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved by an Information…

In retrieval-augmented generation (RAG) question answering systems, generating citations for large language model (LLM) outputs enhances verifiability and helps users identify potential hallucinations. However, we observe two problems in…

Computation and Language · Computer Science 2025-10-21 Guo Chen , Qiuyuan Li , Qiuxian Li , Hongliang Dai , Xiang Chen , Piji Li

Sequence generation models for dialogue are known to have several problems: they tend to produce short, generic sentences that are uninformative and unengaging. Retrieval models on the other hand can surface interesting responses, but are…

Computation and Language · Computer Science 2018-09-07 Jason Weston , Emily Dinan , Alexander H. Miller

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

Machine Learning · Computer Science 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

The diminishing ability of large language models (LLMs) to effectively utilize long-range context-the "lost-in-the-middle" phenomenon-poses a significant challenge in retrieval-based LLM applications. To study the impact of this phenomenon…

Computation and Language · Computer Science 2025-11-19 Mihir Gupte , Eshan Dixit , Muhammad Tayyab , Arun Adiththan