English
Related papers

Related papers: A Survey on Retrieval And Structuring Augmented Ge…

200 papers

Retrieval Augmented Generation (RAG) systems often struggle with domain-specific knowledge due to performance deterioration of pre-trained embeddings and prohibitive computational costs of large language model (LLM)-based retrievers. While…

Information Retrieval · Computer Science 2025-09-15 Yao Zhao , Yantian Ding , Zhiyue Zhang , Dapeng Yao , Yanxun Xu

Retrieval-Augmented Generation (RAG) offers an effective solution to the issues faced by Large Language Models (LLMs) in hallucination generation and knowledge obsolescence by incorporating externally retrieved knowledge. However, existing…

Computation and Language · Computer Science 2025-07-01 Yongxin Xu , Ruizhe Zhang , Xinke Jiang , Yujie Feng , Yuzhen Xiao , Xinyu Ma , Runchuan Zhu , Xu Chu , Junfeng Zhao , Yasha Wang

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising…

Machine Learning · Computer Science 2025-09-23 Jialin Chen , Houyu Zhang , Seongjun Yun , Alejandro Mottini , Rex Ying , Xiang Song , Vassilis N. Ioannidis , Zheng Li , Qingjun Cui

The integration of retrieval-augmented techniques with LLMs has shown promise in improving performance across various domains. However, their utility in tasks requiring advanced reasoning, such as generating and evaluating mathematical…

Artificial Intelligence · Computer Science 2024-12-24 Majd Zayyad , Yossi Adi

Large language models record impressive performance on many natural language processing tasks. However, their knowledge capacity is limited to the pretraining corpus. Retrieval augmentation offers an effective solution by retrieving context…

Computation and Language · Computer Science 2023-11-22 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Given the growing trend of many organizations integrating Retrieval Augmented Generation (RAG) into their operations, we assess RAG on domain-specific data and test state-of-the-art models across various optimization techniques. We…

Artificial Intelligence · Computer Science 2024-11-14 Anum Afzal , Juraj Vladika , Gentrit Fazlija , Andrei Staradubets , Florian Matthes

Causality detection and mining are important tasks in information retrieval due to their enormous use in information extraction, and knowledge graph construction. To solve these tasks, in existing literature there exist several solutions --…

Computation and Language · Computer Science 2025-06-02 Thushara Manjari Naduvilakandy , Hyeju Jang , Mohammad Al Hasan

The lack of domain-specific data in the pre-training of Large Language Models (LLMs) severely limits LLM-based decision systems in specialized applications, while post-training a model in the scenarios requires significant computational…

Artificial Intelligence · Computer Science 2025-05-05 Zongyuan Li , Pengfei Li , Runnan Qi , Yanan Ni , Lumin Jiang , Hui Wu , Xuebo Zhang , Kuihua Huang , Xian Guo

The advent of Large Language Models has revolutionized information retrieval, ushering in a new era of expansive knowledge accessibility. While these models excel in providing open-world knowledge, effectively extracting answers in diverse…

Information Retrieval · Computer Science 2024-01-04 Syed Rameel Ahmad

The advent of large language models (LLMs) has allowed numerous applications, including the generation of queried responses, to be leveraged in chatbots and other conversational assistants. Being trained on a plethora of data, LLMs often…

Computation and Language · Computer Science 2025-05-16 Deeksha Prahlad , Chanhee Lee , Dongha Kim , Hokeun Kim

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Parametric language models (LMs), which are trained on vast amounts of web data, exhibit remarkable flexibility and capability. However, they still face practical challenges such as hallucinations, difficulty in adapting to new data…

Computation and Language · Computer Science 2024-03-06 Akari Asai , Zexuan Zhong , Danqi Chen , Pang Wei Koh , Luke Zettlemoyer , Hannaneh Hajishirzi , Wen-tau Yih

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

Computation and Language · Computer Science 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Large Language Models (LLMs) demonstrate remarkable capabilities in replicating human tasks and boosting productivity. However, their direct application for data extraction presents limitations due to a prioritisation of fluency over…

Computation and Language · Computer Science 2024-06-13 Aman Ahluwalia , Suhrud Wani

Current Large Language Models (LLMs) face inherent limitations due to their pre-defined context lengths, which impede their capacity for multi-hop reasoning within extensive textual contexts. While existing techniques like…

Computation and Language · Computer Science 2024-06-19 Weizhi Fei , Xueyan Niu , Guoqing Xie , Yanhua Zhang , Bo Bai , Lei Deng , Wei Han

Retrieval Augmented Generation (RAG) systems have emerged as a powerful method for enhancing large language models (LLMs) with up-to-date information. However, the retrieval step in RAG can sometimes surface documents containing…

Computation and Language · Computer Science 2025-04-02 Vignesh Gokul , Srikanth Tenneti , Alwarappan Nakkiran

Large Language Models (LLMs) have become foundational tools in artificial intelligence, supporting a wide range of applications beyond traditional natural language processing, including urban systems and tourist recommendations. However,…

Information Retrieval · Computer Science 2025-12-05 Maddalena Amendola , Chiara Pugliese , Raffaele Perego , Chiara Renso

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipeline's ability…

Artificial Intelligence · Computer Science 2026-05-25 Samuel Hildebrand , Curtis Taylor , Sean Oesch , James M Ghawaly , Amir Sadovnik , Ryan Shivers , Brandon Schreiber , Kevin Kurian

Large Language Models (LLMs) are prone to generating factually incorrect information when responding to queries that involve numerical and statistical data or other timely facts. In this paper, we present an approach for enhancing the…

Computation and Language · Computer Science 2024-09-24 Prashanth Radhakrishnan , Jennifer Chen , Bo Xu , Prem Ramaswami , Hannah Pho , Adriana Olmos , James Manyika , R. V. Guha

Retrieval Augmented Generation (RAG) improves correctness of Question Answering (QA) and addresses hallucinations in Large Language Models (LLMs), yet greatly increase computational costs. Besides, RAG is not always needed as may introduce…