English
Related papers

Related papers: IRB: Automated Generation of Robust Factuality Ben…

200 papers

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-Augmented Generation (RAG) has emerged as a standard framework for knowledge-intensive NLP tasks, combining large language models (LLMs) with document retrieval from external corpora. Despite its widespread use, most RAG pipelines…

Information Retrieval · Computer Science 2025-08-26 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

Risk and Quality (R&Q) assurance in highly regulated industries requires constant navigation of complex regulatory frameworks, with employees handling numerous daily queries demanding accurate policy interpretation. Traditional methods…

Incident response (IR) requires fast, coordinated, and well-informed decision-making to contain and mitigate cyber threats. While large language models (LLMs) have shown promise as autonomous agents in simulated IR settings, their reasoning…

Computation and Language · Computer Science 2025-10-07 Zefang Liu , Arman Anwar

Large language models (LLMs) with retrieval augmented-generation (RAG) have been the optimal choice for scalable generative AI solutions in the recent past. Although RAG implemented with AI agents (agentic-RAG) has been recently…

Artificial Intelligence · Computer Science 2024-11-19 Sohini Roychowdhury , Marko Krema , Anvar Mahammad , Brian Moore , Arijit Mukherjee , Punit Prakashchandra

Retrieval-augmented generation (RAG) combines document retrieval with large language models to produce responses grounded in external evidence. While several R packages support core components of RAG workflows, integrated evaluation of RAG…

Computation · Statistics 2026-04-28 Muhammad Aimal Rehman , Zhili Lu , Chi-Kuang Yeh

Reliably determining the performance of Retrieval-Augmented Generation (RAG) systems depends on comprehensive test questions. While a proliferation of evaluation frameworks for LLM-powered applications exists, current practices lack a…

Machine Learning · Computer Science 2025-10-02 Noah Broestl , Adel Nasser Abdalla , Rajprakash Bale , Hersh Gupta , Max Struever

This paper presents EasyRAG, a simple, lightweight, and efficient retrieval-augmented generation framework for automated network operations. Our framework has three advantages. The first is accurate question answering. We designed a…

Computation and Language · Computer Science 2024-10-16 Zhangchi Feng , Dongdong Kuang , Zhongyuan Wang , Zhijie Nie , Yaowei Zheng , Richong Zhang

As the legal community increasingly examines the use of large language models (LLMs) for various legal applications, legal AI developers have turned to retrieval-augmented LLMs ("RAG" systems) to improve system performance and robustness.…

Computation and Language · Computer Science 2025-05-08 Lucia Zheng , Neel Guha , Javokhir Arifov , Sarah Zhang , Michal Skreta , Christopher D. Manning , Peter Henderson , Daniel E. Ho

Large Language Models (LLMs) are increasingly used in software development to generate functions, such as attack detectors, that implement security requirements. A key challenge is ensuring the LLMs have enough knowledge to address specific…

Software Engineering · Computer Science 2025-09-18 Samuele Pasini , Jinhan Kim , Tommaso Aiello , Rocio Cabrera Lozoya , Antonino Sabetta , Paolo Tonella

Retrieval Augmented Generation (RAG) systems have emerged as a powerful method for enhancing large language models (LLMs) with up-to-date information. However, the retrieval step in RAG can sometimes surface documents containing…

Computation and Language · Computer Science 2025-04-02 Vignesh Gokul , Srikanth Tenneti , Alwarappan Nakkiran

Evaluating retrieval-augmented generation (RAG) systems traditionally relies on hand annotations for input queries, passages to retrieve, and responses to generate. We introduce ARES, an Automated RAG Evaluation System, for evaluating RAG…

Computation and Language · Computer Science 2024-04-02 Jon Saad-Falcon , Omar Khattab , Christopher Potts , Matei Zaharia

Accurate multi-modal document retrieval is crucial for Retrieval-Augmented Generation (RAG), yet existing benchmarks do not fully capture real-world challenges with their current design. We introduce REAL-MM-RAG, an automatically generated…

Information Retrieval · Computer Science 2025-02-19 Navve Wasserman , Roi Pony , Oshri Naparstek , Adi Raz Goldfarb , Eli Schwartz , Udi Barzelay , Leonid Karlinsky

Retrieval-Augmented Generation (RAG) is a critical technique for grounding Large Language Models (LLMs) in factual evidence, yet evaluating RAG systems in specialized, safety-critical domains remains a significant challenge. Existing…

Computation and Language · Computer Science 2025-11-07 Joshua Gao , Quoc Huy Pham , Subin Varghese , Silwal Saurav , Vedhus Hoskere

We present IBR, an Iterative Backward Reasoning model to solve the proof generation tasks on rule-based Question Answering (QA), where models are required to reason over a series of textual rules and facts to find out the related proof path…

Computation and Language · Computer Science 2022-05-25 Hanhao Qu , Yu Cao , Jun Gao , Liang Ding , Ruifeng Xu

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Retrieval-augmented generation (RAG) systems have been shown to be effective in addressing many of the drawbacks of relying solely on the parametric memory of large language models. Recent work has demonstrated that RAG systems can be…

Large Language Models (LLMs) are increasingly used for clinical decision support, where hallucinations and unsafe suggestions may pose direct risks to patient safety. These risks are hard to assess: subtle clinical errors are often missed…

Computation and Language · Computer Science 2026-05-14 Yinzhu Chen , Abdine Maiga , Hossein A. Rahmani , Emine Yilmaz

Current evaluations of mathematical reasoning in large language models (LLMs) are dominated by static benchmarks, either derived from competition-style problems or curated through costly expert effort, resulting in limited coverage of…

Computation and Language · Computer Science 2026-05-08 Jicheng Ma , Guohua Wang , Xinhua Feng , Yiming Liu , Zhichao Hu , Yuhong Liu

Retrieval Augmented Generation (RAG) is a common method for integrating external knowledge into pretrained Large Language Models (LLMs) to enhance accuracy and relevancy in question answering (QA) tasks. However, prompt engineering and…

Computation and Language · Computer Science 2024-10-18 Isaac Chung , Phat Vo , Arman C. Kizilkale , Aaron Reite