中文
相关论文

相关论文: Toward General Instruction-Following Alignment for…

200 篇论文

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

计算与语言 · 计算机科学 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

计算与语言 · 计算机科学 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Retriever-augmented generation (RAG) has become a widely adopted approach for enhancing the factual accuracy of large language models (LLMs). While current benchmarks evaluate the performance of RAG methods from various perspectives, they…

信息检索 · 计算机科学 2025-04-08 Kepu Zhang , Zhongxiang Sun , Weijie Yu , Xiaoxue Zang , Kai Zheng , Yang Song , Han Li , Jun Xu

Retrieval-augmented generation (RAG) equips large language models (LLMs) with reliable knowledge memory. To strengthen cross-text associations, recent research integrates graphs and hypergraphs into RAG to capture pairwise and multi-entity…

信息检索 · 计算机科学 2026-02-10 Xingliang Hou , Yuyan Liu , Qi Sun , haoxiu wang , Hao Hu , Shaoyi Du , Zhiqiang Tian

Retrieval-augmented generation (RAG) synergizes the retrieval of pertinent data with the generative capabilities of Large Language Models (LLMs), ensuring that the generated output is not only contextually relevant but also accurate and…

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

计算与语言 · 计算机科学 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Retrieval-augmented generation (RAG) can enhance the generation quality of large language models (LLMs) by incorporating external token databases. However, retrievals from large databases can constitute a substantial portion of the overall…

计算与语言 · 计算机科学 2024-03-12 Wenqi Jiang , Shuai Zhang , Boran Han , Jie Wang , Bernie Wang , Tim Kraska

One core capability of large language models (LLMs) is to follow natural language instructions. However, the issue of automatically constructing high-quality training data to enhance the complex instruction-following abilities of LLMs…

计算与语言 · 计算机科学 2024-07-19 Guanting Dong , Keming Lu , Chengpeng Li , Tingyu Xia , Bowen Yu , Chang Zhou , Jingren Zhou

Retrieval-augmented generation (RAG) has recently emerged as a promising solution for incorporating up-to-date or domain-specific knowledge into large language models (LLMs) and improving LLM factuality, but is predominantly studied in…

计算与语言 · 计算机科学 2024-07-02 Nadezhda Chirkova , David Rau , Hervé Déjean , Thibault Formal , Stéphane Clinchant , Vassilina Nikoulina

With the development of large language models, their ability to follow simple instructions has significantly improved. However, adhering to complex instructions remains a major challenge. Current approaches to generating complex…

计算与语言 · 计算机科学 2025-02-28 Wei Liu , Yancheng He , Hui Huang , Chengwei Hu , Jiaheng Liu , Shilong Li , Wenbo Su , Bo Zheng

Large Language Models (LLMs) have shown remarkable capabilities in natural language understanding and generation, yet their deployment in enterprise environments reveals a critical limitation: inconsistent adherence to custom instructions.…

计算与语言 · 计算机科学 2026-01-08 Vishesh Tripathi , Uday Allu , Biddwan Ahmed

While Retrieval-Augmented Generation (RAG) mitigates hallucination and knowledge staleness in Large Language Models (LLMs), existing frameworks often falter on complex, multi-hop queries that require synthesizing information from disparate…

计算与语言 · 计算机科学 2025-10-28 Mohammad Aghajani Asl , Majid Asgari-Bidhendi , Behrooz Minaei-Bidgoli

Retrieval Augmented Generation (RAG) has emerged as a powerful application of Large Language Models (LLMs), revolutionizing information search and consumption. RAG systems combine traditional search capabilities with LLMs to generate…

信息检索 · 计算机科学 2025-06-12 Harsh Maheshwari , Srikanth Tenneti , Alwarappan Nakkiran

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

计算与语言 · 计算机科学 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Large Language Models (LLMs) have enabled a wide range of applications through their powerful capabilities in language understanding and generation. However, as LLMs are trained on static corpora, they face difficulties in addressing…

计算与语言 · 计算机科学 2025-10-13 Yongjie Wang , Yue Yu , Kaisong Song , Jun Lin , Zhiqi Shen

There are two common ways in which developers are incorporating proprietary and domain-specific data when building applications of Large Language Models (LLMs): Retrieval-Augmented Generation (RAG) and Fine-Tuning. RAG augments the prompt…

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

计算与语言 · 计算机科学 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing large language models (LLMs), with verification engineering playing a central role. However, best practices for RL in instruction following…

计算与语言 · 计算机科学 2025-06-12 Hao Peng , Yunjia Qi , Xiaozhi Wang , Bin Xu , Lei Hou , Juanzi Li

Retrieval-augmented generation (RAG) has shown impressive capability in providing reliable answer predictions and addressing hallucination problems. A typical RAG implementation uses powerful retrieval models to extract external information…

信息检索 · 计算机科学 2024-11-19 Ziwei Liu , Liang Zhang , Qian Li , Jianghua Wu , Guangxu Zhu

Retrieval-Augmented Large Language Models (LLMs), which integrate external knowledge, have shown remarkable performance in medical domains, including clinical diagnosis. However, existing RAG methods often struggle to tailor retrieval…

计算与语言 · 计算机科学 2025-10-16 Jiawei He , Mingyi Jia , Zhihao Jia , Junwen Duan , Yan Song , Jianxin Wang