中文
相关论文

相关论文: Differentiable Retrieval Augmentation via Generati…

200 篇论文

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

计算与语言 · 计算机科学 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Graph-based Retrieval-Augmented Generation (RAG) methods have significantly enhanced the performance of large language models (LLMs) in domain-specific tasks. However, existing RAG methods do not adequately utilize the naturally inherent…

计算与语言 · 计算机科学 2025-09-29 Haoyu Huang , Yongfeng Huang , Junjie Yang , Zhenyu Pan , Yongqiang Chen , Kaili Ma , Hongzhi Chen , James Cheng

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Generative retrieval stands out as a promising new paradigm in text retrieval that aims to generate identifier strings of relevant passages as the retrieval target. This generative paradigm taps into powerful generative language models,…

计算与语言 · 计算机科学 2023-12-19 Yongqi Li , Nan Yang , Liang Wang , Furu Wei , Wenjie Li

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

计算与语言 · 计算机科学 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Research on data generation and augmentation has been focused majorly on enhancing generation models, leaving a notable gap in the exploration and refinement of methods for evaluating synthetic data. There are several text similarity…

计算与语言 · 计算机科学 2023-11-09 Tiasa Singha Roy , Priyam Basu

Question answering (QA) has become an important application in the advanced development of large language models. General pre-trained large language models for question-answering are not trained to properly understand the knowledge or…

Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly…

信息检索 · 计算机科学 2025-03-10 Kunal Sawarkar , Abhilasha Mangal , Shivam Raj Solanki

Large language models often encounter challenges with static knowledge and hallucinations, which undermine their reliability. Retrieval-augmented generation (RAG) mitigates these issues by incorporating external information. However, user…

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

计算与语言 · 计算机科学 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Retrieval-Augmented Generation (RAG) aims to generate more reliable and accurate responses, by augmenting large language models (LLMs) with the external vast and dynamic knowledge. Most previous work focuses on using RAG for single-round…

人工智能 · 计算机科学 2024-03-28 Linhao Ye , Zhikai Lei , Jianghao Yin , Qin Chen , Jie Zhou , Liang He

Large Language Models (LLMs) are effective for data augmentation in classification tasks like intent detection. In some cases, they inadvertently produce examples that are ambiguous with regard to untargeted classes. We present DDAIR…

计算与语言 · 计算机科学 2026-01-19 Galo Castillo-López , Alexis Lombard , Nasredine Semmar , Gaël de Chalendar

The application of Large Language Models to Question Answering has shown great promise, but important challenges such as hallucinations and erroneous reasoning arise when using these models, particularly in knowledge-intensive,…

计算与语言 · 计算机科学 2026-05-15 Ignacio Sastre , Guillermo Moncecchi , Aiala Rosá

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Robust content moderation classifiers are essential for the safety of Generative AI systems. In this task, differences between safe and unsafe inputs are often extremely subtle, making it difficult for classifiers (and indeed, even humans)…

Accurately identifying adversarial techniques in security texts is critical for effective cyber defense. However, existing methods face a fundamental trade-off: they either rely on generic models with limited domain precision or require…

密码学与安全 · 计算机科学 2025-08-12 Ahmed Lekssays , Utsav Shukla , Husrev Taha Sencar , Md Rizwan Parvez

Retrieval-augmented large language models (LLMs) have been remarkably competent in various NLP tasks. However, it was observed by previous works that retrieval is not always helpful, especially when the LLM is already knowledgeable on the…

计算与语言 · 计算机科学 2024-12-16 Chengkai Huang , Yu Xia , Rui Wang , Kaige Xie , Tong Yu , Julian McAuley , Lina Yao

Personalized image generation is crucial for improving the user experience, as it renders reference images into preferred ones according to user visual preferences. Although effective, existing methods face two main issues. First, existing…

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

计算与语言 · 计算机科学 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

计算与语言 · 计算机科学 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu