中文
相关论文

相关论文: Differentially Private Retrieval-Augmented Generat…

200 篇论文

Organizations seeking to utilize Large Language Models (LLMs) for knowledge querying and analysis often encounter challenges in maintaining an LLM fine-tuned on targeted, up-to-date information that keeps answers relevant and grounded.…

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

计算与语言 · 计算机科学 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Large language models (LLMs) exhibit remarkable capabilities but often produce inaccurate responses, as they rely solely on their embedded knowledge. Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating an external…

计算与语言 · 计算机科学 2024-09-25 Nitin Aravind Birur , Tanay Baswa , Divyanshu Kumar , Jatan Loya , Sahil Agarwal , Prashanth Harshangi

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

机器学习 · 计算机科学 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Retrieval-augmented generation (RAG) enhances the outputs of language models by integrating relevant information retrieved from external knowledge sources. However, when the retrieval process involves private data, RAG systems may face…

密码学与安全 · 计算机科学 2025-02-21 Shenglai Zeng , Jiankun Zhang , Pengfei He , Jie Ren , Tianqi Zheng , Hanqing Lu , Han Xu , Hui Liu , Yue Xing , Jiliang Tang

As connected and automated transportation systems evolve, there is a growing need for federal and state authorities to revise existing laws and develop new statutes to address emerging cybersecurity and data privacy challenges. This study…

Natural Language to Code Generation has made significant progress in recent years with the advent of Large Language Models(LLMs). While generation for general-purpose languages like C, C++, and Python has improved significantly, LLMs…

软件工程 · 计算机科学 2024-07-04 Nastaran Bassamzadeh , Chhaya Methani

Large Language Models (LLMs) have exhibited remarkable proficiency in natural language understanding, prompting extensive exploration of their potential applications across diverse domains. In the medical domain, open-source LLMs have…

计算与语言 · 计算机科学 2024-08-01 Cui Long , Yongbin Liu , Chunping Ouyang , Ying Yu

Retrieval-augmented generation (RAG) is a key technique for leveraging external knowledge and reducing hallucinations in large language models (LLMs). However, RAG still struggles to fully prevent hallucinated responses. To address this, it…

计算与语言 · 计算机科学 2025-02-14 Xuzhao Geng , Haozhao Wang , Jun Wang , Wei Liu , Ruixuan Li

Large Language Models (LLMs) have enabled a wide range of applications through their powerful capabilities in language understanding and generation. However, as LLMs are trained on static corpora, they face difficulties in addressing…

计算与语言 · 计算机科学 2025-10-13 Yongjie Wang , Yue Yu , Kaisong Song , Jun Lin , Zhiqi Shen

Retrieval augmented generation (RAG) combines the generative abilities of large language models (LLMs) with external knowledge sources to provide more accurate and up-to-date responses. Recent RAG advancements focus on improving retrieval…

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

计算与语言 · 计算机科学 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Retrieval-Augmented Generation (RAG) has become a standard approach for improving the reliability of large language models (LLMs). Prior work demonstrates the vulnerability of RAG systems by misleading them into generating attacker-chosen…

密码学与安全 · 计算机科学 2025-08-28 Yanbo Dai , Zhenlan Ji , Zongjie Li , Kuan Li , Shuai Wang

Large language models (LLMs) have achieved remarkable success in various domains, primarily due to their strong capabilities in reasoning and generating human-like text. Despite their impressive performance, LLMs are susceptible to…

密码学与安全 · 计算机科学 2025-05-13 Yangguang Shao , Xinjie Lin , Haozheng Luo , Chengshang Hou , Gang Xiong , Jiahao Yu , Junzheng Shi

Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy…

机器学习 · 计算机科学 2026-02-04 Yinan Huang , Haoteng Yin , Eli Chien , Rongzhe Wei , Pan Li

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

计算与语言 · 计算机科学 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Retrieval-augmented Generation (RAG) is a prevalent approach for domain-specific LLMs, yet it is often plagued by "Retrieval Hallucinations"--a phenomenon where fine-tuned models fail to recognize and act upon poor-quality retrieved…

人工智能 · 计算机科学 2026-01-21 Letian Zhang , Guanghao Meng , Xudong Ren , Yiming Wang , Shu-Tao Xia

This research project addresses the errors of financial numerical reasoning Question Answering (QA) tasks due to the lack of domain knowledge in finance. Despite recent advances in Large Language Models (LLMs), financial numerical questions…

计算与语言 · 计算机科学 2026-01-01 Yukun Zhang , Stefan Elbl Droguett , Samyak Jain