中文
相关论文

相关论文: Retrieval-Augmented Perception: High-Resolution Im…

200 篇论文

Retrieval-augmented generation (RAG) has emerged as a leading approach to reducing hallucinations in large language models (LLMs). Current RAG evaluation benchmarks primarily focus on what we call local RAG: retrieving relevant chunks from…

计算与语言 · 计算机科学 2025-11-05 Qi Luo , Xiaonan Li , Tingshuo Fan , Xinchi Chen , Xipeng Qiu

Effectively incorporating external knowledge into Large Language Models (LLMs) is crucial for enhancing their capabilities and addressing real-world needs. Retrieval-Augmented Generation (RAG) offers an effective method for achieving this…

计算与语言 · 计算机科学 2025-03-06 Kuan Li , Liwen Zhang , Yong Jiang , Pengjun Xie , Fei Huang , Shuai Wang , Minhao Cheng

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

信息检索 · 计算机科学 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

A common way to extend the memory of large language models (LLMs) is by retrieval augmented generation (RAG), which inserts text retrieved from a larger memory into an LLM's context window. However, the context window is typically limited…

计算与语言 · 计算机科学 2025-02-14 Marc Pickett , Jeremy Hartman , Ayan Kumar Bhowmick , Raquib-ul Alam , Aditya Vempaty

Large Language Models (LLMs), although powerful in general domains, often perform poorly on domain-specific tasks such as medical question answering (QA). In addition, LLMs tend to function as "black-boxes", making it challenging to modify…

计算与语言 · 计算机科学 2024-08-19 Yucheng Shi , Shaochen Xu , Tianze Yang , Zhengliang Liu , Tianming Liu , Quanzheng Li , Xiang Li , Ninghao Liu

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

计算与语言 · 计算机科学 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen

Medical large vision-language Models (Med-LVLMs) have shown promise in clinical applications but suffer from factual inaccuracies and unreliable outputs, posing risks in real-world diagnostics. While RAG has emerged as a potential solution,…

计算与语言 · 计算机科学 2026-05-05 Zhe Chen , Yusheng Liao , Zhiyuan Zhu , Haolin Li , Hongcheng Liu , Yanfeng Wang , Yu Wang

Multi-step retrieval-augmented generation (RAG) has become a widely adopted strategy for enhancing large language models (LLMs) on tasks that demand global comprehension and intensive reasoning. Although many RAG systems incorporate a…

计算与语言 · 计算机科学 2026-05-28 Chulun Zhou , Chunkang Zhang , Guoxin Yu , Fandong Meng , Jie Zhou , Wai Lam , Mo Yu

Recent advancements in Retrieval-Augmented Generation (RAG) have enabled Large Language Models (LLMs) to access multimodal knowledge bases containing both text and visual information such as charts, diagrams, and tables in financial…

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

机器学习 · 计算机科学 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Recent advancements in large language models (LLMs) have enabled their use as agents for planning complex tasks. Existing methods typically rely on a thought-action-observation (TAO) process to enhance LLM performance, but these approaches…

人工智能 · 计算机科学 2025-04-18 Zheng Wang , Shu Xian Teo , Jun Jie Chew , Wei Shi

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

计算与语言 · 计算机科学 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

计算与语言 · 计算机科学 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Large Language Models (LLMs) excel in various language tasks but they often generate incorrect information, a phenomenon known as "hallucinations". Retrieval-Augmented Generation (RAG) aims to mitigate this by using document retrieval for…

信息检索 · 计算机科学 2024-07-18 Hamin Koo , Minseon Kim , Sung Ju Hwang

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

机器学习 · 计算机科学 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Diffusion models enable high-quality and diverse visual content synthesis. However, they struggle to generate rare or unseen concepts. To address this challenge, we explore the usage of Retrieval-Augmented Generation (RAG) with image…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Rotem Shalev-Arkushin , Rinon Gal , Amit H. Bermano , Ohad Fried

In this article, we evaluate four Large Language Models (LLMs) and their effectiveness at retrieving data within a specialized Retrieval-Augmented Generation (RAG) system, using a comprehensive food composition database. Our method is…

计算与语言 · 计算机科学 2026-03-12 Maks Požarnik Vavken , Matevž Ogrinc , Tome Eftimov , Barbara Koroušić Seljak

Our ability to continuously acquire, organize, and leverage knowledge is a key feature of human intelligence that AI systems must approximate to unlock their full potential. Given the challenges in continual learning with large language…

计算与语言 · 计算机科学 2025-06-23 Bernal Jiménez Gutiérrez , Yiheng Shu , Weijian Qi , Sizhe Zhou , Yu Su

The retrieval-augmented generation (RAG) enables retrieval of relevant information from an external knowledge source and allows large language models (LLMs) to answer queries over previously unseen document collections. However, it was…

计算与语言 · 计算机科学 2025-04-03 Mykhailo Poliakov , Nadiya Shvai