中文
相关论文

相关论文: WikiContradict: A Benchmark for Evaluating LLMs on…

200 篇论文

Retrieval-Augmented Generation (RAG) has emerged as a key paradigm for enhancing large language models (LLMs) by incorporating external knowledge. However, current RAG methods face two limitations: (1) they only cover limited RAG scenarios.…

计算与语言 · 计算机科学 2025-01-03 Wanlong Liu , Junying Chen , Ke Ji , Li Zhou , Wenyu Chen , Benyou Wang

Retrieval-augmented generation (RAG) augments large language models (LLM) by retrieving relevant knowledge, showing promising potential in mitigating LLM hallucinations and enhancing response quality, thereby facilitating the great adoption…

计算与语言 · 计算机科学 2024-01-30 Yixuan Tang , Yi Yang

Retrieval Augmented Generation (RAG) is widely used to enable Large Language Models (LLMs) perform Question Answering (QA) tasks in various domains. However, RAG based on open-source LLM for specialized domains has challenges of evaluating…

计算与语言 · 计算机科学 2024-07-23 Sujoy Roychowdhury , Sumit Soman , H G Ranjani , Neeraj Gunda , Vansh Chhabra , Sai Krishna Bala

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

计算与语言 · 计算机科学 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

Language models (LMs) are known to suffer from hallucinations and misinformation. Retrieval augmented generation (RAG) that retrieves verifiable information from an external knowledge corpus to complement the parametric knowledge in LMs…

计算与语言 · 计算机科学 2024-10-14 Zhuohang Li , Jiaxin Zhang , Chao Yan , Kamalika Das , Sricharan Kumar , Murat Kantarcioglu , Bradley A. Malin

Retrieval-augmented generation (RAG) has emerged as a critical mechanism in contemporary NLP to support Large Language Models(LLMs) in systematically accessing richer factual context. However, the integration of RAG mechanisms brings its…

计算与语言 · 计算机科学 2025-06-11 Leonardo Ranaldi , Marco Valentino , Andrè Freitas

Computational argumentation, which involves generating answers or summaries for controversial topics like abortion bans and vaccination, has become increasingly important in today's polarized environment. Sophisticated LLM capabilities…

计算与语言 · 计算机科学 2024-12-09 Kaustubh D. Dhole , Kai Shu , Eugene Agichtein

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) with external knowledge but remains vulnerable to low-authority sources that can propagate misinformation. We investigate whether LLMs can perceive information…

信息检索 · 计算机科学 2026-03-27 Zhihui Yao , Hengran Zhang , Keping Bi

Retrieval-Augmented Generation (RAG) systems are showing promising potential, and are becoming increasingly relevant in AI-powered legal applications. Existing benchmarks, such as LegalBench, assess the generative capabilities of Large…

人工智能 · 计算机科学 2024-08-21 Nicholas Pipitone , Ghita Houir Alami

Retrieval-Augmented Generation (RAG) is a framework in which a Generator, such as a Large Language Model (LLM), produces answers by retrieving documents from an external collection using a Retriever. In practice, Generators must integrate…

计算与语言 · 计算机科学 2026-04-30 Koki Itai , Shunichi Hasegawa , Yuta Yamamoto , Gouki Minegishi , Masaki Otsuki

Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights, as evidenced by their ability to answer diverse questions across different domains. However, this knowledge is inherently…

人工智能 · 计算机科学 2024-01-31 Oded Ovadia , Menachem Brief , Moshik Mishaeli , Oren Elisha

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating them with an external knowledge base to improve the answer relevance and accuracy. In real-world scenarios, beyond pure text, a substantial amount of…

计算与语言 · 计算机科学 2025-10-07 Jiaru Zou , Dongqi Fu , Sirui Chen , Xinrui He , Zihao Li , Yada Zhu , Jiawei Han , Jingrui He

This study develops a question-answering system based on Retrieval-Augmented Generation (RAG) using Chinese Wikipedia and Lawbank as retrieval sources. Using TTQA and TMMLU+ as evaluation datasets, the system employs BGE-M3 for dense vector…

信息检索 · 计算机科学 2025-01-17 Te-Lun Yang , Jyi-Shane Liu , Yuen-Hsien Tseng , Jyh-Shing Roger Jang

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

计算与语言 · 计算机科学 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

Despite the advancements made in Vision Large Language Models (VLLMs), like text Large Language Models (LLMs), they have limitations in addressing questions that require real-time information or are knowledge-intensive. Indiscriminately…

计算与语言 · 计算机科学 2025-08-26 Zhuo Chen , Xinyu Wang , Yong Jiang , Zhen Zhang , Xinyu Geng , Pengjun Xie , Fei Huang , Kewei Tu

Large language models (LLMs) inherently display hallucinations since the precision of generated texts cannot be guaranteed purely by the parametric knowledge they include. Although retrieval-augmented generation (RAG) systems enhance the…

人工智能 · 计算机科学 2025-02-18 Bingyu Wan , Fuxi Zhang , Zhongpeng Qi , Jiayi Ding , Jijun Li , Baoshi Fan , Yijia Zhang , Jun Zhang

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

计算与语言 · 计算机科学 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

In this paper, we present a comprehensive analysis and monitoring framework for the impact of Large Language Models (LLMs) on Wikipedia, examining the evolution of Wikipedia through existing data and using simulations to explore potential…

计算与语言 · 计算机科学 2026-03-03 Siming Huang , Yuliang Xu , Mingmeng Geng , Yao Wan , Dongping Chen

Large language models (LLMs) acquire most of their knowledge during pretraining, which ties them to a fixed snapshot of the world and makes adaptation to continuously evolving knowledge challenging. As facts, entities, and events change…

计算与语言 · 计算机科学 2026-04-16 Hanbing Liu , Lang Cao , Yang Li

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

计算与语言 · 计算机科学 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen