中文
相关论文

相关论文: Less is More: Making Smaller Language Models Compe…

200 篇论文

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

计算与语言 · 计算机科学 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

The use of retrieval-augmented generation (RAG) to retrieve relevant information from an external knowledge source enables large language models (LLMs) to answer questions over private and/or previously unseen document collections. However,…

Retrieval-Augmented Generation (RAG) is a framework for grounding Large Language Models (LLMs) in external, up-to-date information. However, recent advancements in context window size allow LLMs to process inputs of up to 128K tokens or…

机器学习 · 计算机科学 2026-02-26 Seongwoong Shim , Myunsoo Kim , Jae Hyeon Cho , Byung-Jun Lee

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

计算与语言 · 计算机科学 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Current general-purpose large language models (LLMs) commonly exhibit knowledge hallucination and insufficient domain-specific adaptability in domain-specific tasks, limiting their effectiveness in specialized question answering scenarios.…

信息检索 · 计算机科学 2025-09-16 Mengzheng Yang , Yanfei Ren , David Osei Opoku , Ruochang Li , Peng Ren , Chunxiao Xing

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

计算与语言 · 计算机科学 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Adopting Knowledge Graphs (KGs) as a structured, semantic-oriented, data representation model has significantly improved data integration, reasoning, and querying capabilities across different domains. This is especially true in modern…

信息检索 · 计算机科学 2026-01-19 Marco Arazzi , Davide Ligari , Serena Nicolazzo , Antonino Nocera

Large language models (LLMs) often struggle with knowledge-intensive tasks due to hallucinations and outdated parametric knowledge. While Retrieval-Augmented Generation (RAG) addresses this by integrating external corpora, its effectiveness…

计算与语言 · 计算机科学 2026-02-04 Su Dong , Qinggang Zhang , Yilin Xiao , Shengyuan Chen , Chuang Zhou , Xiao Huang

Large language models (LLMs) struggle with the factual error during inference due to the lack of sufficient training data and the most updated knowledge, leading to the hallucination problem. Retrieval-Augmented Generation (RAG) has gained…

信息检索 · 计算机科学 2026-01-22 Zulun Zhu , Tiancheng Huang , Kai Wang , Junda Ye , Xinghe Chen , Siqiang Luo

Retrieval-Augmented Generation (RAG) enhances language models by grounding responses in external information, yet explainability remains a critical challenge, particularly when retrieval relies on unstructured text. Knowledge graphs (KGs)…

机器学习 · 计算机科学 2025-07-14 Georgios Balanos , Evangelos Chasanis , Konstantinos Skianis , Evaggelia Pitoura

Retrieval augmented generation (RAG) has been applied in many scenarios to augment large language models (LLMs) with external documents provided by retrievers. However, a semantic gap exists between LLMs and retrievers due to differences in…

计算与语言 · 计算机科学 2024-10-31 Fuda Ye , Shuangyin Li , Yongqi Zhang , Lei Chen

Retrieval-augmented generation (RAG) has proven effective in integrating knowledge into large language models (LLMs). However, conventional RAGs struggle to capture complex relationships between pieces of knowledge, limiting their…

信息检索 · 计算机科学 2025-12-12 Linhao Luo , Zicheng Zhao , Gholamreza Haffari , Dinh Phung , Chen Gong , Shirui Pan

Graph Retrieval-Augmented Generation (Graph RAG) effectively builds a knowledge graph (KG) to connect disparate facts across a large document corpus. However, this broad-view approach often lacks the deep structured reasoning needed for…

计算与语言 · 计算机科学 2025-10-27 Jiaoyang Li , Junhao Ruan , Shengwei Tang , Saihan Chen , Kaiyan Chang , Yuan Ge , Tong Xiao , Jingbo Zhu

Large language models (LLMs) have shown strong potential across a variety of tasks, but their application in the telecom field remains challenging due to domain complexity, evolving standards, and specialized terminology. Therefore,…

人工智能 · 计算机科学 2026-02-20 Dun Yuan , Hao Zhou , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

Retrieval-Augmented Generation (RAG) is widely used to mitigate hallucinations of Large Language Models (LLMs) by leveraging external knowledge. While effective for simple queries, traditional RAG systems struggle with large-scale,…

计算与语言 · 计算机科学 2025-11-11 Luyao Zhuang , Shengyuan Chen , Yilin Xiao , Huachi Zhou , Yujing Zhang , Hao Chen , Qinggang Zhang , Xiao Huang

Large Language Models (LLMs) have showcased impressive reasoning abilities, but often suffer from hallucinations or outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) remedies these shortcomings by grounding…

信息检索 · 计算机科学 2025-05-29 Martin Böckling , Heiko Paulheim , Andreea Iana

Retrieval-Augmented Generation (RAG) plays a crucial role in grounding Large Language Models by leveraging external knowledge, whereas the effectiveness is often compromised by the retrieval of contextually flawed or incomplete information.…

人工智能 · 计算机科学 2025-11-13 Yaoze Zhang , Rong Wu , Pinlong Cai , Xiaoman Wang , Guohang Yan , Song Mao , Ding Wang , Botian Shi

Knowledge graph completion (KGC) focuses on identifying missing triples in a knowledge graph (KG) , which is crucial for many downstream applications. Given the rapid development of large language models (LLMs), some LLM-based methods are…

计算与语言 · 计算机科学 2025-01-06 Rui Yang , Jiahao Zhu , Jianping Man , Hongze Liu , Li Fang , Yi Zhou

Retrieval augmented generation (RAG) combines the generative abilities of large language models (LLMs) with external knowledge sources to provide more accurate and up-to-date responses. Recent RAG advancements focus on improving retrieval…

Recent works on knowledge base question answering (KBQA) retrieve subgraphs for easier reasoning. A desired subgraph is crucial as a small one may exclude the answer but a large one might introduce more noises. However, the existing…

计算与语言 · 计算机科学 2022-07-28 Jing Zhang , Xiaokang Zhang , Jifan Yu , Jian Tang , Jie Tang , Cuiping Li , Hong Chen