中文
相关论文

相关论文: Panini: Continual Learning in Token Space via Stru…

200 篇论文

This paper addresses the challenge of comprehending very long contexts in Large Language Models (LLMs) by proposing a method that emulates Retrieval Augmented Generation (RAG) through specialized prompt engineering and chain-of-thought…

计算与语言 · 计算机科学 2025-02-19 Joon Park , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Retrieval-augmented generation (RAG) has become a dominant paradigm for grounding large language models (LLMs) with external evidence in knowledge-intensive question answering. A core design choice is how to fuse retrieved samples into the…

计算与语言 · 计算机科学 2026-02-16 Yixin Chen , Ying Xiong , Shangyu Wu , Xiangrui Ke , Nan Guan , Chun Jason Xue

Complex question-answering (QA) systems face significant challenges in retrieving and reasoning over information that addresses multi-faceted queries. While large language models (LLMs) have advanced the reasoning capabilities of these…

信息检索 · 计算机科学 2025-03-25 V Venktesh , Mandeep Rathee , Avishek Anand

Accurately estimating query-item relevance is vital for e-commerce ranking and conversion. While Large Language Models (LLMs) excel at reasoning, they often lack specialized knowledge required for long-tail or fast-evolving queries,…

信息检索 · 计算机科学 2026-04-07 Tingqiao Xu , Shaowei Yao , Chenhe Dong , Yiming Jin , Zerui Huang , Dan Ou , Haihong Tang , Bo Zheng

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their applications in…

机器学习 · 计算机科学 2024-05-31 Chunjing Gan , Dan Yang , Binbin Hu , Hanxiao Zhang , Siyuan Li , Ziqi Liu , Yue Shen , Lin Ju , Zhiqiang Zhang , Jinjie Gu , Lei Liang , Jun Zhou

Retrieval Augmented Generation (RAG) is a widely used approach for leveraging external context in several natural language applications such as question answering and information retrieval. Yet, the exact nature in which a Language Model…

In modern machine learning, pattern recognition replaces realtime semantic reasoning. The mapping from input to output is learned with fixed semantics by training outcomes deliberately. This is an expensive and static approach which depends…

人工智能 · 计算机科学 2017-08-02 Mark Burgess

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

信息检索 · 计算机科学 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Large Language Models (LLMs) face fundamental limitations in context management despite recent advances extending context windows to millions of tokens. We propose Cognitive Workspace, a novel paradigm that transcends traditional…

人工智能 · 计算机科学 2025-08-20 Tao An

Recent advancements in Large Language Models (LLMs) have significantly improved their performance across various Natural Language Processing (NLP) tasks. However, LLMs still struggle with generating non-factual responses due to limitations…

计算与语言 · 计算机科学 2024-09-10 Taeho Hwang , Soyeong Jeong , Sukmin Cho , SeungYoon Han , Jong C. Park

While large language models (LLMs) demonstrate impressive capabilities, their reliance on parametric knowledge often leads to factual inaccuracies. Retrieval-Augmented Generation (RAG) mitigates this by leveraging external documents, yet…

计算与语言 · 计算机科学 2025-10-07 Lingnan Xu , Chong Feng , Kaiyuan Zhang , Liu Zhengyong , Wenqiang Xu , Fanqing Meng

With the rapid advancement of tool-use capabilities in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) is shifting from static, one-shot retrieval toward autonomous, multi-turn evidence acquisition. However, existing…

人工智能 · 计算机科学 2026-02-13 Zhanli Li , Huiwen Tian , Lvzhou Luo , Yixuan Cao , Ping Luo

High-quality benchmarks are essential for evaluating reasoning and retrieval capabilities of large language models (LLMs). However, curating datasets for this purpose is not a permanent solution as they are prone to data leakage and…

Retrieving and extracting knowledge from extensive research documents and large databases presents significant challenges for researchers, students, and professionals in today's information-rich era. Existing retrieval systems, which rely…

信息检索 · 计算机科学 2025-02-06 Mohammed-Khalil Ghali , Abdelrahman Farrag , Daehan Won , Yu Jin

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

计算与语言 · 计算机科学 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Generative Large Language Models (LLMs) are a promising approach to structuring knowledge contained within the corpora of research literature produced by large-scale and long-running scientific collaborations. Within experimental particle…

高能物理 - 实验 · 物理学 2025-09-09 James McGreivy , Blaise Delaney , Anja Beck , Mike Williams

Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses…

计算与语言 · 计算机科学 2025-11-03 Qi Luo , Xiaonan Li , Yuxin Wang , Tingshuo Fan , Yuan Li , Xinchi Chen , Xipeng Qiu

Retrieval-Augmented Language Models (RALMs) have significantly improved performance in open-domain question answering (QA) by leveraging external knowledge. However, RALMs still struggle with unanswerable queries, where the retrieved…

计算与语言 · 计算机科学 2024-08-09 Seong-Il Park , Seung-Woo Choi , Na-Hyun Kim , Jay-Yoon Lee

We introduce Plan*RAG, a novel framework that enables structured multi-hop reasoning in retrieval-augmented generation (RAG) through test-time reasoning plan generation. While existing approaches such as ReAct maintain reasoning chains…

计算与语言 · 计算机科学 2025-02-05 Prakhar Verma , Sukruta Prakash Midigeshi , Gaurav Sinha , Arno Solin , Nagarajan Natarajan , Amit Sharma

Retrieval-augmented generation (RAG) enables large language models (LLMs) to dynamically access external information, which is powerful for answering questions over previously unseen documents. Nonetheless, they struggle with high-level…

人工智能 · 计算机科学 2026-04-21 Chi-Hsiang Hsiao , Yi-Cheng Wang , Tzung-Sheng Lin , Yi-Ren Yeh , Chu-Song Chen