English
Related papers

Related papers: MARK: Memory Augmented Refinement of Knowledge

200 papers

Large Language Models (LLMs) demonstrate remarkable capabilities, yet struggle with hallucination and outdated knowledge when tasked with complex knowledge reasoning, resulting in factually incorrect outputs. Previous studies have attempted…

Computation and Language · Computer Science 2025-01-07 Derong Xu , Xinhang Li , Ziheng Zhang , Zhenxi Lin , Zhihong Zhu , Zhi Zheng , Xian Wu , Xiangyu Zhao , Tong Xu , Enhong Chen

Large Language Models (LLMs) are increasingly integrating memory functionalities to provide personalized and context-aware interactions. However, user understanding, practices and expectations regarding these memory systems are not yet well…

Human-Computer Interaction · Computer Science 2025-08-12 Shuning Zhang , Rongjun Ma , Ying Ma , Shixuan Li , Yiqun Xu , Xin Yi , Hewu Li

Large Language Models (LLMs) are pre-trained on large-scale corpora and excel in numerous general natural language processing (NLP) tasks, such as question answering (QA). Despite their advanced language capabilities, when it comes to…

Recent advancements in Large Language Models (LLMs) have exhibited notable efficacy in question-answering (QA) tasks across diverse domains. Their prowess in integrating extensive web knowledge has fueled interest in developing LLM-based…

Computational Finance · Quantitative Finance 2023-12-05 Yangyang Yu , Haohang Li , Zhi Chen , Yuechen Jiang , Yang Li , Denghui Zhang , Rong Liu , Jordan W. Suchow , Khaldoun Khashanah

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their…

Artificial Intelligence · Computer Science 2025-06-10 Xinyan Guan , Jiali Zeng , Fandong Meng , Chunlei Xin , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Jie Zhou

To sustain coherent long-term interactions, Large Language Model (LLM) agents must navigate the tension between acquiring new information and retaining prior knowledge. Current unified stream-based memory systems facilitate context updates…

Artificial Intelligence · Computer Science 2026-04-15 Zhaofen Wu , Hanrong Zhang , Fulin Lin , Wujiang Xu , Xinran Xu , Yankai Chen , Henry Peng Zou , Shaowen Chen , Weizhi Zhang , Xue Liu , Philip S. Yu , Hongwei Wang

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness…

Computation and Language · Computer Science 2025-09-03 Zirui Song , Bin Yan , Yuhan Liu , Miao Fang , Mingzhe Li , Rui Yan , Xiuying Chen

We proposed an end-to-end system design towards utilizing Retrieval Augmented Generation (RAG) to improve the factual accuracy of Large Language Models (LLMs) for domain-specific and time-sensitive queries related to private…

Computation and Language · Computer Science 2024-03-18 Jiarui Li , Ye Yuan , Zehua Zhang

Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights, as evidenced by their ability to answer diverse questions across different domains. However, this knowledge is inherently…

Artificial Intelligence · Computer Science 2024-01-31 Oded Ovadia , Menachem Brief , Moshik Mishaeli , Oren Elisha

Large Language Models (LLMs) excel at tackling various natural language tasks. However, due to the significant costs involved in re-training or fine-tuning them, they remain largely static and difficult to personalize. Nevertheless, a…

Information Retrieval · Computer Science 2024-02-20 Jinheon Baek , Nirupama Chandrasekaran , Silviu Cucerzan , Allen herring , Sujay Kumar Jauhar

This paper investigates the impact of domain-specific model fine-tuning and of reasoning mechanisms on the performance of question-answering (Q&A) systems powered by large language models (LLMs) and Retrieval-Augmented Generation (RAG).…

Artificial Intelligence · Computer Science 2024-04-23 Zooey Nguyen , Anthony Annunziata , Vinh Luong , Sang Dinh , Quynh Le , Anh Hai Ha , Chanh Le , Hong An Phan , Shruti Raghavan , Christopher Nguyen

Large Language Models (LLMs) often struggle with dynamically changing knowledge and handling unknown static information. Retrieval-Augmented Generation (RAG) is employed to tackle these challenges and has a significant impact on improving…

Computation and Language · Computer Science 2025-09-18 Zhen Zhang , Xinyu Wang , Yong Jiang , Zile Qiao , Zhuo Chen , Guangyu Li , Feiteng Mu , Mengting Hu , Pengjun Xie , Fei Huang

Multimodal large language models (MLLMs) have shown remarkable capabilities in multimodal perception and understanding tasks. However, their effectiveness in specialized domains, such as remote sensing and medical imaging, remains limited.…

Computation and Language · Computer Science 2026-02-05 Qinglong Cao , Yuntian Chen , Chao Ma , Xiaokang Yang

Speech recognition systems often face challenges due to domain mismatch, particularly in real-world applications where domain-specific data is unavailable because of data accessibility and confidentiality constraints. Inspired by…

Computation and Language · Computer Science 2025-02-24 Peng Shen , Xugang Lu , Hisashi Kawai

Large language models (LLMs) have greatly improved their capability in performing NLP tasks. However, deeper semantic understanding, contextual coherence, and more subtle reasoning are still difficult to obtain. The paper discusses…

Computation and Language · Computer Science 2025-12-05 Mohanakrishnan Hariharan

Large Language Model (LLM)-based agents demonstrate advanced reasoning capabilities, yet practical constraints frequently limit outputs to single responses, leaving significant performance potential unrealized. This paper introduces MARINE…

Multiagent Systems · Computer Science 2025-12-10 Hongwei Zhang , Ji Lu , Yongsheng Du , Yanqin Gao , Lingjun Huang , Baoli Wang , Fang Tan , Peng Zou

This project investigates the efficacy of Large Language Models (LLMs) in understanding and extracting scientific knowledge across specific domains and to create a deep learning framework: Knowledge AI. As a part of this framework, we…

Computation and Language · Computer Science 2024-08-12 Balaji Muralidharan , Hayden Beadles , Reza Marzban , Kalyan Sashank Mupparaju

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

Machine Learning · Computer Science 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

Computation and Language · Computer Science 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen