English
Related papers

Related papers: RepoDoc: A Knowledge Graph-Based Framework to Auto…

200 papers

Large language models (LLMs) commonly struggle with specialized or emerging topics which are rarely seen in the training corpus. Graph-based retrieval-augmented generation (GraphRAG) addresses this by structuring domain knowledge as a graph…

Information Retrieval · Computer Science 2025-06-05 Zhefan Wang , Huanjun Kong , Jie Ying , Wanli Ouyang , Nanqing Dong

With the rise of knowledge graph based retrieval-augmented generation (RAG) techniques such as GraphRAG and Pike-RAG, the role of knowledge graphs in enhancing the reasoning capabilities of large language models (LLMs) has become…

Information Retrieval · Computer Science 2025-04-15 Hairong Zhang , Jiaheng Si , Guohang Yan , Boyuan Qi , Pinlong Cai , Song Mao , Ding Wang , Botian Shi

Large Language Models (LLMs) have achieved remarkable success but remain data-inefficient, especially when learning from small, specialized corpora with limited and proprietary data. Existing synthetic data generation methods for continue…

Computation and Language · Computer Science 2025-09-16 Shengjie Ma , Xuhui Jiang , Chengjin Xu , Cehao Yang , Liyu Zhang , Jian Guo

In long, multi-page industrial documents, retrieval-augmented generation (RAG) depends heavily on whether chunk boundaries follow the document's true structure. Existing text-centric chunkers and generative hierarchy parsers often miss…

Information Retrieval · Computer Science 2026-05-20 Joongmin Shin , Jeongbae Park , Jaehyung Seo , Heuiseok Lim

Despite Retrieval-Augmented Generation improving code completion, traditional retrieval methods struggle with information redundancy and a lack of diversity within limited context windows. To solve this, we propose a resource-optimized…

Software Engineering · Computer Science 2025-10-14 Xiaohan Chen , Zhongying Pan , Quan Feng , Yu Tian , Shuqun Yang , Mengru Wang , Lina Gong , Yuxia Geng , Piji Li , Xiang Chen

Given a large and evolving codebase, the ability to automatically generate holistic, architecture-aware documentation that captures not only individual functions but also cross-file, cross-module, and system-level interactions remains an…

Software Engineering · Computer Science 2026-04-07 Anh Nguyen Hoang , Minh Le-Anh , Bach Le , Nghi D. Q. Bui

Knowledge graphs (KGs) provide structured, verifiable grounding for large language models (LLMs), but current LLM-based systems commonly use KGs as auxiliary structures for text retrieval, leaving their intrinsic quality underexplored. In…

Computation and Language · Computer Science 2026-01-30 Alla Chepurova , Aydar Bulatov , Mikhail Burtsev , Yuri Kuratov

Repository-level code completion aims to generate code for unfinished code snippets within the context of a specified repository. Existing approaches mainly rely on retrieval-augmented generation strategies due to limitations in input…

Software Engineering · Computer Science 2024-07-31 Yanlin Wang , Yanli Wang , Daya Guo , Jiachi Chen , Ruikai Zhang , Yuchi Ma , Zibin Zheng

We aim to develop a retrieval-augmented generation (RAG) framework that answers questions over a corpus of visually-rich documents presented in mixed modalities (e.g., charts, tables) and diverse formats (e.g., PDF, PPTX). In this paper, we…

Computation and Language · Computer Science 2025-04-15 Ryota Tanaka , Taichi Iki , Taku Hasegawa , Kyosuke Nishida , Kuniko Saito , Jun Suzuki

Large Language Models (LLMs) excel at general code generation, but their performance drops sharply in enterprise settings that rely on internal private libraries absent from public pre-training corpora. While Retrieval-Augmented Generation…

Software Engineering · Computer Science 2026-04-28 Mofei Li , Taozhi Chen , Guowei Yang , Jia Li

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

Computation and Language · Computer Science 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Large language models (LLMs) have demonstrated strong performance in natural language generation but remain limited in knowle- dge-intensive tasks due to outdated or incomplete internal knowledge. Retrieval-Augmented Generation (RAG)…

Artificial Intelligence · Computer Science 2025-08-05 Dong Li , Yichen Niu , Ying Ai , Xiang Zou , Biqing Qi , Jianxing Liu

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Multi-document grounded dialogue systems (DGDS) belong to a class of conversational agents that answer users' requests by finding supporting knowledge from a collection of documents. Most previous studies aim to improve the knowledge…

Computation and Language · Computer Science 2023-02-24 Yeqin Zhang , Haomin Fu , Cheng Fu , Haiyang Yu , Yongbin Li , Cam-Tu Nguyen

The integration of documents generated by LLMs themselves (Self-Docs) alongside retrieved documents has emerged as a promising strategy for retrieval-augmented generation systems. However, previous research primarily focuses on optimizing…

Computation and Language · Computer Science 2025-02-11 Jiatao Li , Xinyu Hu , Xunjian Yin , Xiaojun Wan

Incorporating external graph knowledge into neural chatbot models has been proven effective for enhancing dialogue generation. However, in conventional graph neural networks (GNNs), message passing on a graph is independent from text,…

Computation and Language · Computer Science 2023-06-29 Chen Tang , Hongbo Zhang , Tyler Loakman , Chenghua Lin , Frank Guerin

The utilization of programming language (PL) models, pre-trained on large-scale code corpora, as a means of automating software engineering processes has demonstrated considerable potential in streamlining various code generation tasks such…

Machine Learning · Computer Science 2023-07-21 Parshin Shojaee , Aneesh Jain , Sindhu Tipirneni , Chandan K. Reddy

Even for a conservative estimate, 80% of enterprise data reside in unstructured files, stored in data lakes that accommodate heterogeneous formats. Classical search engines can no longer meet information seeking needs, especially when the…

Computation and Language · Computer Science 2024-06-06 Qiang Sun , Yuanyi Luo , Wenxiao Zhang , Sirui Li , Jichunyang Li , Kai Niu , Xiangrui Kong , Wei Liu

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

The performance of repository-level code completion depends upon the effective leverage of both general and repository-specific knowledge. Despite the impressive capability of code LLMs in general code completion tasks, they often exhibit…

Software Engineering · Computer Science 2024-09-16 Wei Liu , Ailun Yu , Daoguang Zan , Bo Shen , Wei Zhang , Haiyan Zhao , Zhi Jin , Qianxiang Wang