English
Related papers

Related papers: Diversify Question Generation with Retrieval-Augme…

200 papers

Retrieval-augmented generation (RAG) has been widely adopted to ground large language models (LLMs) in external knowledge, yet it remains largely underexplored for improving reasoning. Existing methods either rely on online exploration…

Artificial Intelligence · Computer Science 2026-02-10 Jiaxiang Chen , Zhuo Wang , Mingxi Zou , Qifan Wang , Zenglin Xu

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

Computation and Language · Computer Science 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Various industries have produced a large number of documents such as industrial plans, technical guidelines, and regulations that are structurally complex and content-wise fragmented. This poses significant challenges for experts and…

Artificial Intelligence · Computer Science 2025-05-27 Hongjia Wu , Hongxin Zhang , Wei Chen , Jiazhi Xia

Complex scientific questions often entail multiple intents, such as identifying gene mutations and linking them to related diseases. These tasks require evidence from diverse sources and multi-hop reasoning, while conventional…

Artificial Intelligence · Computer Science 2025-11-21 Zhiyuan Li , Haisheng Yu , Guangchuan Guo , Nan Zhou , Jiajun Zhang

Retrieval-augmented generation (RAG) has demonstrated its ability to enhance Large Language Models (LLMs) by integrating external knowledge sources. However, multi-hop questions, which require the identification of multiple knowledge…

Machine Learning · Computer Science 2026-04-28 Yuchen Yan , Peiyan Zhang , Zhihua Liu , Hao Wang , Yatao Bian , Weiming Li , Xiaoshuai Hao

Dialogue systems are usually built on either generation-based or retrieval-based approaches, yet they do not benefit from the advantages of different models. In this paper, we propose a Retrieval-Enhanced Adversarial Training (REAT) method…

Computation and Language · Computer Science 2019-05-24 Qingfu Zhu , Lei Cui , Weinan Zhang , Furu Wei , Ting Liu

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained…

Computation and Language · Computer Science 2025-09-26 Yaxiong Wu , Jianyuan Bo , Yongyue Zhang , Sheng Liang , Yong Liu

Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process…

Computation and Language · Computer Science 2026-04-22 Xingchen Xiao , Heyan Huang , Runheng Liu , Jincheng Xie

Large Language Models (LLMs) have revolutionized natural language processing with their remarkable capabilities in text generation and reasoning. However, these models face critical challenges when deployed in real-world applications,…

Computation and Language · Computer Science 2025-09-16 Pengcheng Jiang , Siru Ouyang , Yizhu Jiao , Ming Zhong , Runchu Tian , Jiawei Han

Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing only LLMs. However,…

Computation and Language · Computer Science 2025-12-18 Youmin Ko , Sungjong Seo , Hyunjoon Kim

Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly…

Information Retrieval · Computer Science 2025-03-10 Kunal Sawarkar , Abhilasha Mangal , Shivam Raj Solanki

Retrieval-Augmented Generation (RAG) has emerged as a critical technique for enhancing large language model (LLM) capabilities. However, practitioners face significant challenges when making RAG deployment decisions. While existing research…

Software Engineering · Computer Science 2025-07-22 Shengming Zhao , Yuchen Shao , Yuheng Huang , Jiayang Song , Zhijie Wang , Chengcheng Wan , Lei Ma

Text-to-image generation increasingly demands access to domain-specific, fine-grained, and rapidly evolving knowledge that pretrained models cannot fully capture, necessitating the integration of retrieval methods. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mengdan Zhu , Senhao Cheng , Guangji Bai , Yifei Zhang , Liang Zhao

Retrieval-Augmented Generation (RAG) has demonstrated considerable effectiveness in open-domain question answering. However, when applied to heterogeneous documents, comprising both textual and tabular components, existing RAG approaches…

Computation and Language · Computer Science 2025-10-01 Xiaohan Yu , Pu Jian , Chong Chen

We introduce a new task, Contextual Text Style Transfer - translating a sentence into a desired style with its surrounding context taken into account. This brings two key challenges to existing style transfer approaches: ($i$) how to…

Computation and Language · Computer Science 2020-05-04 Yu Cheng , Zhe Gan , Yizhe Zhang , Oussama Elachqar , Dianqi Li , Jingjing Liu

This paper presents a novel Retrieval-Augmented Generation (RAG) framework tailored for complex question answering tasks, addressing challenges in multi-hop reasoning and contextual understanding across lengthy documents. Built upon LLaMA…

Computation and Language · Computer Science 2025-06-23 Xinyue Huang , Ziqi Lin , Fang Sun , Wenchao Zhang , Kejian Tong , Yunbo Liu

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

Computation and Language · Computer Science 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Recent question generation (QG) approaches often utilize the sequence-to-sequence framework (Seq2Seq) to optimize the log-likelihood of ground-truth questions using teacher forcing. However, this training objective is inconsistent with…

Computation and Language · Computer Science 2020-11-03 Yuxi Xie , Liangming Pan , Dongzhe Wang , Min-Yen Kan , Yansong Feng

Large language models (LLMs) have demonstrated remarkable advances in reasoning capabilities. However, their performance remains constrained by limited access to explicit and structured domain knowledge. Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-10-20 Junlin Wu , Xianrui Zhong , Jiashuo Sun , Bolian Li , Bowen Jin , Jiawei Han , Qingkai Zeng

Given a graph with textual attributes, we enable users to `chat with their graph': that is, to ask questions about the graph using a conversational interface. In response to a user's questions, our method provides textual replies and…

Machine Learning · Computer Science 2024-05-28 Xiaoxin He , Yijun Tian , Yifei Sun , Nitesh V. Chawla , Thomas Laurent , Yann LeCun , Xavier Bresson , Bryan Hooi