English
Related papers

Related papers: Adversarial Yet Cooperative: Multi-Perspective Rea…

200 papers

Retrieval Augmented Language Models (RALMs) have gained significant attention for their ability to generate accurate answer and improve efficiency. However, RALMs are inherently vulnerable to imperfect information due to their reliance on…

Computation and Language · Computer Science 2024-10-22 Seong-Il Park , Jay-Yoon Lee

Retrieval-Augmented Generation (RAG) has become a powerful and widely used approach for improving large language models by grounding generation in retrieved evidence. However, RAG systems still produce incorrect answers in many cases. Why…

Computation and Language · Computer Science 2026-05-15 Kai Guo , Xinnan Dai , Zhibo Zhang , Nuohan Lin , Shenglai Zeng , Jie Ren , Haoyu Han , Jiliang Tang

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Information Retrieval · Computer Science 2026-03-24 Yuqin Dai , Shuo Yang , Guoqing Wang , Yong Deng , Zhanwei Zhang , Jun Yin , Pengyu Zeng , Zhenzhe Ying , Changhua Meng , Can Yi , Yuchen Zhou , Weiqiang Wang , Shuai Lu

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

Computation and Language · Computer Science 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

Multilingual retrieval-augmented generation (MRAG) requires models to effectively acquire and integrate beneficial external knowledge from multilingual collections. However, most existing studies employ a unitive process where queries of…

Computation and Language · Computer Science 2026-04-23 Rui Qi , Fengran Mo , Yufeng Chen , Xue Zhang , Shuo Wang , Hongliang Li , Jinan Xu , Meng Jiang , Jian-Yun Nie , Kaiyu Huang

Teaching large language models (LLMs) to reason during post-training typically relies on reinforcement learning with explicit outcome- or process-based reward functions. However, in many real-world settings, obtaining or defining such…

Artificial Intelligence · Computer Science 2026-05-19 Claudio Fanconi , Nicolás Astorga , Mihaela van der Schaar

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Language models (LMs) now excel at many tasks such as few-shot learning, question answering, reasoning, and dialog. However, they sometimes generate unsupported or misleading content. A user cannot easily determine whether their outputs are…

Retrieval-augmented generation (RAG) improves knowledge-intensive question answering by incorporating external evidence. However, existing RAG methods still suffer from hallucinations and subtle reasoning errors. Recent studies introduce…

Computation and Language · Computer Science 2026-05-29 Wenhan Xiao , Ziwei Zhang , Chuanyue Yu , Xingcheng Fu , Qingyun Sun , Runhua Xu , Jianxin Li

Verifiers have been demonstrated to enhance LLM reasoning via test-time scaling (TTS). Yet, they face significant challenges in complex domains. Error propagation from incorrect intermediate reasoning can lead to false positives for…

Large Language Models (LLMs) exhibit substantial capabilities yet encounter challenges, including hallucination, outdated knowledge, and untraceable reasoning processes. Retrieval-augmented generation (RAG) has emerged as a promising…

Artificial Intelligence · Computer Science 2024-06-03 Feiteng Fang , Yuelin Bai , Shiwen Ni , Min Yang , Xiaojun Chen , Ruifeng Xu

Multi-image reasoning and grounding require understanding complex cross-image relationships at both object levels and image levels. Current Large Visual Language Models (LVLMs) face two critical challenges: the lack of cross-image reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Lihao Zheng , Jiawei Chen , Xintian Shen , Hao Ma , Tao Wei

Evaluating the social intelligence of Large Language Models (LLMs) increasingly requires moving beyond static text generation toward dynamic, adversarial interaction. We introduce the Adversarial Resource Extraction Game (AREG), a benchmark…

Computation and Language · Computer Science 2026-02-19 Adib Sakhawat , Fardeen Sadab

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

Large Vision-Language Models (LVLMs) have made remarkable strides in multimodal tasks such as visual question answering, visual grounding, and complex reasoning. However, they remain limited by static training data, susceptibility to…

Artificial Intelligence · Computer Science 2025-08-27 Chan-Wei Hu , Yueqi Wang , Shuo Xing , Chia-Ju Chen , Suofei Feng , Ryan Rossi , Zhengzhong Tu

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing the capabilities of large language models. However, existing RAG evaluation predominantly focuses on text retrieval and relies on opaque, end-to-end…

Information Retrieval · Computer Science 2025-05-19 Chuan Xu , Qiaosheng Chen , Yutong Feng , Gong Cheng

Large Multimodal Models (LMMs) excel at comprehending human instructions and demonstrate remarkable results across a broad spectrum of tasks. Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF) further refine LLMs by…

Artificial Intelligence · Computer Science 2024-10-07 Ju-Seung Byun , Jiyun Chun , Jihyung Kil , Andrew Perrault

Retrieval-augmented generation (RAG) has demonstrated strong performance in single-hop question answering (QA) by integrating external knowledge into large language models (LLMs). However, its effectiveness remains limited in multi-hop QA,…

Computation and Language · Computer Science 2026-01-13 Ningning Zhang , Chi Zhang , Zhizhong Tan , Xingxing Yang , Weiping Deng , Wenyong Wang

Recent advancements in Retrieval-Augmented Generation (RAG) have revolutionized natural language processing by integrating Large Language Models (LLMs) with external information retrieval, enabling accurate, up-to-date, and verifiable text…

Computation and Language · Computer Science 2025-04-22 Aoran Gan , Hao Yu , Kai Zhang , Qi Liu , Wenyu Yan , Zhenya Huang , Shiwei Tong , Guoping Hu