English
Related papers

Related papers: From MTEB to MTOB: Retrieval-Augmented Classificat…

200 papers

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

Retrieval augmented generation (RAG) has been applied in many scenarios to augment large language models (LLMs) with external documents provided by retrievers. However, a semantic gap exists between LLMs and retrievers due to differences in…

Computation and Language · Computer Science 2024-10-31 Fuda Ye , Shuangyin Li , Yongqi Zhang , Lei Chen

Retrieval-augmented generation (RAG) is a popular technique for using large language models (LLMs) to build customer-support, question-answering solutions. In this paper, we share our team's practical experience building and maintaining…

Information Retrieval · Computer Science 2024-10-18 Sarah Packowski , Inge Halilovic , Jenifer Schlotfeldt , Trish Smith

Despite the impressive performance of Retrieval-augmented Generation (RAG) systems across various NLP benchmarks, their robustness in handling real-world user-LLM interaction queries remains largely underexplored. This presents a critical…

Computation and Language · Computer Science 2026-01-28 Tianyu Cao , Neel Bhandari , Akhila Yerukola , Akari Asai , Maarten Sap

Retrieval-Augmented Generation (RAG) is a powerful approach that enables large language models (LLMs) to incorporate external knowledge. However, evaluating the effectiveness of RAG systems in specialized scenarios remains challenging due…

Computation and Language · Computer Science 2025-03-05 Kunlun Zhu , Yifan Luo , Dingling Xu , Yukun Yan , Zhenghao Liu , Shi Yu , Ruobing Wang , Shuo Wang , Yishan Li , Nan Zhang , Xu Han , Zhiyuan Liu , Maosong Sun

Accurate multi-modal document retrieval is crucial for Retrieval-Augmented Generation (RAG), yet existing benchmarks do not fully capture real-world challenges with their current design. We introduce REAL-MM-RAG, an automatically generated…

Information Retrieval · Computer Science 2025-02-19 Navve Wasserman , Roi Pony , Oshri Naparstek , Adi Raz Goldfarb , Eli Schwartz , Udi Barzelay , Leonid Karlinsky

The paradigm of retrieval-augmented generated (RAG) helps mitigate hallucinations of large language models (LLMs). However, RAG also introduces biases contained within the retrieved documents. These biases can be amplified in scenarios…

Computation and Language · Computer Science 2025-06-24 Bryan Li , Fiona Luo , Samar Haider , Adwait Agashe , Tammy Li , Runqi Liu , Muqing Miao , Shriya Ramakrishnan , Yuan Yuan , Chris Callison-Burch

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in…

Information Retrieval · Computer Science 2024-11-20 Sonal Prabhune , Donald J. Berndt

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Multilingual Retrieval-Augmented Generation (mRAG) leverages cross-lingual evidence to ground Large Language Models (LLMs) in global knowledge. However, we show that current mRAG systems suffer from a language bias during reranking,…

Computation and Language · Computer Science 2026-04-23 Dan Wang , Guozhao Mo , Yafei Shi , Cheng Zhang , Bo Zheng , Boxi Cao , Xuanang Chen , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Le Sun

Topic modeling has evolved as an important means to identify evident or hidden topics within large collections of text documents. Topic modeling approaches are often used for analyzing and making sense of social media discussions consisting…

Social and Information Networks · Computer Science 2026-02-20 Lisa Grobelscheg , Ema Kahr , Mark Strembeck

Recent advancements in Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains. While they exhibit strong zero-shot performance on various tasks, LLMs' effectiveness in music-related applications…

Computation and Language · Computer Science 2025-12-09 Daeyong Kwon , SeungHeon Doh , Juhan Nam

The advent of Large Language Models has revolutionized information retrieval, ushering in a new era of expansive knowledge accessibility. While these models excel in providing open-world knowledge, effectively extracting answers in diverse…

Information Retrieval · Computer Science 2024-01-04 Syed Rameel Ahmad

Large language models (LLMs) have recently become the leading source of answers for users' questions online. Despite their ability to offer eloquent answers, their accuracy and reliability can pose a significant challenge. This is…

Computation and Language · Computer Science 2024-07-09 Bojana Bašaragin , Adela Ljajić , Darija Medvecki , Lorenzo Cassano , Miloš Košprdić , Nikola Milošević

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

Information Retrieval · Computer Science 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

Retrieval-augmented generation (RAG) has emerged as a leading approach to reducing hallucinations in large language models (LLMs). Current RAG evaluation benchmarks primarily focus on what we call local RAG: retrieving relevant chunks from…

Computation and Language · Computer Science 2025-11-05 Qi Luo , Xiaonan Li , Tingshuo Fan , Xinchi Chen , Xipeng Qiu

Retrieval-Augmented Generation (RAG) has emerged as a standard framework for knowledge-intensive NLP tasks, combining large language models (LLMs) with document retrieval from external corpora. Despite its widespread use, most RAG pipelines…

Information Retrieval · Computer Science 2025-08-26 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

Retrieval-Augmented Generation (RAG) has recently gained traction in natural language processing. Numerous studies and real-world applications are leveraging its ability to enhance generative models through external information retrieval.…

Computation and Language · Computer Science 2025-02-17 Hao Yu , Aoran Gan , Kai Zhang , Shiwei Tong , Qi Liu , Zhaofeng Liu

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

Information Retrieval · Computer Science 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

Large language models (LLMs) typically utilize the top-k contexts from a retriever in retrieval-augmented generation (RAG). In this work, we propose a novel instruction fine-tuning framework RankRAG, which instruction-tunes a single LLM for…

Computation and Language · Computer Science 2024-07-03 Yue Yu , Wei Ping , Zihan Liu , Boxin Wang , Jiaxuan You , Chao Zhang , Mohammad Shoeybi , Bryan Catanzaro