English
Related papers

Related papers: A model and package for German ColBERT

200 papers

Retrieval-Augmented Generation (RAG) has demonstrated strong effectiveness in knowledge-intensive tasks by grounding language generation in external evidence. Despite its success, many existing RAG systems are built based on a…

Computation and Language · Computer Science 2026-04-27 Lichang Song , Ting Long , Yi Chang

With the rapid development of large-scale language models, Retrieval-Augmented Generation (RAG) has been widely adopted. However, existing RAG paradigms are inevitably influenced by erroneous retrieval information, thereby reducing the…

Information Retrieval · Computer Science 2024-05-30 Ridong Wu , Shuhong Chen , Xiangbiao Su , Yuankai Zhu , Yifei Liao , Jianming Wu

Transformer-based pre-trained language models such as BERT have achieved remarkable results in Semantic Sentence Matching. However, existing models still suffer from insufficient ability to capture subtle differences. Minor noise like word…

Computation and Language · Computer Science 2023-04-17 Sirui Wang , Di Liang , Jian Song , Yuntao Li , Wei Wu

While (large) language models have significantly improved over the last years, they still struggle to sensibly process long sequences found, e.g., in books, due to the quadratic scaling of the underlying attention mechanism. To address…

Computation and Language · Computer Science 2024-06-14 Tamara Czinczoll , Christoph Hönes , Maximilian Schall , Gerard de Melo

Since the launch of ChatGPT at the end of 2022, generative dialogue models represented by ChatGPT have quickly become essential tools in daily life. As user expectations increase, enhancing the capability of generative dialogue models to…

Computation and Language · Computer Science 2024-09-02 Yuetong Zhao , Hongyu Cao , Xianyu Zhao , Zhijian Ou

Current large language models (LLMs) have proven useful for analyzing financial data, but most existing models, such as BloombergGPT and FinGPT, lack customization for specific user needs. In this paper, we address this gap by developing…

Computational Engineering, Finance, and Science · Computer Science 2024-10-22 Felix Tian , Ajay Byadgi , Daniel Kim , Daochen Zha , Matt White , Kairong Xiao , Xiao-Yang Liu Yanglet

We introduce MoRAG, a novel multi-part fusion based retrieval-augmented generation strategy for text-based human motion generation. The method enhances motion diffusion models by leveraging additional knowledge obtained through an improved…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Sai Shashank Kalakonda , Shubh Maheshwari , Ravi Kiran Sarvadevabhatla

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user needs. However, existing RAG systems…

Information Retrieval · Computer Science 2025-04-29 Zirui Guo , Lianghao Xia , Yanhua Yu , Tu Ao , Chao Huang

The advent of Large Language Models has revolutionized information retrieval, ushering in a new era of expansive knowledge accessibility. While these models excel in providing open-world knowledge, effectively extracting answers in diverse…

Information Retrieval · Computer Science 2024-01-04 Syed Rameel Ahmad

Retrieval-augmented generation (RAG) has emerged as a powerful framework for enhancing large language models (LLMs) with external knowledge, particularly in scientific domains that demand specialized and dynamic information. Despite its…

Computation and Language · Computer Science 2026-02-17 Xianrui Zhong , Bowen Jin , Siru Ouyang , Yanzhen Shen , Qiao Jin , Yin Fang , Zhiyong Lu , Jiawei Han

Retrieval-Augmented Generation (RAG) methods augment the input of Large Language Models (LLMs) with relevant retrieved passages, reducing factual errors in knowledge-intensive tasks. However, contemporary RAG approaches suffer from…

Computation and Language · Computer Science 2024-05-24 Dian Jiao , Li Cai , Jingsheng Huang , Wenqiao Zhang , Siliang Tang , Yueting Zhuang

Cross-modal retrieval is gaining increasing efficacy and interest from the research community, thanks to large-scale training, novel architectural and learning designs, and its application in LLMs and multimodal LLMs. In this paper, we move…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Davide Caffagni , Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Retrieval-Augmented Generation (RAG) has become a powerful paradigm for enhancing large language models (LLMs) through external knowledge retrieval. Despite its widespread attention, existing academic research predominantly focuses on…

Information Retrieval · Computer Science 2024-10-31 Yiruo Cheng , Kelong Mao , Ziliang Zhao , Guanting Dong , Hongjin Qian , Yongkang Wu , Tetsuya Sakai , Ji-Rong Wen , Zhicheng Dou

In this paper, we introduce CollEx, an innovative multimodal agentic Retrieval-Augmented Generation (RAG) system designed to enhance interactive exploration of extensive scientific collections. Given the overwhelming volume and inherent…

Information Retrieval · Computer Science 2025-04-11 Florian Schneider , Narges Baba Ahmadi , Niloufar Baba Ahmadi , Iris Vogel , Martin Semmann , Chris Biemann

Establishing retrieval-based dialogue systems that can select appropriate responses from the pre-built index has gained increasing attention from researchers. For this task, the adoption of pre-trained language models (such as BERT) has led…

Computation and Language · Computer Science 2021-10-04 Chongyang Tao , Jiazhan Feng , Chang Liu , Juntao Li , Xiubo Geng , Daxin Jiang

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for grounding Large Language Model (LLM)-based chatbot responses on external knowledge. However, existing RAG studies typically assume well-structured textual sources…

Computation and Language · Computer Science 2026-02-13 Sungmoon Kim , Hyuna Jeon , Dahye Kim , Mingyu Kim , Dong-Kyu Chae , Jiwoong Kim

Retrieval Augmented Generation (RAG) is a common method for integrating external knowledge into pretrained Large Language Models (LLMs) to enhance accuracy and relevancy in question answering (QA) tasks. However, prompt engineering and…

Computation and Language · Computer Science 2024-10-18 Isaac Chung , Phat Vo , Arman C. Kizilkale , Aaron Reite

This paper investigates the design of a unified search engine to serve multiple retrieval-augmented generation (RAG) agents, each with a distinct task, backbone large language model (LLM), and RAG strategy. We introduce an iterative…

Computation and Language · Computer Science 2025-06-27 Alireza Salemi , Hamed Zamani

We study efficient multi-vector retrieval for late interaction in any modality. Late interaction has emerged as a dominant paradigm for information retrieval in text, images, visual documents, and videos, but its computation and storage…

Information Retrieval · Computer Science 2026-02-25 Hanxiang Qin , Alexander Martin , Rohan Jha , Chunsheng Zuo , Reno Kriz , Benjamin Van Durme

Large language models (LLMs) excel at natural language tasks but are limited by their static parametric knowledge, especially in knowledge-intensive task. Retrieval-augmented generation (RAG) mitigates this by integrating external…

Artificial Intelligence · Computer Science 2025-10-10 Yi Jiang , Lei Shen , Lujie Niu , Sendong Zhao , Wenbo Su , Bo Zheng