English
Related papers

Related papers: HLTCOE at LiveRAG: GPT-Researcher using ColBERT re…

200 papers

Retrieving relevant past interactions from long-term conversational memory typically relies on large dense retrieval models (110M-1.5B parameters) or LLM-augmented indexing. We introduce SelRoute, a framework that routes each query to a…

Information Retrieval · Computer Science 2026-04-06 Matthew McKee

This work uses the state-of-the-art language model GPT-3 to offer a novel method of information extraction for knowledge base development. The suggested method attempts to solve the difficulties associated with obtaining relevant entities…

Computation and Language · Computer Science 2024-08-12 Ritabrata Roy Choudhury , Soumik Dey

We introduce LLMQuoter, a lightweight, distillation-based model designed to enhance Retrieval Augmented Generation (RAG) by extracting the most relevant textual evidence for downstream reasoning tasks. Built on the LLaMA-3B architecture and…

Computation and Language · Computer Science 2025-01-13 Yuri Facanha Bezerra , Li Weigang

Transformer-based Cross-Encoders achieve state-of-the-art effectiveness in text retrieval. However, Cross-Encoders based on large transformer models (such as BERT or T5) are computationally expensive and allow for scoring only a small…

Information Retrieval · Computer Science 2024-04-01 Aleksandr V. Petrov , Sean MacAvaney , Craig Macdonald

This paper introduces a comprehensive framework for the evaluation and validation of generative language models (GLMs), with a focus on Retrieval-Augmented Generation (RAG) systems deployed in high-stakes domains such as banking. GLM…

Computation and Language · Computer Science 2024-12-10 Agus Sudjianto , Aijun Zhang , Srinivas Neppalli , Tarun Joshi , Michal Malohlava

We introduce SetBERT, a fine-tuned BERT-based model designed to enhance query embeddings for set operations and Boolean logic queries, such as Intersection (AND), Difference (NOT), and Union (OR). SetBERT significantly improves retrieval…

Computation and Language · Computer Science 2024-06-27 Quan Mai , Susan Gauch , Douglas Adams

Generative retrieval models encode pointers to information in a corpus as an index within the model's parameters. These models serve as part of a larger pipeline, where retrieved information conditions generation for knowledge-intensive NLP…

Information Retrieval · Computer Science 2024-02-26 EuiYul Song , Sangryul Kim , Haeju Lee , Joonkee Kim , James Thorne

Question answering systems (QA) utilizing Large Language Models (LLMs) heavily depend on the retrieval component to provide them with domain-specific information and reduce the risk of generating inaccurate responses or hallucinations.…

Computation and Language · Computer Science 2024-06-11 Ashkan Alinejad , Krtin Kumar , Ali Vahdat

Recently, DeepSeek-R1 (671B) (DeepSeek-AIet al., 2025) has demonstrated its excellent reasoning ability in complex tasks and has publiclyshared its methodology. This provides potentially high-quality chain-of-thought (CoT) data for…

Artificial Intelligence · Computer Science 2025-04-17 Qianjin Yu , Keyu Wu , Zihan Chen , Chushu Zhang , Manlin Mei , Lingjun Huang , Fang Tan , Yongsheng Du , Kunlin Liu , Yurui Zhu

Given a graph with textual attributes, we enable users to `chat with their graph': that is, to ask questions about the graph using a conversational interface. In response to a user's questions, our method provides textual replies and…

Machine Learning · Computer Science 2024-05-28 Xiaoxin He , Yijun Tian , Yifei Sun , Nitesh V. Chawla , Thomas Laurent , Yann LeCun , Xavier Bresson , Bryan Hooi

While language models (LMs) have proven remarkably adept at generating code, many programs are challenging for LMs to generate using their parametric knowledge alone. Providing external contexts such as library documentation can facilitate…

Software Engineering · Computer Science 2025-02-28 Zora Zhiruo Wang , Akari Asai , Xinyan Velocity Yu , Frank F. Xu , Yiqing Xie , Graham Neubig , Daniel Fried

Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the…

Computation and Language · Computer Science 2026-04-15 Xudong Wang , Chaoning Zhang , Qigan Sun , Zhenzhen Huang , Chang Lu , Sheng Zheng , Zeyu Ma , Caiyan Qin , Yang Yang , Hengtao Shen

Knowledge tracing (KT) aims to estimate student's knowledge mastery based on their historical interactions. Recently, the deep learning based KT (DLKT) approaches have achieved impressive performance in the KT task. These DLKT models…

Computers and Society · Computer Science 2024-10-28 Hengyuan Zhang , Zitao Liu , Shuyan Huang , Chenming Shang , Bojun Zhan , Yong Jiang

We present a retrieval-augmented question answering framework for 5G/6G networks, where the Open Radio Access Network (O-RAN) has become central to disaggregated, virtualized, and AI-driven wireless systems. While O-RAN enables multi-vendor…

Networking and Internet Architecture · Computer Science 2026-01-07 Nathan Conger , Nathan Scollar , Kemal Davaslioglu , Yalin E. Sagduyu , Sastry Kompella

Retrieval-augmented question-answering systems combine retrieval techniques with large language models to provide answers that are more accurate and informative. Many existing toolkits allow users to quickly build such systems using…

Computation and Language · Computer Science 2024-03-05 Xiao Yu , Yunan Lu , Zhou Yu

This paper studies the performances of BERT combined with tree structure in short sentence ranking task. In retrieval-based question answering system, we retrieve the most similar question of the query question by ranking all the questions…

Computation and Language · Computer Science 2019-09-09 Tong Guo , Huilin Gao

Head Start programs utilizing GoEngage face significant challenges when new or rotating staff attempt to locate appropriate Tasks (modules) on the platform homepage. These difficulties arise from domain-specific jargon (e.g., IFPA, DRDP),…

Computation and Language · Computer Science 2025-10-08 Bowen Wei

Retrieval-Augmented Generation (RAG) mitigates LLM hallucinations but introduces a critical vulnerability: corpus integrity. We present SilentRetrieval, a two-stage data poisoning attack that hijacks RAG systems through adversarially…

Cryptography and Security · Computer Science 2026-05-28 Jiachen Qian

Prompting-based large language models (LLMs) are surprisingly powerful at generating natural language reasoning steps or Chains-of-Thoughts (CoT) for multi-step question answering (QA). They struggle, however, when the necessary knowledge…

Computation and Language · Computer Science 2023-06-26 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

This paper presents a detailed evaluation of a Retrieval-Augmented Generation (RAG) system that integrates large language models (LLMs) to enhance information retrieval and instruction generation for maintenance personnel across diverse…

Information Retrieval · Computer Science 2025-02-28 Akos Nagy , Yannis Spyridis , Vasileios Argyriou