English
Related papers

Related papers: DQA: Diagnostic Question Answering for IT Support

200 papers

Retrieval-Augmented Generation (RAG) aims to reduce hallucination by grounding answers in retrieved evidence, yet hallucinated answers remain common even when relevant documents are available. Existing evaluations focus on answer-level or…

Computation and Language · Computer Science 2026-05-21 Passant Elchafei , Monorama Swain , Shahed Masoudian , Markus Schedl

Retrieval-Augmented Generation (RAG) has emerged as a powerful technique for enhancing the quality of responses in Question-Answering (QA) tasks. However, existing approaches often struggle with retrieving contextually relevant information,…

Computation and Language · Computer Science 2026-01-27 Tianyi Yang , Nashrah Haque , Vaishnave Jonnalagadda , Yuya Jeremy Ong , Zhehui Chen , Yanzhao Wu , Lei Yu , Divyesh Jadav , Wenqi Wei

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

Machine Learning · Computer Science 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

A database D may be inconsistent wrt a given set IC of integrity constraints. Consistent Query Answering (CQA) is the problem of computing from D the answers to a query that are consistent wrt IC . Consistent answers are invariant under all…

Databases · Computer Science 2016-05-24 Andrei Lopatenko , Leopoldo Bertossi

With the ever-increasing demands on Question Answering (QA) systems for IT operations and maintenance, an efficient and supervised fine-tunable framework is necessary to ensure the data security, private deployment and continuous upgrading.…

Artificial Intelligence · Computer Science 2025-06-04 Tianyang Zhang , Zhuoxuan Jiang , Shengguang Bai , Tianrui Zhang , Lin Lin , Yang Liu , Jiawei Ren

Retrieval Augmented Generation (RAG) has become one of the most popular methods for bringing knowledge-intensive context to large language models (LLM) because of its ability to bring local context at inference time without the cost or data…

Information Retrieval · Computer Science 2025-05-02 Michael J. Ryan , Danmei Xu , Chris Nivera , Daniel Campos

Retrieval-augmented generation (RAG) systems are widely used in question-answering (QA) tasks, but current benchmarks lack metadata integration, limiting their evaluation in scenarios requiring both textual data and external information. To…

Information Retrieval · Computer Science 2026-02-13 Davide Bruni , Marco Avvenuti , Nicola Tonellotto , Maurizio Tesconi

In the constantly evolving field of cybersecurity, it is imperative for analysts to stay abreast of the latest attack trends and pertinent information that aids in the investigation and attribution of cyber-attacks. In this work, we…

Cryptography and Security · Computer Science 2024-08-13 Sampath Rajapaksha , Ruby Rani , Erisa Karafili

Question Answering (QA) systems face challenges in handling complex questions that require multi-domain knowledge synthesis. The naive RAG models, although effective in information retrieval, struggle with complex questions that require…

Computation and Language · Computer Science 2024-10-24 Ziyang Chen , Xiaobin Wang , Yong Jiang , Jinzhi Liao , Pengjun Xie , Fei Huang , Xiang Zhao

Retrieval-Augmented Generation (RAG) systems have shown substantial benefits in applications such as question answering and multi-turn dialogue \citep{lewis2020retrieval}. However, traditional RAG methods, while leveraging static knowledge…

Computation and Language · Computer Science 2025-02-20 Feiyuan Zhang , Dezhi Zhu , James Ming , Yilun Jin , Di Chai , Liu Yang , Han Tian , Zhaoxin Fan , Kai Chen

This paper presents an advancement in Question-Answering (QA) systems using a Retrieval Augmented Generation (RAG) framework to enhance information extraction from PDF files. Recognizing the richness and diversity of data within…

Computation and Language · Computer Science 2026-04-08 Thi Thu Uyen Hoang , Meenakshi Rajendran , Kun Zhang , Yuhan Wu , Viet Anh Nguyen

As Retrieval-Augmented Generation (RAG) systems evolve toward more sophisticated architectures, ensuring their trustworthiness through explainable and robust evaluation becomes critical. Existing scalar metrics suffer from limited…

Artificial Intelligence · Computer Science 2025-12-30 Shiyan Liu , Jian Ma , Rui Qu

Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of…

Computation and Language · Computer Science 2021-06-04 Munazza Zaib , Wei Emma Zhang , Quan Z. Sheng , Adnan Mahmood , Yang Zhang

In this paper, we study the problem of numerical multi-table question answering (MTQA) over large-scale table collections (e.g., online data repositories). This task is essential in many analytical applications. Existing MTQA solutions,…

Databases · Computer Science 2026-03-10 Feng Luo , Hai Lan , Hui Luo , Zhifeng Bao , Xiaoli Wang , J. Shane Culpepper , Shazia Sadiq

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

Organizations handling sensitive documents face a critical dilemma: adopt cloud-based AI systems that offer powerful question-answering capabilities but compromise data privacy, or maintain local processing that ensures security but…

Computation and Language · Computer Science 2025-12-01 Paolo Astrino

Biomedical question-answering (QA) systems require effective retrieval and generation components to ensure accuracy, efficiency, and scalability. This study systematically examines a Retrieval-Augmented Generation (RAG) system for…

Information Retrieval · Computer Science 2026-01-14 Linus Stuhlmann , Michael Alexander Saxer , Jonathan Fürst

Retrieval-Augmented Generation (RAG) is widely employed to mitigate risks such as hallucinations and knowledge obsolescence in medical question answering, yet its predominantly single-round, static retrieval paradigm misaligns with the…

Computation and Language · Computer Science 2026-05-19 Yongfeng Huang , Ruiying Chen , James Cheng

Retrieval-augmented generation (RAG) based on large language models often falters on narrative documents with inherent temporal structures. Standard unstructured RAG methods rely solely on embedding-similarity matching and lack any general…

Information Retrieval · Computer Science 2025-06-09 Ze Yu Zhang , Zitao Li , Yaliang Li , Bolin Ding , Bryan Kian Hsiang Low

Retrieval-Augmented Generation (RAG) systems face significant performance gaps when applied to technical domains requiring precise information extraction from complex documents. Current evaluation methodologies relying on document-level…

Machine Learning · Computer Science 2025-02-25 Aryan Jadon , Avinash Patil , Shashank Kumar