English

Augmenting Question Answering with A Hybrid RAG Approach

Computation and Language 2026-01-27 v2 Artificial Intelligence

Abstract

Retrieval-Augmented Generation (RAG) has emerged as a powerful technique for enhancing the quality of responses in Question-Answering (QA) tasks. However, existing approaches often struggle with retrieving contextually relevant information, leading to incomplete or suboptimal answers. In this paper, we introduce Structured-Semantic RAG (SSRAG), a hybrid architecture that enhances QA quality by integrating query augmentation, agentic routing, and a structured retrieval mechanism combining vector and graph based techniques with context unification. By refining retrieval processes and improving contextual grounding, our approach improves both answer accuracy and informativeness. We conduct extensive evaluations on three popular QA datasets, TruthfulQA, SQuAD and WikiQA, across five Large Language Models (LLMs), demonstrating that our proposed approach consistently improves response quality over standard RAG implementations.

Keywords

Cite

@article{arxiv.2601.12658,
  title  = {Augmenting Question Answering with A Hybrid RAG Approach},
  author = {Tianyi Yang and Nashrah Haque and Vaishnave Jonnalagadda and Yuya Jeremy Ong and Zhehui Chen and Yanzhao Wu and Lei Yu and Divyesh Jadav and Wenqi Wei},
  journal= {arXiv preprint arXiv:2601.12658},
  year   = {2026}
}

Comments

10 pages, 5 tables, 2 figures; presented at IEEE CogMI 2025

R2 v1 2026-07-01T09:09:54.425Z