English

Conversational Factor Information Retrieval Model (ConFIRM)

Information Retrieval 2024-10-10 v4 Artificial Intelligence Computational Engineering, Finance, and Science Computation and Language Machine Learning

Abstract

This paper introduces the Conversational Factor Information Retrieval Method (ConFIRM), a novel approach to fine-tuning large language models (LLMs) for domain-specific retrieval tasks. ConFIRM leverages the Five-Factor Model of personality to generate synthetic datasets that accurately reflect target population characteristics, addressing data scarcity in specialized domains. We demonstrate ConFIRM's effectiveness through a case study in the finance sector, fine-tuning a Llama-2-7b model using personality-aligned data from the PolyU-Asklora Fintech Adoption Index. The resulting model achieved 91% accuracy in classifying financial queries, with an average inference time of 0.61 seconds on an NVIDIA A100 GPU. ConFIRM shows promise for creating more accurate and personalized AI-driven information retrieval systems across various domains, potentially mitigating issues of hallucinations and outdated information in LLMs deployed

Keywords

Cite

@article{arxiv.2310.13001,
  title  = {Conversational Factor Information Retrieval Model (ConFIRM)},
  author = {Stephen Choi and William Gazeley and Siu Ho Wong and Tingting Li},
  journal= {arXiv preprint arXiv:2310.13001},
  year   = {2024}
}

Comments

8 pages, 2 figures, 2 tables, 2 appendices

R2 v1 2026-06-28T12:55:59.290Z