English

NLP-based Regulatory Compliance -- Using GPT 4.0 to Decode Regulatory Documents

Computation and Language 2024-12-31 v1

Abstract

Large Language Models (LLMs) such as GPT-4.0 have shown significant promise in addressing the semantic complexities of regulatory documents, particularly in detecting inconsistencies and contradictions. This study evaluates GPT-4.0's ability to identify conflicts within regulatory requirements by analyzing a curated corpus with artificially injected ambiguities and contradictions, designed in collaboration with architects and compliance engineers. Using metrics such as precision, recall, and F1 score, the experiment demonstrates GPT-4.0's effectiveness in detecting inconsistencies, with findings validated by human experts. The results highlight the potential of LLMs to enhance regulatory compliance processes, though further testing with larger datasets and domain-specific fine-tuning is needed to maximize accuracy and practical applicability. Future work will explore automated conflict resolution and real-world implementation through pilot projects with industry partners.

Keywords

Cite

@article{arxiv.2412.20602,
  title  = {NLP-based Regulatory Compliance -- Using GPT 4.0 to Decode Regulatory Documents},
  author = {Bimal Kumar and Dmitri Roussinov},
  journal= {arXiv preprint arXiv:2412.20602},
  year   = {2024}
}

Comments

accepted for presentation at Georg Nemetschek Institute Symposium & Expo on Artificial Intelligence for the Built World - Munich, Germany. 12 Sept 2024

R2 v1 2026-06-28T20:51:28.353Z