English

LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks

Computer Vision and Pattern Recognition 2024-02-21 v1 Artificial Intelligence

Abstract

LangXAI is a framework that integrates Explainable Artificial Intelligence (XAI) with advanced vision models to generate textual explanations for visual recognition tasks. Despite XAI advancements, an understanding gap persists for end-users with limited domain knowledge in artificial intelligence and computer vision. LangXAI addresses this by furnishing text-based explanations for classification, object detection, and semantic segmentation model outputs to end-users. Preliminary results demonstrate LangXAI's enhanced plausibility, with high BERTScore across tasks, fostering a more transparent and reliable AI framework on vision tasks for end-users.

Keywords

Cite

@article{arxiv.2402.12525,
  title  = {LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks},
  author = {Truong Thanh Hung Nguyen and Tobias Clement and Phuc Truong Loc Nguyen and Nils Kemmerzell and Van Binh Truong and Vo Thanh Khang Nguyen and Mohamed Abdelaal and Hung Cao},
  journal= {arXiv preprint arXiv:2402.12525},
  year   = {2024}
}
R2 v1 2026-06-28T14:53:45.605Z