English

Keyword Extraction, and Aspect Classification in Sinhala, English, and Code-Mixed Content

Computation and Language 2025-04-16 v1 Artificial Intelligence Machine Learning

Abstract

Brand reputation in the banking sector is maintained through insightful analysis of customer opinion on code-mixed and multilingual content. Conventional NLP models misclassify or ignore code-mixed text, when mix with low resource languages such as Sinhala-English and fail to capture domain-specific knowledge. This study introduces a hybrid NLP method to improve keyword extraction, content filtering, and aspect-based classification of banking content. Keyword extraction in English is performed with a hybrid approach comprising a fine-tuned SpaCy NER model, FinBERT-based KeyBERT embeddings, YAKE, and EmbedRank, which results in a combined accuracy of 91.2%. Code-mixed and Sinhala keywords are extracted using a fine-tuned XLM-RoBERTa model integrated with a domain-specific Sinhala financial vocabulary, and it results in an accuracy of 87.4%. To ensure data quality, irrelevant comment filtering was performed using several models, with the BERT-base-uncased model achieving 85.2% for English and XLM-RoBERTa 88.1% for Sinhala, which was better than GPT-4o, SVM, and keyword-based filtering. Aspect classification followed the same pattern, with the BERT-base-uncased model achieving 87.4% for English and XLM-RoBERTa 85.9% for Sinhala, both exceeding GPT-4 and keyword-based approaches. These findings confirm that fine-tuned transformer models outperform traditional methods in multilingual financial text analysis. The present framework offers an accurate and scalable solution for brand reputation monitoring in code-mixed and low-resource banking environments.

Keywords

Cite

@article{arxiv.2504.10679,
  title  = {Keyword Extraction, and Aspect Classification in Sinhala, English, and Code-Mixed Content},
  author = {F. A. Rizvi and T. Navojith and A. M. N. H. Adhikari and W. P. U. Senevirathna and Dharshana Kasthurirathna and Lakmini Abeywardhana},
  journal= {arXiv preprint arXiv:2504.10679},
  year   = {2025}
}

Comments

6 Pages, 2 figures, 7 Tables

R2 v1 2026-06-28T22:58:21.515Z