English

Personalization of Code Readability Evaluation Based on LLM Using Collaborative Filtering

Software Engineering 2024-12-04 v2

Abstract

Code readability is an important indicator of software maintenance as it can significantly impact maintenance efforts. Recently, LLM (large language models) have been utilized for code readability evaluation. However, readability evaluation differs among developers, so personalization of the evaluation by LLM is needed. This study proposes a method which calibrates the evaluation, using collaborative filtering. Our preliminary analysis suggested that the method effectively enhances the accuracy of the readability evaluation using LLMs.

Keywords

Cite

@article{arxiv.2411.10583,
  title  = {Personalization of Code Readability Evaluation Based on LLM Using Collaborative Filtering},
  author = {Buntaro Hiraki and Kensei Hamamoto and Ami Kimura and Masateru Tsunoda and Amjed Tahir and Kwabena Ebo Bennin and Akito Monden and Keitaro Nakasai},
  journal= {arXiv preprint arXiv:2411.10583},
  year   = {2024}
}

Comments

2 pages, 2 figures, 1 table

R2 v1 2026-06-28T20:01:54.962Z