Deep Learning for Medical Text Processing: BERT Model Fine-Tuning and Comparative Study
Abstract
This paper proposes a medical literature summary generation method based on the BERT model to address the challenges brought by the current explosion of medical information. By fine-tuning and optimizing the BERT model, we develop an efficient summary generation system that can quickly extract key information from medical literature and generate coherent, accurate summaries. In the experiment, we compared various models, including Seq-Seq, Attention, Transformer, and BERT, and demonstrated that the improved BERT model offers significant advantages in the Rouge and Recall metrics. Furthermore, the results of this study highlight the potential of knowledge distillation techniques to further enhance model performance. The system has demonstrated strong versatility and efficiency in practical applications, offering a reliable tool for the rapid screening and analysis of medical literature.
Cite
@article{arxiv.2410.20792,
title = {Deep Learning for Medical Text Processing: BERT Model Fine-Tuning and Comparative Study},
author = {Jiacheng Hu and Yiru Cang and Guiran Liu and Meiqi Wang and Weijie He and Runyuan Bao},
journal= {arXiv preprint arXiv:2410.20792},
year = {2024}
}