SplaXBERT:基于混合精度训练与上下文分割的问答系统
计算与语言
2024-12-10 v1 机器学习
摘要
SplaXBERT基于ALBERT-xlarge模型,采用上下文分割和混合精度训练技术,在长文本问答任务上实现了高效性能。在SQuAD v1.1数据集上测试,Exact Match达到85.95%,F1 Score达到92.97%,在准确率和资源效率方面均优于传统基于BERT的模型。
引用
@article{arxiv.2412.05499,
title = {SplaXBERT: Leveraging Mixed Precision Training and Context Splitting for Question Answering},
author = {Zhu Yufan and Hao Zeyu and Li Siqi and Niu Boqian},
journal= {arXiv preprint arXiv:2412.05499},
year = {2024}
}