English

Ensemble Making Few-Shot Learning Stronger

Computation and Language 2021-05-26 v1 Artificial Intelligence Machine Learning

Abstract

Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortage of capturing a certain aspect of semantic features, for example, CNN on long-range dependencies part, Transformer on local features. It is difficult for a single model to adapt to various relation learning, which results in the high variance problem. Ensemble strategy could be competitive on improving the accuracy of few-shot relation extraction and mitigating high variance risks. This paper explores an ensemble approach to reduce the variance and introduces fine-tuning and feature attention strategies to calibrate relation-level features. Results on several few-shot relation learning tasks show that our model significantly outperforms the previous state-of-the-art models.

Keywords

Cite

@article{arxiv.2105.11904,
  title  = {Ensemble Making Few-Shot Learning Stronger},
  author = {Qing Lin and Yongbin Liu and Wen Wen and Zhihua Tao},
  journal= {arXiv preprint arXiv:2105.11904},
  year   = {2021}
}
R2 v1 2026-06-24T02:26:49.230Z