Computation and Language · Computer Science
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding
Wei Wang, Bin Bi, Ming Yan, Chen Wu +4
2019-09-30
Computation and Language · Computer Science
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld +2
2020-01-22
Computation and Language · Computer Science
Comparative Study of Machine Learning Models and BERT on SQuAD
Devshree Patel, Param Raval, Ratnam Parikh, Yesha Shastri
2020-05-25
Computation and Language · Computer Science
FAT ALBERT: Finding Answers in Large Texts using Semantic Similarity Attention Layer based on BERT
Omar Mossad, Amgad Ahmed, Anandharaju Raju, Hari Karthikeyan +1
2020-09-03
Computation and Language · Computer Science
Pre-trained Language Model for Biomedical Question Answering
Wonjin Yoon, Jinhyuk Lee, Donghyeon Kim, Minbyul Jeong +1
2019-09-19
Computation and Language · Computer Science
Span Selection Pre-training for Question Answering
Michael Glass, Alfio Gliozzo, Rishav Chakravarti, Anthony Ferritto +4
2020-06-22
Computation and Language · Computer Science
SPBERT: An Efficient Pre-training BERT on SPARQL Queries for Question Answering over Knowledge Graphs
Hieu Tran, Long Phan, James Anibal, Binh T. Nguyen +1
2021-07-02
Computation and Language · Computer Science
SpeechBERT: An Audio-and-text Jointly Learned Language Model for End-to-end Spoken Question Answering
Yung-Sung Chuang, Chi-Liang Liu, Hung-Yi Lee, Lin-shan Lee
2020-08-12
Computation and Language · Computer Science
Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRC
Alex John Quijano, Sam Nguyen, Juanita Ordonez
2021-03-30
Computation and Language · Computer Science
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT
Souvik Kundu, Sharath Nittur Sridhar, Maciej Szankin, Sairam Sundaresan
2023-09-01
Computation and Language · Computer Science
MathBERT: A Pre-Trained Model for Mathematical Formula Understanding
Shuai Peng, Ke Yuan, Liangcai Gao, Zhi Tang
2021-05-04
Computation and Language · Computer Science
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
2019-05-28
Computation and Language · Computer Science
ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding
Minjeong Kim, Gyuwan Kim, Sang-Woo Lee, Jung-Woo Ha
2021-04-13
Computation and Language · Computer Science
Blockwise Self-Attention for Long Document Understanding
Jiezhong Qiu, Hao Ma, Omer Levy, Scott Wen-tau Yih +2
2020-11-03
Computation and Language · Computer Science
DABERT: Dual Attention Enhanced BERT for Semantic Matching
Sirui Wang, Di Liang, Jian Song, Yuntao Li +1
2023-04-17