English
Related papers

Related papers: Transformer-Based Models for Question Answering on…

200 papers

We present the first end-to-end, transformer-based table question answering (QA) system that takes natural language questions and massive table corpus as inputs to retrieve the most relevant tables and locate the correct table cells to…

Computation and Language · Computer Science 2021-06-10 Feifei Pan , Mustafa Canim , Michael Glass , Alfio Gliozzo , Peter Fox

This paper describes our submissions for the Social Media Mining for Health (SMM4H)2021 shared tasks. We participated in 2 tasks:(1) Classification, extraction and normalization of adverse drug effect (ADE) mentions in English tweets…

Computation and Language · Computer Science 2021-04-16 Sidharth R , Abhiraj Tiwari , Parthivi Choubey , Saisha Kashyap , Sahil Khose , Kumud Lakara , Nishesh Singh , Ujjwal Verma

For the last two years, from 2020 to 2021, COVID-19 has broken disease prevention measures in many countries, including Vietnam, and negatively impacted various aspects of human life and the social community. Besides, the misleading…

Computation and Language · Computer Science 2022-09-15 Triet Minh Thai , Ngan Ha-Thao Chu , Anh Tuan Vo , Son T. Luu

Motivated by the emerging demand in the financial industry for the automatic analysis of unstructured and structured data at scale, Question Answering (QA) systems can provide lucrative and competitive advantages to companies by…

Computation and Language · Computer Science 2025-05-05 Bithiah Yuan

This study presents an efficient transformer-based question-answering (QA) model optimized for deployment on a 13th Gen Intel i7-1355U CPU, using the Stanford Question Answering Dataset (SQuAD) v1.1. Leveraging exploratory data analysis,…

Computation and Language · Computer Science 2025-05-30 Ngeyen Yinkfu

In this work, we present an end-to-end Knowledge Graph Question Answering (KGQA) system named GETT-QA. GETT-QA uses T5, a popular text-to-text pre-trained language model. The model takes a question in natural language as input and produces…

Computation and Language · Computer Science 2023-03-29 Debayan Banerjee , Pranav Ajit Nair , Ricardo Usbeck , Chris Biemann

Machine question answering is an essential yet challenging task in natural language processing. Recently, Pre-trained Contextual Embeddings (PCE) models like Bidirectional Encoder Representations from Transformers (BERT) and A Lite BERT…

Computation and Language · Computer Science 2021-10-20 Shilun Li , Renee Li , Veronica Peng

Context-based question answering (CBQA) models provide more accurate and relevant answers by considering the contextual information. They effectively extract specific information given a context, making them functional in various…

Computation and Language · Computer Science 2025-12-02 Muhammad Muneeb , David B. Ascher , Ahsan Baidar Bakht

The need for skilled medical support is growing in the era of digital healthcare. This research presents an innovative strategy, utilizing the RuBERT model, for categorizing user inquiries in the field of medical consultation with a focus…

Reading comprehension systems for low-resource languages face significant challenges in handling unanswerable questions. These systems tend to produce unreliable responses when correct answers are absent from context. To solve this problem,…

Computation and Language · Computer Science 2026-03-06 Abrar Eyasir , Tahsin Ahmed , Muhammad Ibrahim

Large transformer models, such as BERT, achieve state-of-the-art results in machine reading comprehension (MRC) for open-domain question answering (QA). However, transformers have a high computational cost for inference which makes them…

Computation and Language · Computer Science 2021-08-06 Haytham ElFadeel , Stan Peshterliev

During this pandemic situation, extracting any relevant information related to COVID-19 will be immensely beneficial to the community at large. In this paper, we present a very important resource, COVIDRead, a Stanford Question Answering…

Computation and Language · Computer Science 2021-10-19 Tanik Saikh , Sovan Kumar Sahoo , Asif Ekbal , Pushpak Bhattacharyya

Identifying arguments is a necessary prerequisite for various tasks in automated discourse analysis, particularly within contexts such as political debates, online discussions, and scientific reasoning. In addition to theoretical advances…

Computation and Language · Computer Science 2025-05-29 Marc Feger , Katarina Boland , Stefan Dietze

We describe the systems developed for the WNUT-2020 shared task 2, identification of informative COVID-19 English Tweets. BERT is a highly performant model for Natural Language Processing tasks. We increased BERT's performance in this…

Computation and Language · Computer Science 2020-12-09 Dylan Whang , Soroush Vosoughi

This paper presents an empirical study of conversational question reformulation (CQR) with sequence-to-sequence architectures and pretrained language models (PLMs). We leverage PLMs to address the strong token-to-token independence…

Computation and Language · Computer Science 2020-04-07 Sheng-Chieh Lin , Jheng-Hong Yang , Rodrigo Nogueira , Ming-Feng Tsai , Chuan-Ju Wang , Jimmy Lin

An effective paradigm for building Automated Question Answering systems is the re-use of previously answered questions, e.g., for FAQs or forum applications. Given a database (DB) of question/answer (q/a) pairs, it is possible to answer a…

Computation and Language · Computer Science 2023-04-04 Stefano Campese , Ivano Lauriola , Alessandro Moschitti

This short paper presents a preliminary analysis of three popular Visual Question Answering (VQA) models, namely ViLBERT, ViLT, and LXMERT, in the context of answering questions relating to driving scenarios. The performance of these models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Kaavya Rekanar , Ciarán Eising , Ganesh Sistu , Martin Hayes

Accuracy of English-language Question Answering (QA) systems has improved significantly in recent years with the advent of Transformer-based models (e.g., BERT). These models are pre-trained in a self-supervised fashion with a large English…

Computation and Language · Computer Science 2022-04-13 Gokul Karthik Kumar , Abhishek Singh Gehlot , Sahal Shaji Mullappilly , Karthik Nandakumar

Bidirectional Encoder Representations from Transformers (BERT) reach state-of-the-art results in a variety of Natural Language Processing tasks. However, understanding of their internal functioning is still insufficient and unsatisfactory.…

Computation and Language · Computer Science 2019-09-12 Betty van Aken , Benjamin Winter , Alexander Löser , Felix A. Gers

Conversational Question Answering is a challenging task since it requires understanding of conversational history. In this project, we propose a new system RoBERTa + AT +KD, which involves rationale tagging multi-task, adversarial training,…

Computation and Language · Computer Science 2019-09-25 Ying Ju , Fubang Zhao , Shijie Chen , Bowen Zheng , Xuefeng Yang , Yunfeng Liu