English
Related papers

Related papers: Pre-trained Transformer-Based Approach for Arabic …

200 papers

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

We show that the task of question answering (QA) can significantly benefit from the transfer learning of models trained on a different large, fine-grained QA dataset. We achieve the state of the art in two well-studied QA datasets, WikiQA…

Computation and Language · Computer Science 2018-06-22 Sewon Min , Minjoon Seo , Hannaneh Hajishirzi

Natural Language Processing (NLP) faces challenges in the ability to quickly model polysemous words. The Grover's Algorithm (GA) is expected to solve this problem but lacks adaptability. To address the above dilemma, a Quantum Text…

Quantum Physics · Physics 2025-06-03 Ren-Xin Zhao

Prior work on multilingual question answering has mostly focused on using large multilingual pre-trained language models (LM) to perform zero-shot language-wise learning: train a QA model on English and test on other languages. In this…

Computation and Language · Computer Science 2020-12-14 Mihaela Bornea , Lin Pan , Sara Rosenthal , Radu Florian , Avirup Sil

Significant advances have been made in recent years on Natural Language Processing with machines surpassing human performance in many tasks, including but not limited to Question Answering. The majority of deep learning methods for Question…

Machine Learning · Computer Science 2024-09-05 Ayush Jain , N. M. Meenachi , B. Venkatraman

Recent progress in neural machine translation (NMT) has made it possible to translate successfully between monolingual language pairs where large parallel data exist, with pre-trained models improving performance even further. Although…

Machine Learning · Computer Science 2021-05-31 El Moatez Billah Nagoudi , AbdelRahim Elmadany , Muhammad Abdul-Mageed

Recent years witnessed an increase in the amount of research on the task of Question Difficulty Estimation from Text QDET with Natural Language Processing (NLP) techniques, with the goal of targeting the limitations of traditional…

Computation and Language · Computer Science 2023-05-18 Luca Benedetto

Quranic Question Answering presents unique challenges due to the linguistic complexity of Classical Arabic and the semantic richness of religious texts. In this paper, we propose a novel two-stage framework that addresses both passage…

Computation and Language · Computer Science 2025-09-05 Mohamed Basem , Islam Oshallah , Ali Hamdi , Khaled Shaban , Hozaifa Kassab

Answering questions related to the legal domain is a complex task, primarily due to the intricate nature and diverse range of legal document systems. Providing an accurate answer to a legal query typically necessitates specialized knowledge…

Computation and Language · Computer Science 2023-09-18 Abdelrahman Abdallah , Bhawna Piryani , Adam Jatowt

We frame Question Answering (QA) as a Reinforcement Learning task, an approach that we call Active Question Answering. We propose an agent that sits between the user and a black box QA system and learns to reformulate questions to elicit…

Computation and Language · Computer Science 2018-03-05 Christian Buck , Jannis Bulian , Massimiliano Ciaramita , Wojciech Gajewski , Andrea Gesmundo , Neil Houlsby , Wei Wang

The Arabic language is among the most popular languages in the world with a huge variety of dialects spoken in 22 countries. In this study, we address the problem of classifying 18 Arabic dialects of the QADI dataset of Arabic tweets. RNN…

Computation and Language · Computer Science 2025-07-01 Omar A. Essameldin , Ali O. Elbeih , Wael H. Gomaa , Wael F. Elsersy

An important task for designing QA systems is answer sentence selection (AS2): selecting the sentence containing (or constituting) the answer to a question from a set of retrieved relevant documents. In this paper, we propose three novel…

Computation and Language · Computer Science 2022-10-21 Luca Di Liello , Siddhant Garg , Luca Soldaini , Alessandro Moschitti

We present Ara-BEST-RQ, a family of self-supervised learning (SSL) models specifically designed for multi-dialectal Arabic speech processing. Leveraging 5,640 hours of crawled Creative Commons speech and combining it with publicly available…

Computation and Language · Computer Science 2026-03-24 Haroun Elleuch , Ryan Whetten , Salima Mdhaffar , Yannick Estève , Fethi Bougares

In this paper, we explore the effects of language variants, data sizes, and fine-tuning task types in Arabic pre-trained language models. To do so, we build three pre-trained language models across three variants of Arabic: Modern Standard…

Computation and Language · Computer Science 2021-09-07 Go Inoue , Bashar Alhafni , Nurpeiis Baimukan , Houda Bouamor , Nizar Habash

Transformer models have significantly advanced Natural Language Processing (NLP), demonstrating strong performance in English. However, their effectiveness in Arabic, particularly for Named Entity Recognition (NER), remains limited, even…

Computation and Language · Computer Science 2025-12-02 Ahmed Mustafa Younes

The developments that language models have provided in fulfilling almost all kinds of tasks have attracted the attention of not only researchers but also the society and have enabled them to become products. There are commercially…

Computation and Language · Computer Science 2024-04-29 Eren Dogan , M. Egemen Uzun , Atahan Uz , H. Emre Seyrek , Ahmed Zeer , Ezgi Sevi , H. Toprak Kesgin , M. Kaan Yuce , M. Fatih Amasyali

Tracking entities in procedural language requires understanding the transformations arising from actions on entities as well as those entities' interactions. While self-attention-based pre-trained language encoders like GPT and BERT have…

Computation and Language · Computer Science 2019-09-09 Aditya Gupta , Greg Durrett

Table Question Answering (TQA) aims to answer natural language questions about tabular data, often accompanied by additional contexts such as text passages. The task spans diverse settings, varying in table representation, question/answer…

Computation and Language · Computer Science 2026-04-21 Wei Zhou , Bolei Ma , Annemarie Friedrich , Mohsen Mesgar

In this work, we present an end-to-end Knowledge Graph Question Answering (KGQA) system named GETT-QA. GETT-QA uses T5, a popular text-to-text pre-trained language model. The model takes a question in natural language as input and produces…

Computation and Language · Computer Science 2023-03-29 Debayan Banerjee , Pranav Ajit Nair , Ricardo Usbeck , Chris Biemann

We analyze the language learned by an agent trained with reinforcement learning as a component of the ActiveQA system [Buck et al., 2017]. In ActiveQA, question answering is framed as a reinforcement learning task in which an agent sits…

Computation and Language · Computer Science 2018-01-24 Christian Buck , Jannis Bulian , Massimiliano Ciaramita , Wojciech Gajewski , Andrea Gesmundo , Neil Houlsby , Wei Wang