English
Related papers

Related papers: Multi-Dialect Arabic BERT for Country-Level Dialec…

200 papers

The complexities of Arabic language in morphology, orthography and dialects makes sentiment analysis for Arabic more challenging. Also, text feature extraction from short messages like tweets, in order to gauge the sentiment, makes this…

Computation and Language · Computer Science 2018-10-17 Abdulaziz M. Alayba , Vasile Palade , Matthew England , Rahat Iqbal

Pre-trained transformers are now the de facto models in Natural Language Processing given their state-of-the-art results in many tasks and languages. However, most of the current models have been trained on languages for which large text…

Computation and Language · Computer Science 2022-12-13 Amine Abdaoui , Mohamed Berrimi , Mourad Oussalah , Abdelouahab Moussaoui

The performance of Artificial Intelligence (AI) systems fundamentally depends on high-quality training data. However, low-resource languages like Arabic suffer from severe data scarcity. Moreover, the absence of child-specific speech…

Computation and Language · Computer Science 2025-10-28 Mouhand Alkadri , Dania Desouki , Khloud Al Jallad

In this paper, we share our best performing submission to the Arabic AI Tasks Evaluation Challenge (ArAIEval) at ArabicNLP 2023. Our focus was on Task 1, which involves identifying persuasion techniques in excerpts from tweets and news…

The growing importance of culturally-aware natural language processing systems has led to an increasing demand for resources that capture sociopragmatic phenomena across diverse languages. Nevertheless, Arabic-language resources for…

The rapid growth of social media has amplified the spread of offensive, violent, and vulgar speech, which poses serious societal and cybersecurity concerns. Detecting such content in Arabic text is particularly complex due to limited…

Computation and Language · Computer Science 2025-06-04 Aisha Alansari , Hamzah Luqman

This paper presents the different models submitted by the LT@Helsinki team for the SemEval 2020 Shared Task 12. Our team participated in sub-tasks A and C; titled offensive language identification and offense target identification,…

Computation and Language · Computer Science 2020-08-04 Marc Pàmies , Emily Öhman , Kaisla Kajava , Jörg Tiedemann

This paper presents our approach for SwissText & KONVENS 2020 shared task 2, which is a multi-stage neural model for Swiss German (GSW) identification on Twitter. Our model outputs either GSW or non-GSW and is not meant to be used as a…

Computation and Language · Computer Science 2020-06-08 Mohammadreza Banaei , Rémi Lebret , Karl Aberer

The focus of language model evaluation has transitioned towards reasoning and knowledge-intensive tasks, driven by advancements in pretraining large models. While state-of-the-art models are partially trained on large Arabic texts,…

Nowadays, offensive content in social media has become a serious problem, and automatically detecting offensive language is an essential task. In this paper, we build an offensive language detection system, which combines multi-task…

Computation and Language · Computer Science 2020-07-21 Wenliang Dai , Tiezheng Yu , Zihan Liu , Pascale Fung

Code-switching, or alternating between languages within a single conversation, presents challenges for multilingual language models on NLP tasks. This research investigates if pre-training Multilingual BERT (mBERT) on code-switched datasets…

Computation and Language · Computer Science 2025-03-12 Katherine Xie , Nitya Babbar , Vicky Chen , Yoanna Turura

In recent studies, it has been shown that Multilingual language models underperform their monolingual counterparts. It is also a well-known fact that training and maintaining monolingual models for each language is a costly and…

Computation and Language · Computer Science 2021-02-24 Usama Khalid , Mirza Omer Beg , Muhammad Umair Arshad

In this paper we present ensemble-based systems for dialect and language variety identification using the datasets made available by the organizers of the VarDial Evaluation Campaign 2018. We present a system developed to discriminate…

Computation and Language · Computer Science 2018-08-15 Liviu P. Dinu , Alina Maria Ciobanu , Marcos Zampieri , Shervin Malmasi

We introduce ALHD, the first large-scale comprehensive Arabic dataset explicitly designed to distinguish between human- and LLM-generated texts. ALHD spans three genres (news, social media, reviews), covering both MSA and dialectal Arabic,…

Computation and Language · Computer Science 2025-10-23 Ali Khairallah , Arkaitz Zubiaga

This paper presents Wojood, a corpus for Arabic nested Named Entity Recognition (NER). Nested entities occur when one entity mention is embedded inside another entity mention. Wojood consists of about 550K Modern Standard Arabic (MSA) and…

Computation and Language · Computer Science 2022-05-24 Mustafa Jarrar , Mohammed Khalilia , Sana Ghanem

This paper provides an overview of the Arabic Sentiment Analysis Challenge organized by King Abdullah University of Science and Technology (KAUST). The task in this challenge is to develop machine learning models to classify a given tweet…

Computation and Language · Computer Science 2021-09-30 Hind Alamro , Manal Alshehri , Basma Alharbi , Zuhair Khayyat , Manal Kalkatawi , Inji Ibrahim Jaber , Xiangliang Zhang

Information extraction is an important task in NLP, enabling the automatic extraction of data for relational database filling. Historically, research and data was produced for English text, followed in subsequent years by datasets in…

Computation and Language · Computer Science 2019-12-13 Taesun Moon , Parul Awasthy , Jian Ni , Radu Florian

The importance of building sentiment analysis tools for Arabic social media has been recognized during the past couple of years, especially with the rapid increase in the number of Arabic social media users. One of the main difficulties in…

Computation and Language · Computer Science 2017-10-26 Samhaa R. El-Beltagy , Talaat Khalil , Amal Halaby , Muhammad Hammad

Even as pre-trained language models share a semantic encoder, natural language understanding suffers from a diversity of output schemas. In this paper, we propose UBERT, a unified bidirectional language understanding model based on BERT…

Computation and Language · Computer Science 2022-08-16 Junyu Lu , Ping Yang , Ruyi Gan , Jing Yang , Jiaxing Zhang

This work is an attempt to introduce a comprehensive benchmark for Arabic speech recognition, specifically tailored to address the challenges of telephone conversations in Arabic language. Arabic, characterized by its rich dialectal…

Artificial Intelligence · Computer Science 2024-05-31 Qusai Abo Obaidah , Muhy Eddin Za'ter , Adnan Jaljuli , Ali Mahboub , Asma Hakouz , Bashar Al-Rfooh , Yazan Estaitia