English
Related papers

Related papers: Arabic Text Diacritization In The Age Of Transfer …

200 papers

This paper presents the design and development of multi-dialect automatic speech recognition for Arabic. Deep neural networks are becoming an effective tool to solve sequential data problems, particularly, adopting an end-to-end training of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-30 Abbas Raza Ali

Tokenization is a critical preprocessing step for large language models (LLMs), directly impacting training efficiency and downstream performance. General-purpose tokenizers trained predominantly on English and Latin-script languages…

Computation and Language · Computer Science 2025-12-23 Mark Kashirskiy , Artiom Lipinski , Ilya Makarov

Grammatical error correction (GEC) is a well-explored problem in English with many existing models and datasets. However, research on GEC in morphologically rich languages has been limited due to challenges such as data scarcity and…

Computation and Language · Computer Science 2023-11-10 Bashar Alhafni , Go Inoue , Christian Khairallah , Nizar Habash

Dialectal Arabic is the primary spoken language used by native Arabic speakers in daily communication. The rise of social media platforms has notably expanded its use as a written language. However, Arabic dialects do not have standard…

Computation and Language · Computer Science 2025-06-02 Bashar Alhafni , Sarah Al-Towaity , Ziyad Fawzy , Fatema Nassar , Fadhl Eryani , Houda Bouamor , Nizar Habash

Automatic Arabic Dialect Identification (ADI) of text has gained great popularity since it was introduced in the early 2010s. Multiple datasets were developed, and yearly shared tasks have been running since 2018. However, ADI systems are…

Computation and Language · Computer Science 2023-10-23 Amr Keleg , Walid Magdy

Assessing spoken language is challenging, and quantifying pronunciation metrics for machine learning models is even harder. However, for the Holy Quran, this task is simplified by the rigorous recitation rules (tajweed) established by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Abdullah Abdelfattah , Mahmoud I. Khalil , Hazem Abbas

Neural networks have become the state-of-the-art approach for machine translation (MT) in many languages. While linguistically-motivated tokenization techniques were shown to have significant effects on the performance of statistical MT, it…

Computation and Language · Computer Science 2019-06-28 Mai Oudah , Amjad Almahairi , Nizar Habash

Text editing frames grammatical error correction (GEC) as a sequence tagging problem, where edit tags are assigned to input tokens, and applying these edits results in the corrected text. This approach has gained attention for its…

Computation and Language · Computer Science 2025-06-03 Bashar Alhafni , Nizar Habash

We trained a model to automatically transliterate Judeo-Arabic texts into Arabic script, enabling Arabic readers to access those writings. We employ a recurrent neural network (RNN), combined with the connectionist temporal classification…

Computation and Language · Computer Science 2020-10-22 Ori Terner , Kfir Bar , Nachum Dershowitz

Advances in English language representation enabled a more sample-efficient pre-training task by Efficiently Learning an Encoder that Classifies Token Replacements Accurately (ELECTRA). Which, instead of training a model to recover masked…

Computation and Language · Computer Science 2021-03-09 Wissam Antoun , Fady Baly , Hazem Hajj

Automated Essay Scoring (AES) plays a crucial role in assessing language learners' writing quality, reducing grading workload, and providing real-time feedback. The lack of annotated essay datasets inhibits the development of Arabic AES…

Computation and Language · Computer Science 2025-06-11 Chatrine Qwaider , Bashar Alhafni , Kirill Chirkunov , Nizar Habash , Ted Briscoe

The widespread absence of diacritical marks in Arabic text poses a significant challenge for Arabic natural language processing (NLP). This paper explores instances of naturally occurring diacritics, referred to as "diacritics in the wild,"…

Computation and Language · Computer Science 2024-06-11 Salman Elgamal , Ossama Obeid , Tameem Kabbani , Go Inoue , Nizar Habash

There are many difficulties facing a handwritten Arabic recognition system such as unlimited variation in human handwriting, similarities of distinct character shapes, interconnections of neighbouring characters and their position in the…

Computer Vision and Pattern Recognition · Computer Science 2014-02-27 Ahmed Sahlol , Cheng Suen

Dialectal Arabic (DA) poses a persistent challenge for natural language processing (NLP), as most everyday communication in the Arab world occurs in dialects that diverge significantly from Modern Standard Arabic (MSA). This linguistic…

Computation and Language · Computer Science 2025-09-04 Abdullah Alabdullah , Lifeng Han , Chenghua Lin

In this work, we present Yor\`ub\'a automatic diacritization (YAD) benchmark dataset for evaluating Yor\`ub\'a diacritization systems. In addition, we pre-train text-to-text transformer, T5 model for Yor\`ub\'a and showed that this model…

Computation and Language · Computer Science 2024-12-31 Akindele Michael Olawole , Jesujoba O. Alabi , Aderonke Busayo Sakpere , David I. Adelani

In this work, we tackle the Diacritic Restoration (DR) task for Arabic dialectal sentences using a multimodal approach that combines both textual and speech information. We propose a model that represents the text modality using an encoder…

Computation and Language · Computer Science 2025-10-29 Ahmad Ghannam , Naif Alharthi , Faris Alasmary , Kholood Al Tabash , Shouq Sadah , Lahouari Ghouti

Proper nouns in Arabic Wikipedia are frequently undiacritized, creating ambiguity in pronunciation and interpretation, especially for transliterated named entities of foreign origin. While transliteration and diacritization have been…

Computation and Language · Computer Science 2025-06-24 Rawan Bondok , Mayar Nassar , Salam Khalifa , Kurt Micallef , Nizar Habash

This paper presents a novel dotless representation of Arabic text as an alternative to the standard Arabic text representation. We delve into its implications through comprehensive analysis across five diverse corpora and four different…

Computation and Language · Computer Science 2023-12-27 Maged S. Al-Shaibani , Irfan Ahmad

The continuous increase in the use of social media and the visual content on the internet have accelerated the research in computer vision field in general and the image captioning task in specific. The process of generating a caption that…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Muhy Eddin Za'ter , Bashar Talafha

The prominence of figurative language devices, such as sarcasm and irony, poses serious challenges for Arabic Sentiment Analysis (SA). While previous research works tackle SA and sarcasm detection separately, this paper introduces an…

Computation and Language · Computer Science 2021-06-24 Abdelkader El Mahdaouy , Abdellah El Mekki , Kabil Essefar , Nabil El Mamoun , Ismail Berrada , Ahmed Khoumsi