English
Related papers

Related papers: Data Augmentation using Transformers and Similarit…

200 papers

This paper describes the creation, optimization, and assessment of a question-answering (QA) model for a personalized learning assistant that uses BERT transformers customized for the Arabic language. The model was particularly finetuned on…

Computation and Language · Computer Science 2024-06-14 Mohammad Sammoudi , Ahmad Habaybeh , Huthaifa I. Ashqar , Mohammed Elhenawy

Automated essay scoring is one of the most important problem in Natural Language Processing. It has been explored for a number of years, and it remains partially solved. In addition to its economic and educational usefulness, it presents…

Computation and Language · Computer Science 2023-02-07 Kshitij Gupta

With the rapid development and widespread use of advanced network systems, software vulnerabilities pose a significant threat to secure communications and networking. Learning-based vulnerability detection systems, particularly those…

Cryptography and Security · Computer Science 2024-10-04 Weiliang Qi , Jiahao Cao , Darsh Poddar , Sophia Li , Xinda Wang

Sentiment analysis plays a crucial role in understanding the sentiment expressed in text data. While sentiment analysis research has been extensively conducted in English and other Western languages, there exists a significant gap in…

Computation and Language · Computer Science 2023-10-03 Aabha Pingle , Aditya Vyawahare , Isha Joshi , Rahul Tangsali , Geetanjali Kale , Raviraj Joshi

Data augmentation is an essential part of the training process applied to deep learning models. The motivation is that a robust training process for deep learning models depends on large annotated datasets, which are expensive to be…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Toan Tran , Trung Pham , Gustavo Carneiro , Lyle Palmer , Ian Reid

This study addresses the critical gap in Arabic natural language processing by developing an effective Arabic Reverse Dictionary (RD) system that enables users to find words based on their descriptions or meanings. We present a novel…

Computation and Language · Computer Science 2025-05-01 Serry Sibaee , Samar Ahmed , Abdullah Al Harbi , Omer Nacar , Adel Ammar , Yasser Habashi , Wadii Boulila

People may be puzzled by the fact that voice over recordings data sets exist in addition to Text-to-Speech (TTS), Synthesis system advancements, albeit this is not the case. The goal of this study is to explain the relevance of TTS as well…

Sound · Computer Science 2022-04-08 Hala Al Masri , Muhy Eddin Za'ter

This paper describes AraS2P, our speech-to-phonemes system submitted to the Iqra'Eval 2025 Shared Task. We adapted Wav2Vec2-BERT via Two-Stage training strategy. In the first stage, task-adaptive continue pretraining was performed on…

Computation and Language · Computer Science 2025-09-30 Bassam Matar , Mohamed Fayed , Ayman Khalafallah

Dialectal Arabic (DA) poses a persistent challenge for natural language processing (NLP), as most everyday communication in the Arab world occurs in dialects that diverge significantly from Modern Standard Arabic (MSA). This linguistic…

Computation and Language · Computer Science 2025-09-04 Abdullah Alabdullah , Lifeng Han , Chenghua Lin

In recent years, Large Language Models have revolutionized the field of natural language processing, showcasing an impressive rise predominantly in English-centric domains. These advancements have set a global benchmark, inspiring…

Computation and Language · Computer Science 2024-05-06 Manel Aloui , Hasna Chouikhi , Ghaith Chaabane , Haithem Kchaou , Chehir Dhaouadi

Data augmentation techniques are widely used in text classification tasks to improve the performance of classifiers, especially in low-resource scenarios. Most previous methods conduct text augmentation without considering the different…

Computation and Language · Computer Science 2022-09-07 Biyang Guo , Songqiao Han , Hailiang Huang

In multi-label emotion classification, particularly for low-resource languages like Arabic, the challenges of class imbalance and label correlation hinder model performance, especially in accurately predicting minority emotions. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Muhammad Azeem Aslam , Wang Jun , Nisar Ahmed , Muhammad Imran Zaman , Li Yanan , Hu Hongfei , Wang Shiyu , Xin Liu

Recent successes in Generative Adversarial Networks (GAN) have affirmed the importance of using more data in GAN training. Yet it is expensive to collect data in many domains such as medical applications. Data Augmentation (DA) has been…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Trung-Kien Nguyen , Ngai-Man Cheung

Recently, with the rapid development in the fields of technology and the increasing amount of text t available on the internet, it has become urgent to develop effective tools for processing and understanding texts in a way that summaries…

Computation and Language · Computer Science 2024-06-13 Sari Masri , Yaqeen Raddad , Fidaa Khandaqji , Huthaifa I. Ashqar , Mohammed Elhenawy

The fast-growing amount of information on the Internet makes the research in automatic document summarization very urgent. It is an effective solution for information overload. Many approaches have been proposed based on different…

Computation and Language · Computer Science 2018-08-01 Kamal Al-Sabahi , Zuping Zhang , Jun Long , Khaled Alwesabi

Transfer learning with a unified Transformer framework (T5) that converts all language problems into a text-to-text format was recently proposed as a simple and effective transfer learning approach. Although a multilingual version of the T5…

Computation and Language · Computer Science 2022-03-16 El Moatez Billah Nagoudi , AbdelRahim Elmadany , Muhammad Abdul-Mageed

The mental disorder of online users is determined using social media posts. The major challenge in this domain is to avail the ethical clearance for using the user generated text on social media platforms. Academic re searchers identified…

Computation and Language · Computer Science 2022-11-09 Gunjan Ansari , Muskan Garg , Chandni Saxena

This paper presents our system developed for the SemEval-2025 Task 9: The Food Hazard Detection Challenge. The shared task's objective is to evaluate explainable classification systems for classifying hazards and products in two levels of…

Computation and Language · Computer Science 2025-04-30 Foteini Papadopoulou , Osman Mutlu , Neris Özen , Bas H. M. van der Velden , Iris Hendrickx , Ali Hürriyetoğlu

Encoder-only transformer models remain widely used for discriminative NLP tasks, yet recent architectural advances have largely focused on English. In this work, we present AraModernBERT, an adaptation of the ModernBERT encoder architecture…

Computation and Language · Computer Science 2026-03-13 Omar Elshehy , Omer Nacar , Abdelbasset Djamai , Muhammed Ragab , Khloud Al Jallad , Mona Abdelazim

Recent studies emphasize the crucial role of data augmentation in enhancing the performance of object detection models. However,existing methodologies often struggle to effectively harmonize dataset diversity with semantic coordination.To…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Sen Nie , Zhuo Wang , Xinxin Wang , Kun He