English
Related papers

Related papers: BERT Transformer model for Detecting Arabic GPT2 A…

200 papers

Nowadays, there exist powerful language models such as OpenAI's GPT-2 that can generate readable text and can be fine-tuned to generate text for a specific domain. Considering GPT-2, it cannot directly generate synthetic news with respect…

Computation and Language · Computer Science 2020-11-02 Ahmadreza Mosallanezhad , Kai Shu , Huan Liu

As natural language models like ChatGPT become increasingly prevalent in applications and services, the need for robust and accurate methods to detect their output is of paramount importance. In this paper, we present GPT Reddit Dataset…

Computation and Language · Computer Science 2024-03-13 Zubair Qazi , William Shiao , Evangelos E. Papalexakis

Language models (LMs) pre-trained on massive amounts of text, in particular bidirectional encoder representations from Transformers (BERT), generative pre-training (GPT), and GPT-2, have become a key technology for many natural language…

Computation and Language · Computer Science 2021-10-04 Xianrui Zheng , Chao Zhang , Philip C. Woodland

Reliable methods for automatic readability assessment have the potential to impact a variety of fields, ranging from machine translation to self-informed learning. Recently, large language models for the German language (such as GBERT and…

Computation and Language · Computer Science 2022-09-12 Patrick Gustav Blaneck , Tobias Bornheim , Niklas Grieger , Stephan Bialonski

Social media platforms have revolutionized traditional communication techniques by enabling people globally to connect instantaneously, openly, and frequently. People use social media to share personal stories and express their opinion.…

Computation and Language · Computer Science 2023-09-04 Asma Abdulsalam , Areej Alhothali , Saleh Al-Ghamdi

With the rise of generative pre-trained transformer models such as GPT-3, GPT-NeoX, or OPT, distinguishing human-generated texts from machine-generated ones has become important. We refined five separate language models to generate…

Computation and Language · Computer Science 2023-10-27 Sinclair Schneider , Florian Steuber , Joao A. G. Schneider , Gabi Dreo Rodosek

The United States has experienced a significant increase in violent extremism, prompting the need for automated tools to detect and limit the spread of extremist ideology online. This study evaluates the performance of Bidirectional Encoder…

Computation and Language · Computer Science 2024-08-30 Beidi Dong , Jin R. Lee , Ziwei Zhu , Balassubramanian Srinivasan

Today, hate speech classification from Arabic tweets has drawn the attention of several researchers. Many systems and techniques have been developed to resolve this classification task. Nevertheless, two of the major challenges faced in…

Computation and Language · Computer Science 2024-07-03 Kheir Eddine Daouadi , Yaakoub Boualleg , Kheir Eddine Haouaouchi

False information spread via the internet and social media influences public opinion and user activity, while generative models enable fake content to be generated faster and more cheaply than had previously been possible. In the not so…

Computation and Language · Computer Science 2021-04-27 Antonis Maronikolakis , Hinrich Schutze , Mark Stevenson

Pretraining Bidirectional Encoder Representations from Transformers (BERT) for downstream NLP tasks is a non-trival task. We pretrained 5 BERT models that differ in the size of their training sets, mixture of formal and informal Arabic, and…

Computation and Language · Computer Science 2021-02-23 Ahmed Abdelali , Sabit Hassan , Hamdy Mubarak , Kareem Darwish , Younes Samih

The appearance of complex attention-based language models such as BERT, Roberta or GPT-3 has allowed to address highly complex tasks in a plethora of scenarios. However, when applied to specific domains, these models encounter considerable…

Computation and Language · Computer Science 2022-06-14 Javier Huertas-Tato , Alejandro Martin , David Camacho

Large language models (LLMs) can produce text that closely resembles human writing. This capability raises concerns about misuse, including disinformation and content manipulation. Detecting AI-generated text is essential to maintain…

Computation and Language · Computer Science 2025-12-29 Md. Rakibul Islam , Most. Sharmin Sultana Samu , Md. Zahid Hossain , Farhad Uz Zaman , Md. Kamrozzaman Bhuiyan

$ $The usage of generative artificial intelligence (AI) tools based on large language models, including ChatGPT, Bard, and Claude, for text generation has many exciting applications with the potential for phenomenal productivity gains. One…

Computation and Language · Computer Science 2024-01-01 Antônio Junior Alves Caiado , Michael Hahsler

In recent years, text generation tools utilizing Artificial Intelligence (AI) have occasionally been misused across various domains, such as generating student reports or creative writings. This issue prompts plagiarism detection services…

Computation and Language · Computer Science 2025-04-14 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo

ChatGPT is a conversational artificial intelligence that is a member of the generative pre-trained transformer of the large language model family. This text generative model was fine-tuned by both supervised learning and reinforcement…

Computation and Language · Computer Science 2023-06-06 Niful Islam , Debopom Sutradhar , Humaira Noor , Jarin Tasnim Raya , Monowara Tabassum Maisha , Dewan Md Farid

Recently, there has been a rise in the development of powerful pre-trained natural language models, including GPT-2, Grover, and XLM. These models have shown state-of-the-art capabilities towards a variety of different NLP tasks, including…

Computation and Language · Computer Science 2022-03-21 Keenan Jones , Jason R. C. Nurse , Shujun Li

Academic researchers and social media entities grappling with the identification of hate speech face significant challenges, primarily due to the vast scale of data and the dynamic nature of hate speech. Given the ethical and practical…

Computation and Language · Computer Science 2024-05-08 Dengyi Liu , Minghao Wang , Andrew G. Catlin

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Online news and social media have been the de facto mediums to disseminate information globally from the beginning of the last decade. However, bias in content and purpose of intentions are not regulated, and managing bias is the…

Computation and Language · Computer Science 2022-04-19 Sharath Srivatsa , Tushar Mohan , Kumari Neha , Nishchay Malakar , Ponnurangam Kumaraguru , Srinath Srinivasa

Rampant use of offensive language on social media led to recent efforts on automatic identification of such language. Though offensive language has general characteristics, attacks on specific entities may exhibit distinct phenomena such as…

Computation and Language · Computer Science 2021-11-19 Hamdy Mubarak , Ahmed Abdelali , Kareem Darwish , Younes Samih