English
Related papers

Related papers: A Text-to-Text Model for Multilingual Offensive La…

200 papers

Multi-lingual language models (LM), such as mBERT, XLM-R, mT5, mBART, have been remarkably successful in enabling natural language tasks in low-resource languages through cross-lingual transfer from high-resource ones. In this work, we try…

Computation and Language · Computer Science 2022-12-06 Benjamin Muller , Deepanshu Gupta , Siddharth Patwardhan , Jean-Philippe Fauconnier , David Vandyke , Sachin Agarwal

In recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-only and decoder-only architectures. While Spanish language…

Computation and Language · Computer Science 2024-03-22 Vladimir Araujo , Maria Mihaela Trusca , Rodrigo Tufiño , Marie-Francine Moens

Code-switching, or alternating between languages within a single conversation, presents challenges for multilingual language models on NLP tasks. This research investigates if pre-training Multilingual BERT (mBERT) on code-switched datasets…

Computation and Language · Computer Science 2025-03-12 Katherine Xie , Nitya Babbar , Vicky Chen , Yoanna Turura

Identifying offensive language is essential for maintaining safety and sustainability in the social media era. Though large language models (LLMs) have demonstrated encouraging potential in social media analytics, they lack thorough…

Computation and Language · Computer Science 2024-10-22 Jianfei He , Lilin Wang , Jiaying Wang , Zhenyu Liu , Hongbin Na , Zimu Wang , Wei Wang , Qi Chen

The growing prevalence and rapid evolution of offensive language in social media amplify the complexities of detection, particularly highlighting the challenges in identifying such content across diverse languages. This survey presents a…

Computation and Language · Computer Science 2026-04-02 Aiqi Jiang , Arkaitz Zubiaga

Multilingual T5 (mT5) pretrains a sequence-to-sequence model on massive monolingual texts, which has shown promising results on many cross-lingual tasks. In this paper, we improve multilingual text-to-text transfer Transformer with…

Computation and Language · Computer Science 2021-09-14 Zewen Chi , Li Dong , Shuming Ma , Shaohan Huang Xian-Ling Mao , Heyan Huang , Furu Wei

This paper describes the system submitted to Dravidian-Codemix-HASOC2021: Hate Speech and Offensive Language Identification in Dravidian Languages (Tamil-English and Malayalam-English). This task aims to identify offensive content in…

Computation and Language · Computer Science 2021-12-08 Sean Benhur , Kanchana Sivanraju

Cyberbullying on social media is inherently multilingual and multi-faceted, where abusive behaviors often overlap across multiple categories. Existing methods are commonly limited by monolingual assumptions or single-task formulations,…

Computation and Language · Computer Science 2026-03-16 Zixin Feng , Xinying Cui , Yifan Sun , Zheng Wei , Jiachen Yuan , Jiazhen Hu , Ning Xin , Md Maruf Hasan

Fine-tuning of pre-trained transformer networks such as BERT yield state-of-the-art results for text classification tasks. Typically, fine-tuning is performed on task-specific training datasets in a supervised manner. One can also fine-tune…

Computation and Language · Computer Science 2020-06-12 Gregor Wiedemann , Seid Muhie Yimam , Chris Biemann

The exponential increase in the use of the Internet and social media over the last two decades has changed human interaction. This has led to many positive outcomes, but at the same time it has brought risks and harms. While the volume of…

Computation and Language · Computer Science 2020-12-23 Neeraj Vashistha , Arkaitz Zubiaga , Shanky Sharma

Social media often serves as a breeding ground for various hateful and offensive content. Identifying such content on social media is crucial due to its impact on the race, gender, or religion in an unprejudiced society. However, while…

Computation and Language · Computer Science 2022-10-10 Mithun Das , Somnath Banerjee , Punyajoy Saha , Animesh Mukherjee

Numerous machine learning (ML) and deep learning (DL)-based approaches have been proposed to utilize textual data from social media for anti-social behavior analysis like cyberbullying, fake news detection, and identification of hate speech…

Computation and Language · Computer Science 2022-12-22 Md. Rezaul Karim , Sumon Kanti Dey , Tanhim Islam , Md. Shajalal , Bharathi Raja Chakravarthi

Existing research on detecting cyberbullying incidents on social media has primarily concentrated on harassment and is typically approached as a binary classification task. However, cyberbullying encompasses various forms, such as…

Computation and Language · Computer Science 2025-01-29 Peiling Yi , Arkaitz Zubiaga , Yunfei Long

Social media platforms are critical spaces for public discourse, shaping opinions and community dynamics, yet their widespread use has amplified harmful content, particularly hate speech, threatening online safety and inclusivity. While…

Computation and Language · Computer Science 2025-06-11 Muhammad Usman , Muhammad Ahmad , M. Shahiki Tash , Irina Gelbukh , Rolando Quintero Tellez , Grigori Sidorov

We present our work on developing a multilingual, efficient text-to-text transformer that is suitable for handling long inputs. This model, called mLongT5, builds upon the architecture of LongT5, while leveraging the multilingual datasets…

Computation and Language · Computer Science 2023-10-30 David Uthus , Santiago Ontañón , Joshua Ainslie , Mandy Guo

Cyberbullying significantly contributes to mental health issues in communities by negatively impacting the psychology of victims. It is a prevalent problem on social media platforms, necessitating effective, real-time detection and…

Computation and Language · Computer Science 2024-12-31 Adamu Gaston Philipo , Doreen Sebastian Sarwatt , Jianguo Ding , Mahmoud Daneshmand , Huansheng Ning

This study evaluates the resilience of large language models (LLMs) against adversarial attacks, specifically focusing on Flan-T5, BERT, and RoBERTa-Base. Using systematically designed adversarial tests through TextFooler and BERTAttack, we…

Cryptography and Security · Computer Science 2025-09-15 Taniya Gidatkar , Oluwaseun Ajao , Matthew Shardlow

Social media often acts as breeding grounds for different forms of offensive content. For low resource languages like Tamil, the situation is more complex due to the poor performance of multilingual or language-specific models and lack of…

Computation and Language · Computer Science 2021-02-22 Debjoy Saha , Naman Paharia , Debajit Chakraborty , Punyajoy Saha , Animesh Mukherjee

In today's fast-paced world, the rates of stress and depression present a surge. Social media provide assistance for the early detection of mental health conditions. Existing methods mainly introduce feature extraction approaches and train…

Computation and Language · Computer Science 2023-07-07 Loukas Ilias , Spiros Mouzakitis , Dimitris Askounis

The rapid growth of social media has amplified the spread of offensive, violent, and vulgar speech, which poses serious societal and cybersecurity concerns. Detecting such content in Arabic text is particularly complex due to limited…

Computation and Language · Computer Science 2025-06-04 Aisha Alansari , Hamzah Luqman