English
Related papers

Related papers: Towards Generalized Offensive Language Identificat…

200 papers

Hate speech detection refers to the task of detecting hateful content that aims at denigrating an individual or a group based on their religion, gender, sexual orientation, or other characteristics. Due to the different policies of the…

Computation and Language · Computer Science 2023-10-10 Paras Sheth , Tharindu Kumarage , Raha Moraffah , Aman Chadha , Huan Liu

Online harassment is a significant social problem. Prevention of online harassment requires rapid detection of harassing, offensive, and negative social media posts. In this paper, we propose the use of word embedding models to identify…

Machine Learning · Computer Science 2019-11-19 Anqi Liu , Maya Srikanth , Nicholas Adams-Cohen , R. Michael Alvarez , Anima Anandkumar

With the rise of social media, people can now form relationships and communities easily regardless of location, race, ethnicity, or gender. However, the power of social media simultaneously enables harmful online behavior such as harassment…

Social and Information Networks · Computer Science 2016-06-28 Elaheh Raisi , Bert Huang

The proliferation of harmful content on online platforms is a major societal problem, which comes in many different forms including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content,…

This paper investigates the propagation of harmful information in multilingual large language models (LLMs) and evaluates the efficacy of various unlearning methods. We demonstrate that fake information, regardless of the language it is in,…

Computation and Language · Computer Science 2025-09-04 Taiming Lu , Philipp Koehn

Online hate speech has caught everyone's attention from the news related to the COVID-19 pandemic, US elections, and worldwide protests. Online toxicity - an umbrella term for online hateful behavior, manifests itself in forms such as…

Computation and Language · Computer Science 2021-09-08 Mudit Chaudhary , Chandni Saxena , Helen Meng

Automatic counterspeech generation methods have been developed to assist efforts in combating hate speech. Existing research focuses on generating counterspeech with linguistic attributes such as being polite, informative, and…

Computation and Language · Computer Science 2024-10-02 Lingzi Hong , Pengcheng Luo , Eduardo Blanco , Xiaoying Song

Social media communication has become a significant part of daily activity in modern societies. For this reason, ensuring safety in social media platforms is a necessity. Use of dangerous language such as physical threats in online…

Computation and Language · Computer Science 2020-05-15 Ali Alshehri , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

Artificial Intelligence · Computer Science 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

Large language models (LLMs) have become integral to various real-world applications, leveraging massive, web-sourced datasets like Common Crawl, C4, and FineWeb for pretraining. While these datasets provide linguistic data essential for…

Computation and Language · Computer Science 2025-08-14 Sai Krishna Mendu , Harish Yenala , Aditi Gulati , Shanu Kumar , Parag Agrawal

The issue of hate speech extends beyond the confines of the online realm. It is a problem with real-life repercussions, prompting most nations to formulate legal frameworks that classify hate speech as a punishable offence. These legal…

Computation and Language · Computer Science 2024-12-10 Katerina Korre , John Pavlopoulos , Paolo Gajo , Alberto Barrón-Cedeño

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Minh-Hao Van , Xintao Wu

Robustness of machine learning models on ever-changing real-world data is critical, especially for applications affecting human well-being such as content moderation. New kinds of abusive language continually emerge in online discussions in…

Computation and Language · Computer Science 2022-04-06 Isar Nejadgholi , Kathleen C. Fraser , Svetlana Kiritchenko

With rising concern around abusive and hateful behavior on social media platforms, we present an ensemble learning method to identify and analyze the linguistic properties of such content. Our stacked ensemble comprises of three machine…

Computation and Language · Computer Science 2020-06-08 Gaurav Verma , Niyati Chhaya , Vishwa Vinay

Recently, large language models (LLMs) have taken the spotlight in natural language processing. Further, integrating LLMs with vision enables the users to explore more emergent abilities in multimodality. Visual language models (VLMs), such…

Computation and Language · Computer Science 2023-11-14 Minh-Hao Van , Xintao Wu

Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the overall efficiency and accuracy of content review. However,…

Computation and Language · Computer Science 2025-08-14 Kangwei Liu , Siyuan Cheng , Bozhong Tian , Xiaozhuan Liang , Yuyang Yin , Meng Han , Ningyu Zhang , Bryan Hooi , Xi Chen , Shumin Deng

Online abuse has grown increasingly complex, spanning toxic language, harassment, manipulation, and fraudulent behavior. Traditional machine-learning approaches dependent on static classifiers and labor-intensive labeling struggle to keep…

Computation and Language · Computer Science 2026-04-02 Suraj Kath , Sanket Badhe , Preet Shah , Ashwin Sampathkumar , Shivani Gupta

The negative effects of online bullying and harassment are increasing with Internet popularity, especially in social media. One solution is using natural language processing (NLP) and machine learning (ML) methods for the automatic…

Computation and Language · Computer Science 2023-08-30 Tanjim Mahmud , Michal Ptaszynski , Fumito Masui

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

In detecting malicious websites, a common approach is the use of blacklists which are not exhaustive in themselves and are unable to generalize to new malicious sites. Detecting newly encountered malicious websites automatically will help…

Cryptography and Security · Computer Science 2022-09-21 Adebayo Oshingbesan , Courage Ekoh , Chukwuemeka Okobi , Aime Munezero , Kagame Richard