English
Related papers

Related papers: Towards Generalized Offensive Language Identificat…

200 papers

The ability of large language models to generate complex texts allows them to be widely integrated into many aspects of life, and their output can quickly fill all network resources. As the impact of LLMs grows, it becomes increasingly…

Computation and Language · Computer Science 2024-11-12 Yongye Su , Yuqing Wu

The last decade has witnessed a surge in the interaction of people through social networking platforms. While there are several positive aspects of these social platforms, the proliferation has led them to become the breeding ground for…

Computation and Language · Computer Science 2022-05-05 Souvic Chakraborty , Parag Dutta , Sumegh Roychowdhury , Animesh Mukherjee

Recent advances in instruction-following large language models (LLMs) have led to dramatic improvements in a range of NLP tasks. Unfortunately, we find that the same improved capabilities amplify the dual-use risks for malicious purposes of…

Cryptography and Security · Computer Science 2023-02-14 Daniel Kang , Xuechen Li , Ion Stoica , Carlos Guestrin , Matei Zaharia , Tatsunori Hashimoto

This paper highlights the significance of natural language processing (NLP) within artificial intelligence, underscoring its pivotal role in comprehending and modeling human language. Recent advancements in NLP, particularly in…

Computation and Language · Computer Science 2024-10-01 Vlad-Cristian Matei , Iulian-Marius Tăiatu , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel

The proliferation of social media platforms has led to an increase in the spread of hate speech, particularly targeting vulnerable communities. Unfortunately, existing methods for automatically identifying and blocking toxic language rely…

Computation and Language · Computer Science 2025-02-24 Shiza Ali , Jeremy Blackburn , Gianluca Stringhini

In recent years, abusive behavior has become a serious issue in online social networks. In this paper, we present a new corpus from a semi-anonymous social media platform, which contains the instances of offensive and neutral classes. We…

Computation and Language · Computer Science 2019-09-10 Niloofar Safi Samghabadi , Afsheen Hatami , Mahsa Shafaei , Sudipta Kar , Thamar Solorio

NLP research has attained high performances in abusive language detection as a supervised classification task. While in research settings, training and test datasets are usually obtained from similar data samples, in practice systems are…

Computation and Language · Computer Science 2021-05-21 Isar Nejadgholi , Svetlana Kiritchenko

Growing applications of large language models (LLMs) trained by a third party raise serious concerns on the security vulnerability of LLMs.It has been demonstrated that malicious actors can covertly exploit these vulnerabilities in LLMs…

Cryptography and Security · Computer Science 2023-12-11 Shuli Jiang , Swanand Ravindra Kadhe , Yi Zhou , Ling Cai , Nathalie Baracaldo

Given the widespread use of deep learning models in safety-critical applications, ensuring that the decisions of such models are robust against adversarial exploitation is of fundamental importance. In this thesis, we discuss recent…

Machine Learning · Computer Science 2025-09-24 Alexander Robey

We present a holistic approach to building a robust and useful natural language classification system for real-world content moderation. The success of such a system relies on a chain of carefully designed and executed steps, including the…

Computation and Language · Computer Science 2023-02-16 Todor Markov , Chong Zhang , Sandhini Agarwal , Tyna Eloundou , Teddy Lee , Steven Adler , Angela Jiang , Lilian Weng

The spread of various forms of offensive speech online is an important concern in social media. While platforms have been investing heavily in ways of coping with this problem, the question of privacy remains largely unaddressed. Models…

Computation and Language · Computer Science 2024-04-18 Marcos Zampieri , Damith Premasiri , Tharindu Ranasinghe

For subjective tasks such as hate detection, where people perceive hate differently, the Large Language Model's (LLM) ability to represent diverse groups is unclear. By including additional context in prompts, we comprehensively analyze…

Computation and Language · Computer Science 2024-10-04 Sarah Masud , Sahajpreet Singh , Viktor Hangya , Alexander Fraser , Tanmoy Chakraborty

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

Computation and Language · Computer Science 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks. However, their practical application in high-stake domains, such as fraud and abuse detection, remains an area that requires…

Computation and Language · Computer Science 2024-09-11 Joymallya Chakraborty , Wei Xia , Anirban Majumder , Dan Ma , Walid Chaabene , Naveed Janvekar

The widespread integration of wearable sensing devices in Internet of Things (IoT) ecosystems, particularly in healthcare, smart homes, and industrial applications, has required robust human activity recognition (HAR) techniques to improve…

Machine Learning · Computer Science 2025-11-24 W. K. M Mithsara , Ning Yang , Ahmed Imteaj , Hussein Zangoti , Abdur R. Shahid

The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have…

Computation and Language · Computer Science 2025-06-12 Matthieu Dubois , François Yvon , Pablo Piantanida

The fast advancements in Large Language Models (LLMs) are driving an increasing number of applications. Together with the growing number of users, we also see an increasing number of attackers who try to outsmart these systems. They want…

Cryptography and Security · Computer Science 2024-05-31 Patrick Levi , Christoph P. Neumann

The phenomenal growth on the internet has helped in empowering individual's expressions, but the misuse of freedom of expression has also led to the increase of various cyber crimes and anti-social activities. Hate speech is one such issue…

Computation and Language · Computer Science 2020-06-01 Prashant Kapil , Asif Ekbal , Dipankar Das

Hate speech represents a pervasive and detrimental form of online discourse, often manifested through an array of slurs, from hateful tweets to defamatory posts. As such speech proliferates, it connects people globally and poses significant…

Computation and Language · Computer Science 2025-05-06 Paloma Piot , Patricia Martín-Rodilla , Javier Parapar

Combating online hate speech in multilingual settings requires approaches that go beyond English-centric models and capture the cultural and linguistic diversity of global online discourse. This paper presents a comprehensive survey and…

Computation and Language · Computer Science 2026-03-23 Zahra Safdari Fesaghandis , Suman Kalyan Maity