English
Related papers

Related papers: ThreatCore: A Benchmark for Explicit and Implicit …

200 papers

The widespread presence of hateful languages on social media has resulted in adverse effects on societal well-being. As a result, addressing this issue with high priority has become very important. Hate speech or offensive languages exist…

Toxicity detection has become core safety infrastructure for online moderation, dataset filtering, and deployed language-model systems. Yet most detectors still treat toxicity as an intrinsic property of isolated text. This position paper…

Machine Learning · Computer Science 2026-05-13 Sergei Berezin , Reza Farahbakhsh , Noel Crespi

The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. While recent studies primarily focus on probing toxic outputs that can be…

Computation and Language · Computer Science 2023-11-30 Jiaxin Wen , Pei Ke , Hao Sun , Zhexin Zhang , Chengfei Li , Jinfeng Bai , Minlie Huang

The rise of social networks has not only facilitated communication but also allowed the spread of harmful content. Although significant advances have been made in detecting toxic language in textual data, the exploration of concept-based…

Computation and Language · Computer Science 2025-12-16 Samarth Garg , Divya Singh , Deeksha Varshney , Mamta

Insider threats represent one of the most critical challenges in modern cybersecurity. These threats arise from individuals within an organization who misuse their legitimate access to harm the organization's assets, data, or operations.…

Cryptography and Security · Computer Science 2025-05-22 Anas Ali , Mubashar Husain , Peter Hans

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

Computation and Language · Computer Science 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

The context-dependent nature of online aggression makes annotating large collections of data extremely difficult. Previously studied datasets in abusive language detection have been insufficient in size to efficiently train deep learning…

Computation and Language · Computer Science 2018-08-31 Younghun Lee , Seunghyun Yoon , Kyomin Jung

Offensive or antagonistic language targeted at individuals and social groups based on their personal characteristics (also known as cyber hate speech or cyberhate) has been frequently posted and widely circulated viathe World Wide Web. This…

Computation and Language · Computer Science 2018-03-09 Wafa Alorainy , Pete Burnap , Han Liu , Matthew Williams

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail…

Information Retrieval · Computer Science 2025-10-20 Sayantan Adak , Somnath Banerjee , Rajarshi Mandal , Avik Halder , Sayan Layek , Rima Hazra , Animesh Mukherjee

Text classification models, especially neural networks based models, have reached very high accuracy on many popular benchmark datasets. Yet, such models when deployed in real world applications, tend to perform badly. The primary reason is…

Computation and Language · Computer Science 2020-02-04 Utkarsh Desai , Srikanth Tamilselvam , Jassimran Kaur , Senthil Mani , Shreya Khare

The rise of hate speech on online platforms has led to an urgent need for effective content moderation. However, the subjective and multi-faceted nature of hateful online content, including implicit hate speech, poses significant challenges…

Computation and Language · Computer Science 2023-03-17 Uma Gunturi , Xiaohan Ding , Eugenia H. Rho

The rapid evolution of cyberattacks continues to drive the emergence of unknown (zero-day) threats, posing significant challenges for network intrusion detection systems in Internet of Things (IoT) networks. Existing machine learning and…

Cryptography and Security · Computer Science 2026-02-13 Shan Ali , Feifei Niu , Paria Shirani , Lionel C. Briand

As the cyber threat landscape is constantly becoming increasingly complex and polymorphic, the more critical it becomes to understand the enemy and its modus operandi for anticipatory threat reduction. Even though the cyber security…

Cryptography and Security · Computer Science 2021-09-22 Vasileios Mavroeidis , Ryan Hohimer , Tim Casey , Audun Jøsang

The ubiquity of offensive and hateful content on online fora necessitates the need for automatic solutions that detect such content competently across target groups. In this paper we show that text classification models trained on large…

Computation and Language · Computer Science 2021-12-08 Darsh J Shah , Sinong Wang , Han Fang , Hao Ma , Luke Zettlemoyer

Language agents increasingly act as web-enabled systems that search, browse, and synthesize information from diverse sources. However, these sources can include unreliable or adversarial content, and the robustness of agents to adversarial…

Artificial Intelligence · Computer Science 2026-03-03 Shrey Shah , Levent Ozgur

For the safe sharing pre-trained language models, no guidelines exist at present owing to the difficulty in estimating the upper bound of the risk of privacy leakage. One problem is that previous studies have assessed the risk for different…

Computation and Language · Computer Science 2022-03-18 Yuta Nakamura , Shouhei Hanaoka , Yukihiro Nomura , Naoto Hayashi , Osamu Abe , Shuntaro Yada , Shoko Wakamiya , Eiji Aramaki

The volume of machine-generated content online has grown dramatically due to the widespread use of Large Language Models (LLMs), leading to new challenges for content moderation systems. Conventional content moderation classifiers, which…

Computation and Language · Computer Science 2026-05-26 Shaz Furniturewala , Arkaitz Zubiaga

Current Vision Language Models (VLMs) remain vulnerable to malicious prompts that induce harmful outputs. Existing safety benchmarks for VLMs primarily rely on automated evaluation methods, but these methods struggle to detect implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Wonjun Lee , Doehyeon Lee , Eugene Choi , Sangyoon Yu , Ashkan Yousefpour , Haon Park , Bumsub Ham , Suhyun Kim

Online toxic content has grown into a pervasive phenomenon, intensifying during times of crisis, elections, and social unrest. A significant amount of research has been focused on detecting or analyzing toxic content using machine-learning…

Computation and Language · Computer Science 2025-09-19 Gautam Kishore Shahi , Tim A. Majchrzak

Progress in speech processing has been facilitated by shared datasets and benchmarks. Historically these have focused on automatic speech recognition (ASR), speaker identification, or other lower-level tasks. Interest has been growing in…

Computation and Language · Computer Science 2022-08-01 Suwon Shon , Ankita Pasad , Felix Wu , Pablo Brusco , Yoav Artzi , Karen Livescu , Kyu J. Han