English
Related papers

Related papers: A Data-Centric Approach for Safe and Secure Large …

200 papers

Large language models (LLMs) are highly susceptible to backdoor attacks (BAs), wherein training samples are poisoned using trigger-based harmful content. Furthermore, existing defenses have proven ineffective when extensively tested across…

Cryptography and Security · Computer Science 2026-05-20 John T. Halloran , Noopur S. Bhatt

Large language models (LLMs) pose significant risks due to the potential for generating harmful content or users attempting to evade guardrails. Existing studies have developed LLM-based guard models designed to moderate the input and…

Cryptography and Security · Computer Science 2025-02-25 Hongfu Liu , Hengguan Huang , Xiangming Gu , Hao Wang , Ye Wang

WARNING: This paper contains examples of offensive materials. To address the proliferation of toxic content on social media, we introduce SMARTER, we introduce SMARTER, a data-efficient two-stage framework for explainable content moderation…

Computation and Language · Computer Science 2026-04-23 Huy Nghiem , Advik Sachdeva , Hal Daumé

Detecting online sexual predatory behaviours and abusive language on social media platforms has become a critical area of research due to the growing concerns about online safety, especially for vulnerable populations such as children and…

Computation and Language · Computer Science 2023-08-29 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Recent advances in large language models (LLMs) have demonstrated strong performance on simple text classification tasks, frequently under zero-shot settings. However, their efficacy declines when tackling complex social media challenges…

Computation and Language · Computer Science 2025-04-23 Elyas Meguellati , Assaad Zeghina , Shazia Sadiq , Gianluca Demartini

As the number of large language models (LLMs) released to the public grows, there is a pressing need to understand the safety implications associated with these models learning from third-party custom finetuning data. We explore the…

Computation and Language · Computer Science 2024-07-04 Jiachen Zhao , Zhun Deng , David Madras , James Zou , Mengye Ren

Large language models (LLMs) are susceptible to social-engineered attacks that are human-interpretable but require a high level of comprehension for LLMs to counteract. Existing defensive measures can only mitigate less than half of these…

Computation and Language · Computer Science 2025-05-01 Canaan Yung , Hadi Mohaghegh Dolatabadi , Sarah Erfani , Christopher Leckie

This research article critically examines the potential risks and implications arising from the malicious utilization of large language models(LLM), focusing specifically on ChatGPT and Google's Bard. Although these large language models…

Cryptography and Security · Computer Science 2023-05-25 P. V. Sai Charan , Hrushikesh Chunduri , P. Mohan Anand , Sandeep K Shukla

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

Large language models (LLMs) have demonstrated immense utility across various industries. However, as LLMs advance, the risk of harmful outputs increases due to incorrect or malicious instruction prompts. While current methods effectively…

Computation and Language · Computer Science 2025-06-19 Xinyi Zeng , Yuying Shang , Jiawei Chen , Jingyuan Zhang , Yu Tian

The rapid growth of social media platforms has raised significant concerns regarding online content toxicity. When Large Language Models (LLMs) are used for toxicity detection, two key challenges emerge: 1) the absence of domain-specific…

Computation and Language · Computer Science 2025-06-03 Yibo Zhao , Jiapeng Zhu , Can Xu , Yao Liu , Xiang Li

Fine-tuning large language models (LLMs) for downstream tasks often leads to catastrophic forgetting, notably degrading the safety of originally aligned models. While some existing methods attempt to restore safety by incorporating…

Computation and Language · Computer Science 2025-08-29 Hua Farn , Hsuan Su , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Many safety post-training methods for large language models (LLMs) are designed to modify the model's behaviour from producing unsafe answers to issuing refusals. However, such distribution shifts are often brittle and degrade performance…

Computation and Language · Computer Science 2025-10-08 David Dobre , Mehrnaz Mofakhami , Sophie Xhonneux , Leo Schwinn , Gauthier Gidel

Large Language Models (LLMs) have become increasingly popular for their advanced text generation capabilities across various domains. However, like any software, they face security challenges, including the risk of 'jailbreak' attacks that…

Cryptography and Security · Computer Science 2024-01-31 Jie Li , Yi Liu , Chongyang Liu , Ling Shi , Xiaoning Ren , Yaowen Zheng , Yang Liu , Yinxing Xue

Large Language Models (LLMs) have achieved remarkable success across domains such as healthcare, education, and cybersecurity. However, this openness also introduces significant security risks, particularly through embedding space…

Computation and Language · Computer Science 2025-07-14 Zhibo Zhang , Yuxi Li , Kailong Wang , Shuai Yuan , Ling Shi , Haoyu Wang

Recent advances in large language models (LLMs) have led to their extensive global deployment, and ensuring their safety calls for comprehensive and multilingual toxicity evaluations. However, existing toxicity benchmarks are overwhelmingly…

Computation and Language · Computer Science 2024-08-13 Devansh Jain , Priyanshu Kumar , Samuel Gehman , Xuhui Zhou , Thomas Hartvigsen , Maarten Sap

We consider the challenge of mitigating the generation of negative or toxic content by the Large Language Models (LLMs) in response to certain prompts. We propose integrating risk-averse principles into LLM fine-tuning to minimize the…

Artificial Intelligence · Computer Science 2025-01-14 Sapana Chaudhary , Ujwal Dinesha , Dileep Kalathil , Srinivas Shakkottai

Although large language models (LLMs) achieve effective safety alignment at the time of release, they still face various safety challenges. A key issue is that fine-tuning often compromises the safety alignment of LLMs. To address this…

Computation and Language · Computer Science 2025-05-27 Di Wu , Xin Lu , Yanyan Zhao , Bing Qin

Despite the impressive performance of general-purpose large language models (LLMs), they often require fine-tuning or post-training to excel at specific tasks. For instance, large reasoning models (LRMs), such as the DeepSeek-R1 series,…

Computation and Language · Computer Science 2026-04-02 Mingjie Li , Wai Man Si , Michael Backes , Yang Zhang , Yisen Wang

Recent advancements in large language models (LLMs) have significantly enhanced capabilities in natural language processing and artificial intelligence. These models, including GPT-3.5 and LLaMA-2, have revolutionized text generation,…

Computation and Language · Computer Science 2024-02-06 Yunhong He , Jianling Qiu , Wei Zhang , Zhengqing Yuan