English
Related papers

Related papers: LLM Safety From Within: Detecting Harmful Content …

200 papers

Insider threat detection aims to identify malicious user behavior by analyzing logs that record user interactions. Due to the lack of fine-grained behavior-level annotations, detecting specific behavior-level anomalies within user behavior…

Cryptography and Security · Computer Science 2025-08-18 Yang Wang , Yaxin Zhao , Xinyu Jiao , Sihan Xu , Xiangrui Cai , Ying Zhang , Xiaojie Yuan

Ransomware's escalating sophistication necessitates tamper-resistant, off-host detection solutions that capture deep disk activity beyond the reach of a compromised operating system. Existing detection systems use host/kernel signals or…

Cryptography and Security · Computer Science 2026-03-13 Md Raz , Venkata Sai Charan Putrevu , Prashanth Krishnamurthy , Farshad Khorrami , Ramesh Karri

This work addresses the computational challenge of enforcing privacy for agentic Large Language Models (LLMs), where privacy is governed by the contextual integrity framework. Indeed, existing defenses rely on LLM-mediated checking stages…

Cryptography and Security · Computer Science 2026-01-22 Saswat Das , Ferdinando Fioretto

This paper addresses the critical challenge of deriving interpretable confidence scores from generative language models (LLMs) when applied to multi-label content safety classification. While models like LLaMA Guard are effective for…

Computation and Language · Computer Science 2025-12-01 Anjaneya Praharaj , Jaykumar Kasundra

While explicit Chain-of-Thought (CoT) empowers large reasoning models (LRMs), it enables the generation of riskier final answers. Current alignment paradigms primarily rely on externally enforced compliance, optimizing models to detect…

Artificial Intelligence · Computer Science 2026-05-12 Yi Zhang , Yuxin Chen , Leheng Sheng , Dongcheng Zhang , Chaochao Lu , Xiang Wang , An Zhang

Large Language Models (LLMs) have emerged as a popular choice in vulnerability detection studies given their foundational capabilities, open source availability, and variety of models, but have limited scalability due to extensive compute…

Software Engineering · Computer Science 2026-04-01 Miles Farmer , Ekincan Ufuktepe , Anne Watson , Hialo Muniz Carvalho , Vadim Okun , Zineb Maasaoui , Kannappan Palaniappan

Large Language Models (LLMs) can comply with harmful instructions, raising serious safety concerns despite their impressive capabilities. Recent work has leveraged probing-based approaches to study the separability of malicious and benign…

Computation and Language · Computer Science 2025-12-16 Cheng Wang , Zeming Wei , Qin Liu , Muhao Chen

Large Language Models (LLMs) are increasingly used in a variety of important applications, yet their safety and reliability remain as major concerns. Various adversarial and jailbreak attacks have been proposed to bypass the safety…

Computation and Language · Computer Science 2024-10-18 Leon Zhou , Junfeng Yang , Chengzhi Mao

As Large Language Models (LLMs) are deployed and integrated into thousands of applications, the need for scalable evaluation of how models respond to adversarial attacks grows rapidly. However, LLM security is a moving target: models…

Computation and Language · Computer Science 2024-06-18 Leon Derczynski , Erick Galinkin , Jeffrey Martin , Subho Majumdar , Nanna Inie

Adaptive prompt and program search makes LLM evaluation selection-sensitive. Once benchmark items are reused inside tuning, the observed winner's score need not estimate the fresh-data performance of the full tune-then-deploy procedure. We…

Machine Learning · Statistics 2026-05-08 Yang Xu , Jiefu Zhang , Haixiang Sun , Zihan Zhou , Tianyu Cao , Vaneet Aggarwal

Multi-agent LLM systems introduce a security risk in which sensitive information accessed by one agent can propagate through shared context and reappear in downstream outputs, even without explicit adversarial intent. We formalise this…

Artificial Intelligence · Computer Science 2026-05-12 Riya Tapwal , Abhishek Kumar , Carsten Maple

Controlling undesirable Large Language Model (LLM) behaviors, such as the generation of unsafe content or failing to adhere to safety guidelines, often relies on costly fine-tuning. Activation steering provides an alternative for…

Computation and Language · Computer Science 2026-03-17 Amr Hegazy , Mostafa Elhoushi , Amr Alanwar

Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias,…

Cryptography and Security · Computer Science 2024-06-21 Suriya Ganesh Ayyamperumal , Limin Ge

Machine learning (ML)-based network intrusion detection is susceptible to attacks that perturb malicious network flows to evade detection. Existing approaches to evaluating the robustness of these models rely on gradient-based optimization…

Cryptography and Security · Computer Science 2026-05-15 Kyle Domico , Jean-Charles Noirot Ferrand , Patrick McDaniel

Large language models (LLMs) undergo alignment training to avoid harmful behaviors, yet the resulting safeguards remain brittle: jailbreaks routinely bypass them, and fine-tuning on narrow domains can induce ``emergent misalignment'' that…

Computation and Language · Computer Science 2026-04-13 Hadas Orgad , Boyi Wei , Kaden Zheng , Martin Wattenberg , Peter Henderson , Seraphina Goldfarb-Tarrant , Yonatan Belinkov

Malicious content generated by large language models (LLMs) can pose varying degrees of harm. Although existing LLM-based moderators can detect harmful content, they struggle to assess risk levels and may miss lower-risk outputs. Accurate…

Computation and Language · Computer Science 2025-03-11 Fan Yin , Philippe Laban , Xiangyu Peng , Yilun Zhou , Yixin Mao , Vaibhav Vats , Linnea Ross , Divyansh Agarwal , Caiming Xiong , Chien-Sheng Wu

Achieving robust safety alignment in large language models (LLMs) while preserving their utility remains a fundamental challenge. Existing approaches often struggle to balance comprehensive safety with fine-grained controllability at the…

Artificial Intelligence · Computer Science 2025-09-25 Huizhen Shu , Xuying Li , Zhuo Li

To enhance the safety of VLMs, this paper introduces a novel reasoning-based VLM guard model dubbed GuardReasoner-VL. The core idea is to incentivize the guard model to deliberatively reason before making moderation decisions via online RL.…

Artificial Intelligence · Computer Science 2025-05-19 Yue Liu , Shengfang Zhai , Mingzhe Du , Yulin Chen , Tri Cao , Hongcheng Gao , Cheng Wang , Xinfeng Li , Kun Wang , Junfeng Fang , Jiaheng Zhang , Bryan Hooi

Large language models (LLMs) have brought significant advancements to code generation, benefiting both novice and experienced developers. However, their training using unsanitized data from open-source repositories, like GitHub, introduces…

Software Engineering · Computer Science 2023-10-26 Jiexin Wang , Liuwen Cao , Xitong Luo , Zhiping Zhou , Jiayuan Xie , Adam Jatowt , Yi Cai

Despite the success of Large Language Models (LLMs) across various fields, their potential to generate untruthful, biased and harmful responses poses significant risks, particularly in critical applications. This highlights the urgent need…

Artificial Intelligence · Computer Science 2025-05-27 Mengdi Zhang , Kai Kiat Goh , Peixin Zhang , Jun Sun , Rose Lin Xin , Hongyu Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›