English
Related papers

Related papers: From Narrow Unlearning to Emergent Misalignment: C…

200 papers

Jailbreaking attacks can enable Large Language Models (LLMs) to bypass the safeguard and generate harmful content. Existing jailbreaking defense methods have failed to address the fundamental issue that harmful knowledge resides within the…

Computation and Language · Computer Science 2024-07-04 Weikai Lu , Ziqian Zeng , Jianwei Wang , Zhengdong Lu , Zelin Chen , Huiping Zhuang , Cen Chen

Safety alignment has become a critical step to ensure LLMs refuse harmful requests while providing helpful and harmless responses. However, despite the ubiquity of safety alignment for deployed frontier models, two separate lines of recent…

Cryptography and Security · Computer Science 2026-04-06 John T. Halloran

The Extreme Learning Machine (ELM) is a growing statistical technique widely applied to regression problems. In essence, ELMs are single-layer neural networks where the hidden layer weights are randomly sampled from a specific distribution,…

Machine Learning · Statistics 2025-07-31 Daniela De Canditiis , Fabiano Veglianti

Large Language Models (LLMs) are increasingly used for cybersecurity threat analysis, but their deployment in security-sensitive environments raises trust and safety concerns. With over 21,000 vulnerabilities disclosed in 2025, manual…

Cryptography and Security · Computer Science 2025-09-04 Reza Fayyazi , Michael Zuzak , Shanchieh Jay Yang

The widespread deployment of Large Language Models (LLMs) trained on massive, uncurated corpora has raised growing concerns about the inclusion of sensitive, copyrighted, or illegal content. This has led to increasing interest in LLM…

Computation and Language · Computer Science 2025-06-10 Chenlong Zhang , Zhuoran Jin , Hongbang Yuan , Jiaheng Wei , Tong Zhou , Kang Liu , Jun Zhao , Yubo Chen

Deploying LLM-based agents in real-life applications often faces a critical challenge: the misalignment between agents' behavior and user intent. Such misalignment may lead agents to unintentionally execute critical actions that carry…

Computation and Language · Computer Science 2025-10-01 Haishuo Fang , Xiaodan Zhu , Iryna Gurevych

Large language models (LLMs) are now ubiquitous in everyday tools, raising urgent safety concerns about their tendency to generate harmful content. The dominant safety approach -- reinforcement learning from human feedback (RLHF) --…

Machine Learning · Computer Science 2025-09-29 Sathwik Karnik , Somil Bansal

Safely aligning large language models (LLMs) often demands extensive human-labeled preference data, a process that's both costly and time-consuming. While synthetic data offers a promising alternative, current methods frequently rely on…

Cryptography and Security · Computer Science 2025-06-13 Kyubyung Chae , Hyunbin Jin , Taesup Kim

Despite investments in improving model safety, studies show that misaligned capabilities remain latent in safety-tuned models. In this work, we shed light on the mechanics of this phenomenon. First, we show that even when model generations…

Computation and Language · Computer Science 2024-08-14 Asma Ghandeharioun , Ann Yuan , Marius Guerard , Emily Reif , Michael A. Lepori , Lucas Dixon

The deployment of large language models (LLMs) raises significant ethical and safety concerns. While LLM alignment techniques are adopted to improve model safety and trustworthiness, adversaries can exploit these techniques to undermine…

Cryptography and Security · Computer Science 2026-04-10 Rui Zhang , Hongwei Li , Yun Shen , Xinyue Shen , Wenbo Jiang , Guowen Xu , Yang Liu , Michael Backes , Yang Zhang

One of the key technologies for the success of Large Language Models (LLMs) is preference alignment. However, a notable side effect of preference alignment is poor calibration: while the pre-trained models are typically well-calibrated,…

Machine Learning · Computer Science 2025-10-17 Jiancong Xiao , Bojian Hou , Zhanliang Wang , Ruochen Jin , Qi Long , Weijie J. Su , Li Shen

AI developers often apply safety alignment procedures to prevent the misuse of their AI systems. For example, before Meta released Llama 2-Chat - a collection of instruction fine-tuned large language models - they invested heavily in safety…

Machine Learning · Computer Science 2024-05-24 Simon Lermen , Charlie Rogers-Smith , Jeffrey Ladish

Current LLM safety research predominantly focuses on mitigating Goal Hijacking, preventing attackers from redirecting a model's high-level objective (e.g., from "summarizing emails" to "phishing users"). In this paper, we argue that this…

Cryptography and Security · Computer Science 2026-04-28 Yuansen Liu , Yixuan Tang , Anthony Kum Hoe Tun

Activation monitoring, which probes a model's internal states using lightweight classifiers, is an emerging tool for AI safety. However, its worst-case robustness under a misalignment threat model--where a model might learn to actively…

Machine Learning · Computer Science 2025-12-16 Max McGuinness , Alex Serrano , Luke Bailey , Scott Emmons

Ecological Momentary Assessments (EMAs) are an important psychological data source for measuring current cognitive states, affect, behavior, and environmental factors from participants in mobile health (mHealth) studies and treatment…

Data-sparse settings such as robotic manipulation, molecular physics, and galaxy morphology classification are some of the hardest domains for deep learning. For these problems, equivariant networks can help improve modeling across…

Machine Learning · Computer Science 2026-01-30 Edward Berman , Jacob Ginesin , Marco Pacini , Robin Walters

Machine unlearning seeks to selectively remove the "influence" of specific training data on a model's outputs. The ideal goal is Retrain Equivalence--behavior identical to a model trained from scratch on only the retained data. This goal…

Machine Learning · Computer Science 2025-10-31 Jiatong Yu , Yinghui He , Anirudh Goyal , Sanjeev Arora

Fine-tuning text-to-image diffusion models is widely used for personalization and adaptation for new domains. In this paper, we identify a critical vulnerability of fine-tuning: safety alignment methods designed to filter harmful content…

Artificial Intelligence · Computer Science 2024-12-03 Sanghyun Kim , Moonseok Choi , Jinwoo Shin , Juho Lee

Misaligned research objectives have considerably hindered progress in adversarial robustness research over the past decade. For instance, an extensive focus on optimizing target metrics, while neglecting rigorous standardized evaluation,…

Machine Learning · Computer Science 2025-02-24 Leo Schwinn , Yan Scholten , Tom Wollschläger , Sophie Xhonneux , Stephen Casper , Stephan Günnemann , Gauthier Gidel

The growing concern over training data privacy has elevated the "Right to be Forgotten" into a critical requirement, thereby raising the demand for effective Machine Unlearning. However, existing unlearning approaches commonly suffer from a…

Machine Learning · Computer Science 2026-02-20 Haoyu Wang , Zhuo Huang , Xiaolong Wang , Bo Han , Zhiwei Lin , Tongliang Liu