English
Related papers

Related papers: Secure Tug-of-War (SecTOW): Iterative Defense-Atta…

200 papers

Federated learning is a promising approach for training machine learning models while preserving data privacy. However, its distributed nature makes it vulnerable to backdoor attacks, particularly in NLP tasks, where related research…

Machine Learning · Computer Science 2025-07-31 Minyeong Choe , Cheolhee Park , Changho Seo , Hyunil Kim

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Split Learning (SL) has emerged as a promising paradigm for distributed deep learning, allowing resource-constrained clients to offload portions of their model computation to servers while maintaining collaborative learning. However, recent…

Cryptography and Security · Computer Science 2025-05-12 Aqsa Shabbir , Halil İbrahim Kanpak , Alptekin Küpçü , Sinem Sav

While there has been progress towards aligning Large Language Models (LLMs) with human values and ensuring safe behaviour at inference time, safety guards can easily be removed when fine tuned on unsafe and harmful datasets. While this…

The success of deep learning in transient stability assessment (TSA) heavily relies on high-quality training data. However, the label information in TSA datasets is vulnerable to contamination through false label injection (FLI)…

Machine Learning · Computer Science 2024-06-12 Hanxuan Wang , Na Lu , Yinhong Liu , Zhuqing Wang , Zixuan Wang

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

This study addresses a critical gap in safety tuning practices for Large Language Models (LLMs) by identifying and tackling a refusal position bias within safety tuning data, which compromises the models' ability to appropriately refuse…

Computation and Language · Computer Science 2025-05-26 Youliang Yuan , Wenxiang Jiao , Wenxuan Wang , Jen-tse Huang , Jiahao Xu , Tian Liang , Pinjia He , Zhaopeng Tu

Large Language Models (LLMs) are susceptible to adversarial attacks such as jailbreaking, which can elicit harmful or unsafe behaviors. This vulnerability is exacerbated in multilingual settings, where multilingual safety-aligned data is…

Computation and Language · Computer Science 2025-09-29 Yahan Yang , Soham Dan , Shuo Li , Dan Roth , Insup Lee

Textual backdoor attacks present a substantial security risk to Large Language Models (LLM). It embeds carefully chosen triggers into a victim model at the training stage, and makes the model erroneously predict inputs containing the same…

Computation and Language · Computer Science 2024-07-08 Xinglin Li , Xianwen He , Yao Li , Minhao Cheng

Autonomous spacecraft control via Shielded Deep Reinforcement Learning (SDRL) has become a rapidly growing research area. However, the construction of shields and the definition of tasking remains informal, resulting in policies with no…

Machine Learning · Computer Science 2024-03-15 Robert Reed , Hanspeter Schaub , Morteza Lahijanian

Despite extensive efforts to align Large Language Models (LLMs) with human values and safety rules, jailbreak attacks that exploit certain vulnerabilities continuously emerge, highlighting the need to strengthen existing LLMs with…

Machine Learning · Computer Science 2025-09-30 Xuekang Wang , Shengyu Zhu , Xueqi Cheng

Multimodal large language models (MLLMs) integrate information from multiple modalities such as text, images, audio, and video, enabling complex capabilities such as visual question answering and audio translation. While powerful, this…

Cryptography and Security · Computer Science 2026-03-31 Bhavuk Jain , Sercan Ö. Arık , Hardeo K. Thakur

As large language models (LLMs) become increasingly integrated into real-world applications such as code generation and chatbot assistance, extensive efforts have been made to align LLM behavior with human values, including safety.…

Cryptography and Security · Computer Science 2024-07-29 Zhangchen Xu , Fengqing Jiang , Luyao Niu , Jinyuan Jia , Bill Yuchen Lin , Radha Poovendran

Security concerns related to Large Language Models (LLMs) have been extensively explored, yet the safety implications for Multimodal Large Language Models (MLLMs), particularly in medical contexts (MedMLLMs), remain insufficiently studied.…

Cryptography and Security · Computer Science 2024-08-22 Xijie Huang , Xinyuan Wang , Hantao Zhang , Yinghao Zhu , Jiawen Xi , Jingkun An , Hao Wang , Hao Liang , Chengwei Pan

Backdoor attacks have become a major security threat for deploying machine learning models in security-critical applications. Existing research endeavors have proposed many defenses against backdoor attacks. Despite demonstrating certain…

Machine Learning · Computer Science 2023-11-28 Hengzhi Pei , Jinyuan Jia , Wenbo Guo , Bo Li , Dawn Song

Despite careful safety alignment, current large language models (LLMs) remain vulnerable to various attacks. To further unveil the safety risks of LLMs, we introduce a Safety Concept Activation Vector (SCAV) framework, which effectively…

Computation and Language · Computer Science 2024-12-03 Zhihao Xu , Ruixuan Huang , Changyu Chen , Xiting Wang

The widespread adoption of Large Language Models (LLMs) has revolutionized AI deployment, enabling autonomous and semi-autonomous applications across industries through intuitive language interfaces and continuous improvements in model…

Cryptography and Security · Computer Science 2025-10-20 Adam Swanda , Amy Chang , Alexander Chen , Fraser Burch , Paul Kassianik , Konstantin Berlin

LLMs have made impressive progress, but their growing capabilities also expose them to highly flexible jailbreaking attacks designed to bypass safety alignment. While many existing defenses focus on known types of attacks, it is more…

Cryptography and Security · Computer Science 2025-05-27 Haoyu Wang , Zeyu Qin , Yifei Zhao , Chao Du , Min Lin , Xueqian Wang , Tianyu Pang

Large Language Models (LLMs) are attracting significant research attention due to their instruction-following abilities, allowing users and developers to leverage LLMs for a variety of tasks. However, LLMs are vulnerable to prompt-injection…

Cryptography and Security · Computer Science 2024-01-10 Julien Piet , Maha Alrashed , Chawin Sitawarin , Sizhe Chen , Zeming Wei , Elizabeth Sun , Basel Alomair , David Wagner

The increasing deployment of large language models in security-sensitive domains necessitates rigorous evaluation of their resilience against adversarial prompt-based attacks. While previous benchmarks have focused on security evaluations…

Cryptography and Security · Computer Science 2025-09-22 Huining Cui , Wei Liu