English
Related papers

Related papers: On Evaluating the Durability of Safeguards for Ope…

200 papers

Rapid advances in the capabilities of large language models (LLMs) have raised widespread concerns regarding their potential for malicious use. Open-weight LLMs present unique challenges, as existing safeguards lack robustness to tampering…

Recent defenses for safeguarding open-weight large language models (LLMs) are intended to prevent adversarial usage. Underlying these defenses is an assumption that new harmful behavior is learned through fine-tuning rather than elicited by…

Machine Learning · Computer Science 2026-05-27 Kevin Kuo , Chhavi Yadav , Virginia Smith

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

Artificial Intelligence · Computer Science 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Background: Fine-tuning is central to adapting pre-trained Large Language Models (LLMs) to downstream tasks, but its reliance on training data, parameter updates, and reusable components opens entry points for attackers. Threats have…

Cryptography and Security · Computer Science 2026-05-26 Wenjuan Li , Yitao Liu , Runze Chen , Rajkumar Buyya

Large Language Models (LLMs) have revolutionized artificial intelligence and machine learning through their advanced text processing and generating capabilities. However, their widespread deployment has raised significant safety and…

Cryptography and Security · Computer Science 2024-12-03 Jing Cui , Yishi Xu , Zhewei Huang , Shuchang Zhou , Jianbin Jiao , Junge Zhang

Large Language Models (LLMs) are increasingly popular, powering a wide range of applications. Their widespread use has sparked concerns, especially through jailbreak attacks that bypass safety measures to produce harmful content. In this…

Cryptography and Security · Computer Science 2025-12-25 Zhengchun Shang , Wenlan Wei , Weiheng Bai

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

Cryptography and Security · Computer Science 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Large Language Models (LLMs) represent an advanced evolution of earlier, simpler language models. They boast enhanced abilities to handle complex language patterns and generate coherent text, images, audios, and videos. Furthermore, they…

Cryptography and Security · Computer Science 2024-03-01 Jun Huang , Jiawei Zhang , Qi Wang , Weihong Han , Yanchun Zhang

In the burgeoning field of Large Language Models (LLMs), developing a robust safety mechanism, colloquially known as "safeguards" or "guardrails", has become imperative to ensure the ethical use of LLMs within prescribed boundaries. This…

Cryptography and Security · Computer Science 2024-06-06 Yi Dong , Ronghui Mu , Yanghao Zhang , Siqi Sun , Tianle Zhang , Changshun Wu , Gaojie Jin , Yi Qi , Jinwei Hu , Jie Meng , Saddek Bensalem , Xiaowei Huang

Large language models (LLMs) have demonstrated remarkable capabilities across a broad spectrum of tasks. They have attracted significant attention and been deployed in numerous downstream applications. Nevertheless, akin to a double-edged…

Computation and Language · Computer Science 2023-11-28 Zishan Guo , Renren Jin , Chuang Liu , Yufei Huang , Dan Shi , Supryadi , Linhao Yu , Yan Liu , Jiaxuan Li , Bojian Xiong , Deyi Xiong

Open-weight large language models (LLMs) unlock huge benefits in innovation, personalization, privacy, and democratization. However, their core advantage - modifiability - opens the door to systemic risks: bad actors can trivially subvert…

Computers and Society · Computer Science 2025-07-17 Ann-Kathrin Dombrowski , Dillon Bowen , Adam Gleave , Chris Cundy

Integrated Speech and Large Language Models (SLMs) that can follow speech instructions and generate relevant text responses have gained popularity lately. However, the safety and robustness of these models remains largely unclear. In this…

Fine-tuning Large Language Models (LLMs) on some task-specific datasets has been a primary use of LLMs. However, it has been empirically observed that this approach to enhancing capability inevitably compromises safety, a phenomenon also…

Machine Learning · Statistics 2025-03-28 Pin-Yu Chen , Han Shen , Payel Das , Tianyi Chen

Large Language Models (LLMs) have become central to numerous natural language processing tasks, but their vulnerabilities present significant security and ethical challenges. This systematic survey explores the evolving landscape of attack…

Cryptography and Security · Computer Science 2025-05-05 Zhiyu Liao , Kang Chen , Yuanguo Lin , Kangkang Li , Yunxuan Liu , Hefeng Chen , Xingwang Huang , Yuanhui Yu

Robust verbal confidence generated by large language models (LLMs) is crucial for the deployment of LLMs to help ensure transparency, trust, and safety in many applications, including those involving human-AI interactions. In this paper, we…

Computation and Language · Computer Science 2025-12-19 Stephen Obadinma , Xiaodan Zhu

Fine-tuning a general-purpose large language model (LLM) for a specific domain or task has become a routine procedure for ordinary users. However, fine-tuning is known to remove the safety alignment features of the model, even when the…

Computation and Language · Computer Science 2025-06-23 Kathleen C. Fraser , Hillary Dawkins , Isar Nejadgholi , Svetlana Kiritchenko

Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains. However, the fine-tuning process…

Artificial Intelligence · Computer Science 2025-04-08 Hao Du , Shang Liu , Lele Zheng , Yang Cao , Atsuyoshi Nakamura , Lei Chen

Proprietary large language models (LLMs) exhibit strong generalization capabilities across diverse tasks and are increasingly deployed on edge devices for efficiency and privacy reasons. However, deploying proprietary LLMs at the edge…

Cryptography and Security · Computer Science 2026-04-28 Qinfeng Li , Tianyue Luo , Xuhong Zhang , Yangfan Xie , Zhiqiang Shen , Lijun Zhang , Yier Jin , Hao Peng , Xinkui Zhao , Xianwei Zhu , Jianwei Yin

Large Language Models (LLMs) have revolutionized natural language processing, but their robustness against adversarial attacks remains a critical concern. We presents a novel white-box style attack approach that exposes vulnerabilities in…

Computation and Language · Computer Science 2024-09-16 Zeyu Yang , Zhao Meng , Xiaochen Zheng , Roger Wattenhofer

Recent studies reveal that Large Language Models (LLMs) face challenges in balancing safety with utility, particularly when processing long texts for NLP tasks like summarization and translation. Despite defenses against malicious short…

Computation and Language · Computer Science 2024-05-27 Yu Fu , Wen Xiao , Jia Chen , Jiachen Li , Evangelos Papalexakis , Aichi Chien , Yue Dong
‹ Prev 1 2 3 10 Next ›