中文
相关论文

相关论文: A Generative Approach to LLM Harmfulness Mitigatio…

200 篇论文

Large Language Models (LLMs) are known to be vulnerable to jailbreak attacks. An important observation is that, while different types of jailbreak attacks can generate significantly different queries, they mostly result in similar responses…

密码学与安全 · 计算机科学 2025-05-21 Zhexin Zhang , Junxiao Yang , Yida Lu , Pei Ke , Shiyao Cui , Chujie Zheng , Hongning Wang , Minlie Huang

As large-scale distributed energy resources are integrated into the active distribution networks (ADNs), effective energy management in ADNs becomes increasingly prominent compared to traditional distribution networks. Although advanced…

系统与控制 · 电气工程与系统科学 2024-12-03 Xu Yang , Chenhui Lin , Haotian Liu , Wenchuan Wu

When large language model (LLM) systems interact with external data to perform complex tasks, a new attack, namely prompt injection, becomes a significant threat. By injecting instructions into the data accessed by the system, the attacker…

密码学与安全 · 计算机科学 2025-08-26 Sizhe Chen , Yizhu Wang , Nicholas Carlini , Chawin Sitawarin , David Wagner

In order to be deployed safely, Large Language Models (LLMs) must be capable of dynamically adapting their behavior based on their level of knowledge and uncertainty associated with specific topics. This adaptive behavior, which we refer to…

计算与语言 · 计算机科学 2024-07-04 Alexandre Piché , Aristides Milios , Dzmitry Bahdanau , Chris Pal

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

计算与语言 · 计算机科学 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Large language models have demonstrated exceptional performance, yet struggle with complex tasks such as numerical reasoning, plan generation. Integrating external tools, such as calculators and databases, into large language models (LLMs)…

计算与语言 · 计算机科学 2025-06-18 Chenghao Li , Liu Liu , Baosheng Yu , Jiayan Qiu , Yibing Zhan

Red-teaming is a common practice for mitigating unsafe behaviors in Large Language Models (LLMs), which involves thoroughly assessing LLMs to identify potential flaws and addressing them with responsible and accurate responses. While…

计算与语言 · 计算机科学 2023-11-15 Suyu Ge , Chunting Zhou , Rui Hou , Madian Khabsa , Yi-Chia Wang , Qifan Wang , Jiawei Han , Yuning Mao

Intrusion Detection Systems (IDS) play a crucial role in network security defense. However, a significant challenge for IDS in training detection models is the shortage of adequately labeled malicious samples. To address these issues, this…

密码学与安全 · 计算机科学 2025-08-26 Haijian Ma , Daizong Liu , Xiaowen Cai , Pan Zhou , Yulai Xie

Large language models (LLMs) are now ubiquitous in everyday tools, raising urgent safety concerns about their tendency to generate harmful content. The dominant safety approach -- reinforcement learning from human feedback (RLHF) --…

机器学习 · 计算机科学 2025-09-29 Sathwik Karnik , Somil Bansal

Large Language Models (LLMs) are becoming vital tools that help us solve and understand complex problems by acting as digital assistants. LLMs can generate convincing explanations, even when only given the inputs and outputs of these…

计算与语言 · 计算机科学 2024-10-14 Rohan Ajwani , Shashidhar Reddy Javaji , Frank Rudzicz , Zining Zhu

The rapid growth of Large Language Models (LLMs) presents significant privacy, security, and ethical concerns. While much research has proposed methods for defending LLM systems against misuse by malicious actors, researchers have recently…

Social media platforms utilize Machine Learning (ML) and Artificial Intelligence (AI) powered recommendation algorithms to maximize user engagement, which can result in inadvertent exposure to harmful content. Current moderation efforts,…

计算与语言 · 计算机科学 2025-05-30 Rajvardhan Oak , Muhammad Haroon , Claire Jo , Magdalena Wojcieszak , Anshuman Chhabra

Large Language Models (LLMs), despite their impressive capabilities, often fail to accurately repeat a single word when prompted to, and instead output unrelated text. This unexplained failure mode represents a vulnerability, allowing even…

机器学习 · 计算机科学 2025-03-13 Itay Yona , Ilia Shumailov , Jamie Hayes , Federico Barbero , Yossi Gandelsman

As large language models (LLMs) grow in power and influence, ensuring their safety and preventing harmful output becomes critical. Automated red teaming serves as a tool to detect security vulnerabilities in LLMs without manual labor.…

人工智能 · 计算机科学 2025-06-03 Weiyang Guo , Zesheng Shi , Zhuo Li , Yequan Wang , Xuebo Liu , Wenya Wang , Fangming Liu , Min Zhang , Jing Li

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

计算与语言 · 计算机科学 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

Large Language Models (LLMs) have shown strong potential for recommendation by framing item prediction as a token-by-token language generation task. However, existing methods treat all item tokens equally, simply pursuing likelihood…

计算与语言 · 计算机科学 2025-10-31 Zijie Lin , Yang Zhang , Xiaoyan Zhao , Fengbin Zhu , Fuli Feng , Tat-Seng Chua

The rapid growth of social media platforms has raised significant concerns regarding online content toxicity. When Large Language Models (LLMs) are used for toxicity detection, two key challenges emerge: 1) the absence of domain-specific…

计算与语言 · 计算机科学 2025-06-03 Yibo Zhao , Jiapeng Zhu , Can Xu , Yao Liu , Xiang Li

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

密码学与安全 · 计算机科学 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

计算与语言 · 计算机科学 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

Large language models (LLMs) have enhanced our ability to rapidly analyze and classify unstructured natural language data. However, concerns regarding cost, network limitations, and security constraints have posed challenges for their…

机器学习 · 计算机科学 2024-11-05 David Farr , Nico Manzonelli , Iain Cruickshank , Jevin West