中文
相关论文

相关论文: Mitigating Exaggerated Safety in Large Language Mo…

200 篇论文

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

软件工程 · 计算机科学 2026-04-07 Rabia Iftikhar , Andreas Rausch

Many publicly available language models have been safety tuned to reduce the likelihood of toxic or liability-inducing text. To redteam or jailbreak these models for compliance with toxic requests, users and security analysts have developed…

计算与语言 · 计算机科学 2024-10-02 T. Ben Thompson , Michael Sklar

In large language models (LLM)-based recommendation systems (LLM-RSs), accurately predicting user preferences by leveraging the general knowledge of LLMs is possible without requiring extensive training data. By converting recommendation…

信息检索 · 计算机科学 2024-12-20 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

With the integration of an additional modality, large vision-language models (LVLMs) exhibit greater vulnerability to safety risks (e.g., jailbreaking) compared to their language-only predecessors. Although recent studies have devoted…

机器学习 · 计算机科学 2025-01-07 Ziwei Zheng , Junyao Zhao , Le Yang , Lijun He , Fan Li

In this paper, we investigate the safety mechanisms of instruction fine-tuned large language models (LLMs). We discover that re-weighting MLP neurons can significantly compromise a model's safety, especially for MLPs in end-of-sentence…

计算与语言 · 计算机科学 2024-10-15 Yifan Luo , Zhennan Zhou , Meitan Wang , Bin Dong

Large language models (LLMs) show impressive abilities via few-shot prompting. Commercialized APIs such as OpenAI GPT-3 further increase their use in real-world language applications. However, the crucial problem of how to improve the…

计算与语言 · 计算机科学 2023-02-16 Chenglei Si , Zhe Gan , Zhengyuan Yang , Shuohang Wang , Jianfeng Wang , Jordan Boyd-Graber , Lijuan Wang

System prompts provide a lightweight yet powerful mechanism for conditioning large language models (LLMs) at inference time. While prior work has focused on English-only settings, real-world deployments benefit from having a single prompt…

计算与语言 · 计算机科学 2025-12-03 Lechen Zhang , Yusheng Zhou , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

信息检索 · 计算机科学 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning and text generation. However, these models can inadvertently generate unsafe or biased responses when prompted with problematic inputs, raising…

As diverse linguistic communities and users adopt large language models (LLMs), assessing their safety across languages becomes critical. Despite ongoing efforts to make LLMs safe, they can still be made to behave unsafely with…

计算与语言 · 计算机科学 2024-08-09 Fabio Pernisi , Dirk Hovy , Paul Röttger

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Recent progress in large language models (LLMs) has led to their widespread adoption in various domains. However, these advancements have also introduced additional safety risks and raised concerns regarding their detrimental impact on…

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

计算与语言 · 计算机科学 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

Large language models (LLMs) are popular for high-quality text generation but can produce harmful content, even when aligned with human values through reinforcement learning. Adversarial prompts can bypass their safety measures. We propose…

计算与语言 · 计算机科学 2024-05-03 Mansi Phute , Alec Helbling , Matthew Hull , ShengYun Peng , Sebastian Szyller , Cory Cornelius , Duen Horng Chau

As large language models (LLMs) are deployed in safety-critical settings, it is essential to ensure that their responses comply with safety standards. Prior research has revealed that LLMs often fail to grasp the notion of safe behaviors,…

人工智能 · 计算机科学 2026-03-09 Kartik Sharma , Yiqiao Jin , Vineeth Rakesh , Yingtong Dou , Menghai Pan , Mahashweta Das , Srijan Kumar

Large Language Models (LLMs) are widely used across sectors, yet their alignment with International Humanitarian Law (IHL) is not well understood. This study evaluates eight leading LLMs on their ability to refuse prompts that explicitly…

计算机与社会 · 计算机科学 2025-06-10 John Mavi , Diana Teodora Găitan , Sergio Coronado

Large language models (LLMs) are typically aligned to refuse harmful instructions through safety fine-tuning. A recent attack, termed abliteration, identifies and suppresses the single latent direction most responsible for refusal behavior,…

计算与语言 · 计算机科学 2025-10-08 Harethah Abu Shairah , Hasan Abed Al Kader Hammoud , Bernard Ghanem , George Turkiyyah

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

计算与语言 · 计算机科学 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

The rapid identification of medical emergencies through digital communication channels remains a critical challenge in modern healthcare delivery, particularly with the increasing prevalence of telemedicine. This paper presents a novel…

机器学习 · 计算机科学 2024-12-24 Ferit Akaybicen , Aaron Cummings , Lota Iwuagwu , Xinyue Zhang , Modupe Adewuyi

This paper studies contextual biasing with Large Language Models (LLMs), where during second-pass rescoring additional contextual information is provided to a LLM to boost Automatic Speech Recognition (ASR) performance. We propose to…

计算与语言 · 计算机科学 2023-09-25 Chuanneng Sun , Zeeshan Ahmed , Yingyi Ma , Zhe Liu , Lucas Kabela , Yutong Pang , Ozlem Kalinli