中文
相关论文

相关论文: Towards Safety and Helpfulness Balanced Responses …

200 篇论文

Large Language Models (LLMs) become the start-of-the-art solutions for a variety of natural language tasks and are integrated into real-world applications. However, LLMs can be potentially harmful in manifesting undesirable safety issues…

人工智能 · 计算机科学 2024-03-05 Zhuoer Xu , Jianping Zhang , Shiwen Cui , Changhua Meng , Weiqiang Wang

Fine-tuning large language models (LLMs) for downstream tasks often leads to catastrophic forgetting, notably degrading the safety of originally aligned models. While some existing methods attempt to restore safety by incorporating…

计算与语言 · 计算机科学 2025-08-29 Hua Farn , Hsuan Su , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Large Language Models (LLMs) are transforming human decision-making by acting as cognitive collaborators. Yet, this promise comes with a paradox: while LLMs can improve accuracy, they may also erode independent reasoning, promote…

密码学与安全 · 计算机科学 2025-09-09 Irdin Pekaric , Philipp Zech , Tom Mattson

The application scope of Large Language Models (LLMs) continues to expand, leading to increasing interest in personalized LLMs that align with human values. However, aligning these models with individual values raises significant safety…

计算与语言 · 计算机科学 2025-06-10 Sooyung Choi , Jaehyeok Lee , Xiaoyuan Yi , Jing Yao , Xing Xie , JinYeong Bak

As Large Language Models (LLMs) receive increasing attention and are being deployed across various domains, their potential risks, including generating harmful or biased content, producing unsupported claims, and exhibiting vulnerabilities…

计算与语言 · 计算机科学 2026-04-20 Wai Man Si , Mingjie Li , Michael Backes , Yang Zhang

The emergence of autonomous Large Language Model (LLM) agents capable of tool usage has introduced new safety risks that go beyond traditional conversational misuse. These agents, empowered to execute external functions, are vulnerable to…

人工智能 · 计算机科学 2025-07-14 Zeyang Sha , Hanling Tian , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weiqiang Wang

Recent studies reveal that Large Language Models (LLMs) face challenges in balancing safety with utility, particularly when processing long texts for NLP tasks like summarization and translation. Despite defenses against malicious short…

计算与语言 · 计算机科学 2024-05-27 Yu Fu , Wen Xiao , Jia Chen , Jiachen Li , Evangelos Papalexakis , Aichi Chien , Yue Dong

This paper presents a systematic evaluation of Large Language Models' (LLMs) behavior on long-tail distributed (encrypted) texts and their safety implications. We introduce a two-dimensional framework for assessing LLM safety: (1)…

计算与语言 · 计算机科学 2025-06-05 Utsav Maskey , Mark Dras , Usman Naseem

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex cognitive tasks. However, their complexity and lack of transparency have raised several trustworthiness concerns, including the propagation of…

机器学习 · 计算机科学 2023-11-07 Satyapriya Krishna

Large Language Models (LLMs) have enabled agents to move beyond conversation toward end-to-end task execution and become more helpful. However, this helpfulness introduces new security risks stem less from direct interface abuse than from…

密码学与安全 · 计算机科学 2026-01-19 Fengchao Chen , Tingmin Wu , Van Nguyen , Carsten Rudolph

The increased presence of large language models (LLMs) in educational settings has ignited debates concerning negative repercussions, including overreliance and inadequate task reflection. Our work advocates moderated usage of such models,…

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

计算与语言 · 计算机科学 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

Generative AI, including large language models (LLMs) have the potential -- and already are being used -- to increase the speed, scale, and types of unsafe conversations online. LLMs lower the barrier for entry for bad actors to create…

人机交互 · 计算机科学 2025-07-31 Owen Hoffman , Kangze Peng , Zehua You , Sajid Kamal , Sukrit Venkatagiri

This paper analyzes the safety of Large Language Models (LLMs) in interactions with children below age of 18 years. Despite the transformative applications of LLMs in various aspects of children's lives such as education and therapy, there…

计算机与社会 · 计算机科学 2025-02-19 Prasanjit Rath , Hari Shrawgi , Parag Agrawal , Sandipan Dandapat

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

密码学与安全 · 计算机科学 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

Large Language Models (LLMs) are increasingly embedded in child-facing contexts such as education, companionship, creative tools, but their deployment raises safety, privacy, developmental, and security risks. We conduct a systematic…

计算机与社会 · 计算机科学 2026-05-26 Junfeng Jiao , Saleh Afroogh , Kevin Chen , Abhejay Murali , David Atkinson , Amit Dhurandhar

Ensuring that large language models (LLMs) are both helpful and harmless is a critical challenge, as overly strict constraints can lead to excessive refusals, while permissive models risk generating harmful content. Existing approaches,…

Large Language Models (LLMs) are transforming education by enabling personalization, feedback, and knowledge access, while also raising concerns about risks to students and learning systems. Yet empirical evidence on these risks remains…

计算机与社会 · 计算机科学 2025-11-04 Iris Delikoura , Yi. R Fung , Pan Hui

Autonomous Driving (AD) encounters significant safety hurdles in long-tail unforeseen driving scenarios, largely stemming from the non-interpretability and poor generalization of the deep neural networks within the AD system, particularly…

人工智能 · 计算机科学 2024-03-25 Yixuan Wang , Ruochen Jiao , Sinong Simon Zhan , Chengtian Lang , Chao Huang , Zhaoran Wang , Zhuoran Yang , Qi Zhu

Given the growing influence of language model-based agents on high-stakes societal decisions, from public policy to healthcare, ensuring their beneficial impact requires understanding the far-reaching implications of their suggestions. We…

人工智能 · 计算机科学 2025-06-27 Chenkai Sun , Denghui Zhang , ChengXiang Zhai , Heng Ji