中文
相关论文

相关论文: LM Agents May Fail to Act on Their Own Risk Knowle…

200 篇论文

With the integration of large language models (LLMs), embodied agents have strong capabilities to understand and plan complicated natural language instructions. However, a foreseeable issue is that those embodied agents can also flawlessly…

密码学与安全 · 计算机科学 2025-11-03 Sheng Yin , Xianghe Pang , Yuanzhuo Ding , Menglan Chen , Yutong Bi , Yichen Xiong , Wenhao Huang , Zhen Xiang , Jing Shao , Siheng Chen

We observe that MLRMs oriented toward human-centric service are highly susceptible to user emotional cues during the deep-thinking stage, often overriding safety protocols or built-in safety checks under high emotional intensity. Inspired…

人工智能 · 计算机科学 2025-08-07 Yuan Xun , Xiaojun Jia , Xinwei Liu , Hua Zhang

Large language models (LLMs) often achieve strong performance on reasoning benchmarks, but final-answer accuracy alone does not show whether they faithfully execute the procedure specified in a prompt. We introduce a controlled diagnostic…

计算与语言 · 计算机科学 2026-05-26 Sailesh Panda , Pritam Kadasi , Abhishek Upperwal , Mayank Singh

High-privilege LLM agents that autonomously process external documentation are increasingly trusted to automate tasks by reading and executing project instructions, yet they are granted terminal access, filesystem control, and outbound…

密码学与安全 · 计算机科学 2026-03-13 Ching-Yu Kao , Xinfeng Li , Shenyu Dai , Tianze Qiu , Pengcheng Zhou , Eric Hanchen Jiang , Philip Sperl

As the use of large language model (LLM) agents continues to grow, their safety vulnerabilities have become increasingly evident. Extensive benchmarks evaluate various aspects of LLM safety by defining the safety relying heavily on general…

计算与语言 · 计算机科学 2025-10-24 Yeonjun In , Wonjoong Kim , Kanghoon Yoon , Sungchul Kim , Mehrab Tanjim , Sangwu Park , Kibum Kim , Chanyoung Park

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

人工智能 · 计算机科学 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

This paper presents a systematic evaluation of Large Language Models' (LLMs) behavior on long-tail distributed (encrypted) texts and their safety implications. We introduce a two-dimensional framework for assessing LLM safety: (1)…

计算与语言 · 计算机科学 2025-06-05 Utsav Maskey , Mark Dras , Usman Naseem

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

密码学与安全 · 计算机科学 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

A growing body of research assumes that large language model (LLM) agents can serve as proxies for how people form attitudes toward and behave in response to security and privacy (S&P) threats. If correct, these simulations could offer a…

计算机与社会 · 计算机科学 2026-02-25 Yuxuan Li , Leyang Li , Hao-Ping Lee , Sauvik Das

Large Language Model (LLM) agents increasingly act through external tools, making their safety contingent on tool-call workflows rather than text generation alone. While recent benchmarks evaluate agents across diverse environments and risk…

软件工程 · 计算机科学 2026-03-20 Xuan Chen , Lu Yan , Ruqi Zhang , Xiangyu Zhang

Large Language Models (LLMs) exhibit substantial promise in enhancing task-planning capabilities within embodied agents due to their advanced reasoning and comprehension. However, the systemic safety of these agents remains an underexplored…

人工智能 · 计算机科学 2025-04-22 Yuting Huang , Leilei Ding , Zhipeng Tang , Tianfu Wang , Xinrui Lin , Wuyang Zhang , Mingxiao Ma , Yanyong Zhang

The emergence of autonomous Large Language Model (LLM) agents capable of tool usage has introduced new safety risks that go beyond traditional conversational misuse. These agents, empowered to execute external functions, are vulnerable to…

人工智能 · 计算机科学 2025-07-14 Zeyang Sha , Hanling Tian , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weiqiang Wang

Large audio-language models (LALMs) extend text-based LLMs with auditory understanding, offering new opportunities for multimodal applications. While their perception, reasoning, and task performance have been widely studied, their safety…

The integration of vision-language models (VLMs) is driving a new generation of embodied agents capable of operating in human-centered environments. However, as deployment expands, these systems face growing safety risks, particularly when…

密码学与安全 · 计算机科学 2025-10-21 Zonghao Ying , Le Wang , Yisong Xiao , Jiakai Wang , Yuqing Ma , Jinyang Guo , Zhenfei Yin , Mingchuan Zhang , Aishan Liu , Xianglong Liu

With the rapid development of multimodal large language models (MLLMs), they are increasingly deployed as autonomous computer-use agents capable of accomplishing complex computer tasks. However, a pressing issue arises: Can the safety risk…

人工智能 · 计算机科学 2025-06-23 Jingyi Yang , Shuai Shao , Dongrui Liu , Jing Shao

With the continuous development of large language models (LLMs), transformer-based models have made groundbreaking advances in numerous natural language processing (NLP) tasks, leading to the emergence of a series of agents that use LLMs as…

人工智能 · 计算机科学 2024-11-15 Yuyou Gan , Yong Yang , Zhe Ma , Ping He , Rui Zeng , Yiming Wang , Qingming Li , Chunyi Zhou , Songze Li , Ting Wang , Yunjun Gao , Yingcai Wu , Shouling Ji

Large Language Model (LLM) safety is one of the most pressing challenges for enabling wide-scale deployment. While most studies and global discussions focus on generic harms, such as models assisting users in harming themselves or others,…

人工智能 · 计算机科学 2026-03-16 Jingdi Lei , Varun Gumma , Rishabh Bhardwaj , Seok Min Lim , Chuan Li , Amir Zadeh , Soujanya Poria

Can large language model agents discover hidden safety objectives through experience alone? We introduce EPO-Safe (Experiential Prompt Optimization for Safe Agents), a framework where an LLM iteratively generates action plans, receives…

人工智能 · 计算机科学 2026-04-28 Víctor Gallego

Modern LLM based agents are no longer passive text generators. They read repositories, call tools, browse the web, execute code, maintain memory, communicate with other agents, and act through long horizon workflows. This shift moves the…

多智能体系统 · 计算机科学 2026-05-12 Tianxiao Li , Yixing Ma , Haiquan Wen , Zhenglin Huang , Qianyu Zhou , Zeyu Fu , Guangliang Cheng

The success of Large Language Models (LLMs) has sparked interest in various agentic applications. A key hypothesis is that LLMs, leveraging common sense and Chain-of-Thought (CoT) reasoning, can effectively explore and efficiently solve…

机器学习 · 计算机科学 2025-04-23 Thomas Schmied , Jörg Bornschein , Jordi Grau-Moya , Markus Wulfmeier , Razvan Pascanu