中文
相关论文

相关论文: Advancing Embodied Agent Security: From Safety Ben…

200 篇论文

Large Language Models (LLMs) are increasingly vulnerable to a sophisticated form of adversarial prompting known as camouflaged jailbreaking. This method embeds malicious intent within seemingly benign language to evade existing safety…

密码学与安全 · 计算机科学 2025-09-09 Youjia Zheng , Mohammad Zandsalimy , Shanu Sushmita

Large language model (LLM)-powered multi-agent systems (MAS) enable agents to communicate and share information, achieving strong performance on complex tasks. However, this communication also creates an attack surface where malicious…

密码学与安全 · 计算机科学 2026-05-05 Lingxi Zhang , Guangtao Zheng , Hanjie Chen

Autonomous robots operating in dynamic environments should identify and report anomalies. Embodying proactive mitigation improves safety and operational continuity. This paper presents a multimodal anomaly detection and mitigation system…

机器人学 · 计算机科学 2025-09-09 Oluwadamilola Sotomi , Devika Kodi , Kiruthiga Chandra Shekar , Aliasghar Arab

Human safety awareness gaps often prevent the timely recognition of everyday risks. In solving this problem, a proactive safety artificial intelligence (AI) system would work better than a reactive one. Instead of just reacting to users'…

计算与语言 · 计算机科学 2025-10-21 Youliang Yuan , Wenxiang Jiao , Yuejin Xie , Chihao Shen , Menghan Tian , Wenxuan Wang , Jen-tse Huang , Pinjia He

Multimodal Large Language Models (MLLMs) have shown significant advancements, providing a promising future for embodied agents. Existing benchmarks for evaluating MLLMs primarily utilize static images or videos, limiting assessments to…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Zhili Cheng , Yuge Tu , Ran Li , Shiqi Dai , Jinyi Hu , Shengding Hu , Jiahao Li , Yang Shi , Tianyu Yu , Weize Chen , Lei Shi , Maosong Sun

Cybersecurity spans multiple interconnected domains, complicating the development of meaningful, labor-relevant benchmarks. Existing benchmarks assess isolated skills rather than integrated performance. We find that pre-trained knowledge of…

The rapid evolution of artificial intelligence (AI) has shifted from static, data-driven models to dynamic systems capable of perceiving and interacting with real-world environments. Despite advancements in pattern recognition and symbolic…

The critical challenge of prompt injection attacks in Large Language Models (LLMs) integrated applications, a growing concern in the Artificial Intelligence (AI) field. Such attacks, which manipulate LLMs through natural language inputs,…

密码学与安全 · 计算机科学 2024-01-17 Xuchen Suo

AI agents, predominantly powered by large language models (LLMs), are vulnerable to indirect prompt injection, in which malicious instructions embedded in untrusted data can trigger dangerous agent actions. This position paper discusses our…

密码学与安全 · 计算机科学 2026-04-01 Chong Xiang , Drew Zagieboylo , Shaona Ghosh , Sanjay Kariyappa , Kai Greshake , Hanshen Xiao , Chaowei Xiao , G. Edward Suh

While large vision-language models (VLMs) are increasingly adopted as the perceptual backbone for embodied agents, existing benchmarks often rely on question-answering or multiple-choice formats. These protocols allow models to exploit…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Haozhe Shan , Xiancong Ren , Han Dong , Haoyuan Shi , Yingji Zhang , Jiayu Hu , Yi Zhang , Yong Dai , Bin Shen , Lizhen Qu , Zenglin Xu , Xiaozhu Ju

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

机器人学 · 计算机科学 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

The domain of Embodied AI, in which agents learn to complete tasks through interaction with their environment from egocentric observations, has experienced substantial growth with the advent of deep reinforcement learning and increased…

计算机视觉与模式识别 · 计算机科学 2020-08-31 Luca Weihs , Jordi Salvador , Klemen Kotar , Unnat Jain , Kuo-Hao Zeng , Roozbeh Mottaghi , Aniruddha Kembhavi

The exponential growth of digital content presents significant challenges for content safety. Current moderation systems, often based on single models or fixed pipelines, exhibit limitations in identifying implicit risks and providing…

人工智能 · 计算机科学 2025-12-10 Yuxiang He , Jian Zhao , Yuchen Yuan , Tianle Zhang , Wei Cai , Haojie Cheng , Ziyan Shi , Ming Zhu , Haichuan Tang , Chi Zhang , Xuelong Li

The adoption of Vision-Language Models (VLMs) in embodied AI agents, while being effective, brings safety concerns such as jailbreaking. Prior work have explored the possibility of directly jailbreaking the embodied agents through…

密码学与安全 · 计算机科学 2025-11-21 Chunyang Li , Zifeng Kang , Junwei Zhang , Zhuo Ma , Anda Cheng , Xinghua Li , Jianfeng Ma

Large Language Models (LLMs) are typically aligned for safety during the post-training phase; however, they may still generate inappropriate outputs that could potentially pose risks to users. This challenge underscores the need for robust…

机器学习 · 计算机科学 2025-12-08 Mahesh Kumar Nandwana , Youngwan Lim , Joseph Liu , Alex Yang , Varun Notibala , Nishchaie Khanna

Embodied AI research has traditionally emphasized performance metrics such as success rate and cumulative reward, overlooking critical robustness and safety considerations that emerge during real-world deployment. In actual environments,…

机器人学 · 计算机科学 2025-05-13 Zhongquan Zhou , Shuhao Li , Zixian Yue

The emergence of autonomous Large Language Model (LLM) agents capable of tool usage has introduced new safety risks that go beyond traditional conversational misuse. These agents, empowered to execute external functions, are vulnerable to…

人工智能 · 计算机科学 2025-07-14 Zeyang Sha , Hanling Tian , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weiqiang Wang

Embodied artificial intelligence is rapidly moving from research into real-world systems such as autonomous vehicles, mobile robots, and industrial machines. As these systems become more capable of perceiving, deciding, and acting in…

机器人学 · 计算机科学 2026-05-12 Jan-Mou Li , Paul Schmitt , Wei Tong , Majed Mohammed , Akshay Chalana , Arpan Kusari , Edward Griffor

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Addressing the critical shortage of mental health resources for effective screening, diagnosis, and treatment remains a significant challenge. This scarcity underscores the need for innovative solutions, particularly in enhancing the…

计算与语言 · 计算机科学 2024-02-15 Maneesh Bilalpur , Mert Inan , Dorsa Zeinali , Jeffrey F. Cohn , Malihe Alikhani