English
Related papers

Related papers: RoboSafe: Safeguarding Embodied Agents via Executa…

200 papers

Code agents have gained widespread adoption due to their strong code generation capabilities and integration with code interpreters, enabling dynamic execution, debugging, and interactive programming capabilities. While these advancements…

Software Engineering · Computer Science 2025-11-12 Chengquan Guo , Chulin Xie , Yu Yang , Zhaorun Chen , Zinan Lin , Xander Davies , Yarin Gal , Dawn Song , Bo Li

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversarial training, while…

Artificial Intelligence · Computer Science 2025-12-23 A. A. Gde Yogi Pramana , Jason Ray , Anthony Jaya , Michael Wijaya

Safety reasoning is a recent paradigm where LLMs reason over safety policies before generating responses, thereby mitigating limitations in existing safety measures such as over-refusal and jailbreak vulnerabilities. However, implementing…

The dawn of embodied intelligence has ushered in an unprecedented imperative for resilient, cognition-enabled multi-agent collaboration across next-generation ecosystems, revolutionizing paradigms in autonomous manufacturing, adaptive…

As large language model (LLM)-powered agents are increasingly deployed to perform complex, real-world tasks, they face a growing class of attacks that exploit extended user-agent-environment interactions to pursue malicious objectives…

Cryptography and Security · Computer Science 2026-05-06 Yuhui Wang , Tanqiu Jiang , Jiacheng Liang , Charles Fleming , Ting Wang

With the widespread deployment of Computer-using Agents (CUAs) in complex real-world environments, prevalent long-term risks often lead to severe and irreversible consequences. Most existing guardrails for CUAs adopt a reactive approach,…

Computation and Language · Computer Science 2026-02-03 Yurun Chen , Zeyi Liao , Ping Yin , Taotao Xie , Keting Yin , Shengyu Zhang

LLM-based multi-agent systems excel at planning, tool use, and role coordination, but their openness and interaction complexity also expose them to jailbreak, prompt-injection, and adversarial collaboration. Existing defenses fall into two…

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

Machine Learning · Computer Science 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

Recent advances in large language models (LLMs) have catalyzed the rise of autonomous AI agents capable of perceiving, reasoning, and acting in dynamic, open-ended environments. These large-model agents mark a paradigm shift from static…

Artificial Intelligence · Computer Science 2025-07-01 Hang Su , Jun Luo , Chang Liu , Xiao Yang , Yichi Zhang , Yinpeng Dong , Jun Zhu

Vision-Language Models (VLMs), with their strong reasoning and planning capabilities, are widely used in embodied decision-making (EDM) tasks in embodied agents, such as autonomous driving and robotic manipulation. Recent research has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yichen Wang , Hangtao Zhang , Hewen Pan , Ziqi Zhou , Xianlong Wang , Peijin Guo , Lulu Xue , Shengshan Hu , Minghui Li , Leo Yu Zhang

Achieving robust safety alignment in large language models (LLMs) while preserving their utility remains a fundamental challenge. Existing approaches often struggle to balance comprehensive safety with fine-grained controllability at the…

Artificial Intelligence · Computer Science 2025-09-25 Huizhen Shu , Xuying Li , Zhuo Li

We propose a new Verbal Reinforcement Learning (VRL) framework for interpretable task-level planning in mobile robotic systems operating under execution uncertainty. The framework follows a closed-loop architecture that enables iterative…

While Deep Reinforcement Learning (DRL) has achieved remarkable success across various domains, it remains vulnerable to occasional catastrophic failures without additional safeguards. An effective solution to prevent these failures is to…

Machine Learning · Computer Science 2024-12-03 Kyungmin Kim , Davide Corsi , Andoni Rodriguez , JB Lanier , Benjami Parellada , Pierre Baldi , Cesar Sanchez , Roy Fox

Recent reasoning-based safety guardrails for Large Reasoning Models (LRMs), such as deliberative alignment, have shown strong defense against jailbreak attacks. By leveraging LRMs' reasoning ability, these guardrails help the models to…

Cryptography and Security · Computer Science 2025-10-24 Shuo Chen , Zhen Han , Haokun Chen , Bailan He , Shengyun Si , Jingpei Wu , Philip Torr , Volker Tresp , Jindong Gu

Operating robots in open-ended scenarios with diverse tasks is a crucial research and application direction in robotics. While recent progress in natural language processing and large multimodal models has enhanced robots' ability to…

Robotics · Computer Science 2025-07-24 Kaidong Zhang , Rongtao Xu , Pengzhen Ren , Junfan Lin , Hefeng Wu , Liang Lin , Xiaodan Liang

A key limitation of learned robot control policies is their inability to generalize outside their training data. Recent works on vision-language-action models (VLAs) have shown that the use of large, internet pre-trained vision-language…

Robotics · Computer Science 2025-03-10 Michał Zawalski , William Chen , Karl Pertsch , Oier Mees , Chelsea Finn , Sergey Levine

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to…

Artificial Intelligence · Computer Science 2025-09-17 Wei Cai , Shujuan Liu , Jian Zhao , Ziyan Shi , Yusheng Zhao , Yuchen Yuan , Tianle Zhang , Chi Zhang , Xuelong Li

Recent advances in Large Vision-Language Models (LVLMs) have showcased strong reasoning abilities across multiple modalities, achieving significant breakthroughs in various real-world applications. Despite this great success, the safety…

Computation and Language · Computer Science 2024-12-02 Chenhang Cui , Gelei Deng , An Zhang , Jingnan Zheng , Yicong Li , Lianli Gao , Tianwei Zhang , Tat-Seng Chua

Assuring the safety and trustworthiness of autonomous systems is particularly difficult when learning-enabled components and open environments are involved. Formal methods provide strong guarantees but depend on complete models and static…

Software Engineering · Computer Science 2025-11-19 Angelo Ferrando

Embodied Chain-of-Thought (ECoT) reasoning enhances vision-language-action (VLA) models by improving performance and interpretability through intermediate reasoning steps. However, its sequential autoregressive token generation introduces…

Robotics · Computer Science 2025-09-23 Zhekai Duan , Yuan Zhang , Shikai Geng , Gaowen Liu , Joschka Boedecker , Chris Xiaoxuan Lu