English
Related papers

Related papers: Predictive Red Teaming: Breaking Policies Without …

200 papers

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is…

Robotics · Computer Science 2026-03-06 Chanmi Lee , Minsung Yoon , Woojae Kim , Sebin Lee , Sung-eui Yoon

Visuomotor policies trained via behavior cloning are vulnerable to covariate shift, where small deviations from expert trajectories can compound into failure. Common strategies to mitigate this issue involve expanding the training…

Robotics · Computer Science 2025-08-11 Zhanyi Sun , Shuran Song

Ensuring the safety of large language models (LLMs) is paramount, yet identifying potential vulnerabilities is challenging. While manual red teaming is effective, it is time-consuming, costly and lacks scalability. Automated red teaming…

Cryptography and Security · Computer Science 2024-12-24 Bojian Jiang , Yi Jing , Tianhao Shen , Tong Wu , Qing Yang , Deyi Xiong

End-to-end visuomotor control is emerging as a compelling solution for robot manipulation tasks. However, imitation learning-based visuomotor control approaches tend to suffer from a common limitation, lacking the ability to recover from an…

Robotics · Computer Science 2021-03-23 Chia-Man Hung , Li Sun , Yizhe Wu , Ioannis Havoutis , Ingmar Posner

In this paper, we propose the use of generative artificial intelligence (AI) to improve zero-shot performance of a pre-trained policy by altering observations during inference. Modern robotic systems, powered by advanced neural networks,…

Robotics · Computer Science 2023-11-30 Yusuke Miyashita , Dimitris Gahtidis , Colin La , Jeremy Rabinowicz , Jurgen Leitner

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

Robotics · Computer Science 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

Learned robot policies have consistently been shown to be versatile, but they typically have no built-in mechanism for handling the complexity of open environments, making them prone to execution failures; this implies that deploying…

Robotics · Computer Science 2025-11-18 Bharath Santhanam , Alex Mitrevski , Santosh Thoduka , Sebastian Houben , Teena Hassan

Visuomotor policies often suffer from perceptual challenges, where visual differences between training and evaluation environments degrade policy performance. Policies relying on state estimations, like 6D pose, require task-specific…

Robotics · Computer Science 2025-10-07 Yunchu Zhang , Shubham Mittal , Zhengyu Zhang , Liyiming Ke , Siddhartha Srinivasa , Abhishek Gupta

Large-scale pre-trained generative models are taking the world by storm, due to their abilities in generating creative content. Meanwhile, safeguards for these generative models are developed, to protect users' rights and safety, most of…

Cryptography and Security · Computer Science 2024-10-14 Guanlin Li , Kangjie Chen , Shudong Zhang , Jie Zhang , Tianwei Zhang

Visuomotor policies trained on human expert demonstrations have recently shown strong performance across a wide range of robotic manipulation tasks. However, these policies remain highly sensitive to domain shifts stemming from background…

Robotics · Computer Science 2026-01-07 Reihaneh Mirjalili , Tobias Jülg , Florian Walter , Wolfram Burgard

Standard evaluation protocols in robotic manipulation typically assess policy performance over curated, in-distribution test sets, offering limited insight into how systems fail under plausible variation. We introduce Geometric Red-Teaming…

Robotics · Computer Science 2025-09-17 Divyam Goel , Yufei Wang , Tiancheng Wu , Guixiu Qiao , Pavel Piliptchak , David Held , Zackory Erickson

Research on robotic manipulation has developed a diverse set of policy paradigms, including vision-language-action (VLA) models, vision-action (VA) policies, and code-based compositional approaches. Concrete policies typically attain high…

Goal-conditioned policies, such as those learned via imitation learning, provide an easy way for humans to influence what tasks robots accomplish. However, these robot policies are not guaranteed to execute safely or to succeed when faced…

Robotics · Computer Science 2025-03-05 Hyun Joe Jeong , Rosy Chen , Andrea Bajcsy

Language-conditioned robot models have the potential to enable robots to perform a wide range of tasks based on natural language instructions. However, assessing their safety and effectiveness remains challenging because it is difficult to…

Various approaches have been proposed to learn visuo-motor policies for real-world robotic applications. One solution is first learning in simulation then transferring to the real world. In the transfer, most existing approaches need…

Robotics · Computer Science 2018-06-01 Fangyi Zhang , Jürgen Leitner , Zongyuan Ge , Michael Milford , Peter Corke

A general-purpose intelligent robot must be able to learn autonomously and be able to accomplish multiple tasks in order to be deployed in the real world. However, standard reinforcement learning approaches learn separate task-specific…

Robotics · Computer Science 2018-10-17 Gregory Kahn , Adam Villaflor , Pieter Abbeel , Sergey Levine

The Visibility-based Persistent Monitoring (VPM) problem seeks to find a set of trajectories (or controllers) for robots to persistently monitor a changing environment. Each robot has a sensor, such as a camera, with a limited field-of-view…

Robotics · Computer Science 2021-10-08 Jingxi Chen , Amrish Baskaran , Zhongshun Zhang , Pratap Tokekar

Recent work has proposed automated red-teaming methods for testing the vulnerabilities of a given target large language model (LLM). These methods use red-teaming LLMs to uncover inputs that induce harmful behavior in a target LLM. In this…

Machine Learning · Computer Science 2025-01-15 Jonathan Nöther , Adish Singla , Goran Radanović

The diversity, quantity, and quality of manipulation data are critical for training effective robot policies. However, due to hardware and physical setup constraints, collecting large-scale real-world manipulation data remains difficult to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Boyang Wang , Haoran Zhang , Shujie Zhang , Jinkun Hao , Mingda Jia , Qi Lv , Yucheng Mao , Zhaoyang Lyu , Jia Zeng , Xudong Xu , Jiangmiao Pang
‹ Prev 1 2 3 10 Next ›