English
Related papers

Related papers: RedVLA: Physical Red Teaming for Vision-Language-A…

200 papers

Vision-language-action models (VLAs) have been extensively used in robotics applications, achieving great success in various manipulation problems. More recently, VLAs have been used in long-horizon tasks and evaluated on benchmarks, such…

Robotics · Computer Science 2026-04-24 Amir Rasouli , Yangzheng Wu , Zhiyuan Li , Rui Heng Yang , Xuan Zhao , Charles Eret , Sajjad Pakdamansavoji

Language Models (LMs) often cannot be deployed because of their potential to harm users in hard-to-predict ways. Prior work identifies harmful behaviors before deployment by using human annotators to hand-write test cases. However, human…

Computation and Language · Computer Science 2022-02-08 Ethan Perez , Saffron Huang , Francis Song , Trevor Cai , Roman Ring , John Aslanides , Amelia Glaese , Nat McAleese , Geoffrey Irving

Trustworthy robot behavior requires not only high levels of task success but also that the robot can reliably quantify how likely it is to succeed. To this end, we present a first-of-its-kind study of confidence calibration in…

Robotics · Computer Science 2025-12-23 Thomas P Zollo , Richard Zemel

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action prediction. However, robotic manipulation is composed of many frequent closed-loop…

Artificial Intelligence · Computer Science 2026-05-12 Boyang Shen , Kaixiang Yang , Hao Wang , Qiuyu Yu , Qiang Xie , Qiang Li , Zhiwei Wang

Leveraging temporal context is crucial for success in partially observable robotic tasks. However, prior work in behavior cloning has demonstrated inconsistent performance gains when using multi-frame observations. In this paper, we…

Robotics · Computer Science 2025-10-07 Huiwon Jang , Sihyun Yu , Heeseung Kwon , Hojin Jeon , Younggyo Seo , Jinwoo Shin

The evaluation of Vision-Language-Action (VLA) agents is hindered by the coarse, end-task success metric that fails to provide precise skill diagnosis or measure robustness to real-world perturbations. This challenge is exacerbated by a…

Robotics · Computer Science 2025-10-22 Jierui Peng , Yanyan Zhang , Yicheng Duan , Tuo Liang , Vipin Chaudhary , Yu Yin

Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse…

Robotics · Computer Science 2026-03-20 Zilin Huang , Zihao Sheng , Zhengyang Wan , Yansong Qu , Junwei You , Sicong Jiang , Sikai Chen

Exploring open-world situations in an end-to-end manner is a promising yet challenging task due to the need for strong generalization capabilities. In particular, end-to-end autonomous driving in unstructured outdoor environments often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hyunki Seong , Seongwoo Moon , Hojin Ahn , Jehun Kang , David Hyunchul Shim

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov…

Machine Learning · Computer Science 2026-04-13 Lei Xiao , Jifeng Li , Juntao Gao , Feiyang Ye , Yan Jin , Jingjing Qian , Jing Zhang , Yong Wu , Xiaoyuan Yu

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Ensuring the safe deployment of AI systems is critical in industry settings where biased outputs can lead to significant operational, reputational, and regulatory risks. Thorough evaluation before deployment is essential to prevent these…

Computation and Language · Computer Science 2025-05-23 Chu Fei Luo , Ahmad Ghawanmeh , Bharat Bhimshetty , Kashyap Murali , Murli Jadhav , Xiaodan Zhu , Faiza Khan Khattak

We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction. Unlike conventional approaches that rely on gloss annotations as intermediate…

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

Robotics · Computer Science 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Autonomous driving policy learning with reinforcement learning (RL) is fundamentally limited by low sample efficiency, weak generalization, and a dependence on unsafe online trial-and-error interactions. Although safe RL introduces explicit…

Robotics · Computer Science 2026-03-31 Yansong Qu , Zilin Huang , Zihao Sheng , Jiancong Chen , Yue Leng , Samuel Labi , Sikai Chen

Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning…

Robotics · Computer Science 2026-05-29 Wenhao Li , Xiu Su , Dan Niu , Yichao Cao , Hongyan Xu , Zhe Qu , Lei Fan , Shan You , Chang Xu

In recent years, Vision-Language-Action (VLA) models have become a vital research direction in robotics due to their impressive multimodal understanding and generalization capabilities. Despite the progress, their practical deployment is…

Robotics · Computer Science 2025-06-17 Wenxuan Song , Jiayi Chen , Pengxiang Ding , Yuxin Huang , Han Zhao , Donglin Wang , Haoang Li

Vision-language models (VLMs) pretrained on large-scale multimodal datasets encode rich visual and linguistic knowledge, making them a strong foundation for robotics. Rather than training robotic policies from scratch, recent approaches…

Ensuring safety remains a key challenge for autonomous vehicles (AVs), especially in rare and complex scenarios. One critical but understudied aspect is the \textbf{potential risk} situations, where the risk is \textbf{not yet observable}…

Automated red-teaming has emerged as a scalable approach for auditing Large Language Models (LLMs) prior to deployment, yet existing approaches lack mechanisms to efficiently adapt to model-specific vulnerabilities at inference. We…

Computation and Language · Computer Science 2026-05-19 Christos Ziakas , Nicholas Loo , Nishita Jain , Alessandra Russo