English
Related papers

Related papers: HazardArena: Evaluating Semantic Safety in Vision-…

200 papers

Multimodal Large Language Models (MLLMs) are widely used in various fields due to their powerful cross-modal comprehension and generation capabilities. However, more modalities bring more vulnerabilities to being utilized for jailbreak…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shiji Zhao , Shukun Xiong , Yao Huang , Yan Jin , Zhenyu Wu , Jiyang Guan , Ranjie Duan , Jialing Tao , Hui Xue , Xingxing Wei

While safe reinforcement learning (RL) holds great promise for many practical applications like robotics or autonomous cars, current approaches require specifying constraints in mathematical form. Such specifications demand domain…

Computation and Language · Computer Science 2021-08-05 Tsung-Yen Yang , Michael Hu , Yinlam Chow , Peter J. Ramadge , Karthik Narasimhan

Vision-Language-Action (VLA) models have advanced autonomous driving, but existing benchmarks still lack scenario diversity, reliable action-level annotation, and evaluation protocols aligned with human preferences. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yuhan Hao , Zhengning Li , Lei Sun , Weilong Wang , Naixin Yi , Sheng Song , Caihong Qin , Mofan Zhou , Yifei Zhan , Xianpeng Lang

While vision-language-action models (VLAs) have shown promising robotic behaviors across a diverse set of manipulation tasks, they achieve limited success rates when deployed on novel tasks out of the box. To allow these policies to safely…

Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under…

Cryptography and Security · Computer Science 2026-05-29 Mohammadreza Teymoorianfard , Jean-Philippe Monteuuis , Jonathan Petit , Amir Houmansadr

Visual Language Action (VLA) models are a multi-modal class of Artificial Intelligence (AI) systems that integrate visual perception, natural language understanding, and action planning to enable agents to interpret their environment,…

Software Engineering · Computer Science 2025-08-04 Pablo Valle , Chengjie Lu , Shaukat Ali , Aitor Arrieta

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

Robotics · Computer Science 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Vision-Language-Action (VLA) models revolutionize robotic systems by enabling end-to-end perception-to-action pipelines that integrate multiple sensory modalities, such as visual signals processed by cameras and auditory signals captured by…

Vision-language models (VLMs) are increasingly deployed in real-world and embodied settings where safety decisions depend on visual context. However, it remains unclear which visual evidence drives these judgments. We study whether…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Carlos Hinojosa , Clemens Grange , Bernard Ghanem

LLM-based agents are becoming increasingly proficient at solving web-based tasks. With this capability comes a greater risk of misuse for malicious purposes, such as posting misinformation in an online forum or selling illicit substances on…

Advancing safe autonomous systems through reinforcement learning (RL) requires robust benchmarks to evaluate performance, analyze methods, and assess agent competencies. Humans primarily rely on embodied visual perception to safely navigate…

Artificial Intelligence · Computer Science 2025-03-12 Tristan Tomilin , Meng Fang , Mykola Pechenizkiy

Current Vision-Language-Action (VLA) models rely primarily on RGB perception, preventing them from capturing modalities such as thermal signals that are imperceptible to conventional visual sensors. Moreover, end-to-end generative policies…

Robotics · Computer Science 2026-03-09 Dian Yu , Qingchuan Zhou , Bingkun Huang , Majid Khadiv , Zewen Yang

Prior Vision-Language-Action (VLA) models are typically trained on teleoperated successful demonstrations, while discarding numerous failed attempts that occur naturally during data collection. However, these failures encode where and how…

Vision-language-action models (VLAs) have been extensively used in robotics applications, achieving great success in various manipulation problems. More recently, VLAs have been used in long-horizon tasks and evaluated on benchmarks, such…

Robotics · Computer Science 2026-04-24 Amir Rasouli , Yangzheng Wu , Zhiyuan Li , Rui Heng Yang , Xuan Zhao , Charles Eret , Sajjad Pakdamansavoji

The proliferation of memes on social media necessitates the capabilities of multimodal Large Language Models (mLLMs) to effectively understand multimodal harmfulness. Existing evaluation approaches predominantly focus on mLLMs' detection…

Computation and Language · Computer Science 2025-11-03 Zixin Chen , Hongzhan Lin , Kaixin Li , Ziyang Luo , Yayue Deng , Jing Ma

Safety hazard identification and prevention are the key elements of proactive safety management. Previous research has extensively explored the applications of computer vision to automatically identify hazards from image clips collected…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Muhammad Adil , Gaang Lee , Vicente A. Gonzalez , Qipei Mei

The integration of vision-language models (VLMs) is driving a new generation of embodied agents capable of operating in human-centered environments. However, as deployment expands, these systems face growing safety risks, particularly when…

Cryptography and Security · Computer Science 2025-10-21 Zonghao Ying , Le Wang , Yisong Xiao , Jiakai Wang , Yuqing Ma , Jinyang Guo , Zhenfei Yin , Mingchuan Zhang , Aishan Liu , Xianglong Liu

Vision-Language-Action (VLA) models and world models have recently emerged as promising paradigms for general-purpose robotic intelligence, yet their progress is hindered by the lack of reliable evaluation protocols that reflect real-world…

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain