English
Related papers

Related papers: SafeAlign-VLA: A Negative-Enhanced Safe Alignment …

200 papers

We introduce SafeWork-R1, a cutting-edge multimodal reasoning model that demonstrates the coevolution of capabilities and safety. It is developed by our proposed SafeLadder framework, which incorporates large-scale, progressive,…

Artificial Intelligence · Computer Science 2025-08-08 Shanghai AI Lab , : , Yicheng Bao , Guanxu Chen , Mingkang Chen , Yunhao Chen , Chiyu Chen , Lingjie Chen , Sirui Chen , Xinquan Chen , Jie Cheng , Yu Cheng , Dengke Deng , Yizhuo Ding , Dan Ding , Xiaoshan Ding , Yi Ding , Zhichen Dong , Lingxiao Du , Yuyu Fan , Xinshun Feng , Yanwei Fu , Yuxuan Gao , Ruijun Ge , Tianle Gu , Lujun Gui , Jiaxuan Guo , Qianxi He , Yuenan Hou , Xuhao Hu , Hong Huang , Kaichen Huang , Shiyang Huang , Yuxian Jiang , Shanzhe Lei , Jie Li , Lijun Li , Hao Li , Juncheng Li , Xiangtian Li , Yafu Li , Lingyu Li , Xueyan Li , Haotian Liang , Dongrui Liu , Qihua Liu , Zhixuan Liu , Bangwei Liu , Huacan Liu , Yuexiao Liu , Zongkai Liu , Chaochao Lu , Yudong Lu , Xiaoya Lu , Zhenghao Lu , Qitan Lv , Caoyuan Ma , Jiachen Ma , Xiaoya Ma , Zhongtian Ma , Lingyu Meng , Ziqi Miao , Yazhe Niu , Yuezhang Peng , Yuan Pu , Han Qi , Chen Qian , Xingge Qiao , Jingjing Qu , Jiashu Qu , Wanying Qu , Wenwen Qu , Xiaoye Qu , Qihan Ren , Qingnan Ren , Qingyu Ren , Jing Shao , Wenqi Shao , Shuai Shao , Dongxing Shi , Xin Song , Xinhao Song , Yan Teng , Xuan Tong , Yingchun Wang , Xuhong Wang , Shujie Wang , Xin Wang , Yige Wang , Yixu Wang , Yuanfu Wang , Futing Wang , Ruofan Wang , Wenjie Wang , Yajie Wang , Muhao Wei , Xiaoyu Wen , Fenghua Weng , Yuqi Wu , Yingtong Xiong , Xingcheng Xu , Chao Yang , Yue Yang , Yang Yao , Yulei Ye , Zhenyun Yin , Yi Yu , Bo Zhang , Qiaosheng Zhang , Jinxuan Zhang , Yexin Zhang , Yinqiang Zheng , Hefeng Zhou , Zhanhui Zhou , Pengyu Zhu , Qingzi Zhu , Yubo Zhu , Bowen Zhou

Safe reinforcement learning (SafeRL) is a prominent paradigm for autonomous driving, where agents are required to optimize performance under strict safety requirements. This dual objective creates a fundamental tension, as overly…

Machine Learning · Computer Science 2025-12-24 Mahesh Keswani , Raunak Bhattacharyya

Robotic real-world reinforcement learning (RL) with vision-language-action (VLA) models is bottlenecked by sparse, handcrafted rewards and inefficient exploration. We introduce VLAC, a general process reward model built upon InternVL and…

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Research interest in end-to-end autonomous driving has surged owing to its fully differentiable design integrating modular tasks, i.e. perception, prediction and planing, which enables optimization in pursuit of the ultimate goal. Despite…

Artificial Intelligence · Computer Science 2025-06-04 Anqing Jiang , Yu Gao , Zhigang Sun , Yiru Wang , Jijun Wang , Jinghao Chai , Qian Cao , Yuweng Heng , Hao Jiang , Yunda Dong , Zongzheng Zhang , Xianda Guo , Hao Sun , Hao Zhao

Autonomous driving is a complex and challenging task that aims at safe motion planning through scene understanding and reasoning. While vision-only autonomous driving methods have recently achieved notable performance, through enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chenbin Pan , Burhaneddin Yaman , Tommaso Nesti , Abhirup Mallik , Alessandro G Allievi , Senem Velipasalar , Liu Ren

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The execution of complex multi-step behaviors in VLA models can be improved by robust instruction grounding, a critical component…

Lane Keeping Assist systems, while increasingly prevalent, often suffer from unpredictable real-world failures, largely due to their opaque, black-box nature, which limits driver anticipation and trust. To bridge the gap between automated…

Robotics · Computer Science 2025-05-20 Yuhang Wang , Hao Zhou

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically…

Vision-Language-Action (VLA) driving augments end-to-end (E2E) planning with language-enabled backbones, yet it remains unclear what changes beyond the usual accuracy--cost trade-off. We revisit this question with 3--RQ analysis in…

Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal perception and generation, yet their safety alignment remains a critical challenge.Existing defenses and vulnerable to multimodal jailbreaks, as visual…

Artificial Intelligence · Computer Science 2025-10-21 MingSheng Li , Guangze Zhao , Sichen Liu

Large Vision-Language Models (LVLMs) have achieved impressive progress across various applications but remain vulnerable to malicious queries that exploit the visual modality. Existing alignment approaches typically fail to resist malicious…

Cryptography and Security · Computer Science 2025-11-18 Yitong Zhang , Jia Li , Liyi Cai , Ge Li

Practical autonomous driving requires models that generalize by reasoning through spatial-temporal possibilities to exclude unsafe outcomes. While state-of-the-art (SOTA) methods use parallel planning architectures, they fail to explicitly…

Robotics · Computer Science 2026-05-12 Yanhao Wu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Congpei Qiu , Liang Gao , Wei Ke , Tong Zhang

Autonomous driving systems often infer pedestrian yielding behavior from geometric and kinematic cues alone, limiting their ability to reason about visual scene context and age-dependent behavioral variability. This limitation can produce…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Qingwen Pu , Kun Xie , Yuxiang Liu

We propose LCLA (Language-Conditioned Latent Alignment), a framework for vision-language navigation that learns modular perception-action interfaces by aligning sensory observations to a latent representation of an expert policy. The expert…

Robotics · Computer Science 2026-02-11 Nitesh Subedi , Adam Haroon , Samuel Tetteh , Prajwal Koirala , Cody Fleming , Soumik Sarkar

Vision-Language-Action (VLA) models remain brittle in long-horizon, contact-rich manipulation because success-only imitation provides little supervision for execution drift, while failed rollouts are often discarded. We introduce RePO-VLA,…

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

Robotic foundation models achieve strong generalization by leveraging internet-scale vision-language representations, but their massive computational cost creates a fundamental bottleneck: high inference latency. In dynamic environments,…

Robotics · Computer Science 2026-02-17 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine

Vision-and-Language Navigation (VLN) requires agents to interpret natural language instructions and act coherently in visually rich environments. However, most existing methods rely on reactive state-action mappings without explicitly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Weiye Zhu , Zekai Zhang , Xiangchen Wang , Hewei Pan , Teng Wang , Tiantian Geng , Rongtao Xu , Feng Zheng