English
Related papers

Related papers: WAM-Diff: A Masked Diffusion VLA Framework with Mo…

200 papers

Block-wise discrete diffusion offers an attractive balance between parallel generation and causal dependency modeling, making it a promising backbone for vision-language modeling. However, its practical adoption has been limited by high…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Shuang Cheng , Yuhua Jiang , Zineng Zhou , Dawei Liu , Wang Tao , Linfeng Zhang , Biqing Qi , Bowen Zhou

Vision Language Models (VLMs) bridge visual perception and linguistic reasoning. In Autonomous Driving (AD), this synergy has enabled Vision Language Action (VLA) models, which translate high-level multimodal understanding into driving…

Efficient trajectory planning in off-road terrains presents a formidable challenge for autonomous vehicles, often necessitating complex multi-step pipelines. However, traditional approaches exhibit limited adaptability in dynamic…

Robotics · Computer Science 2026-01-13 Liangdong Zhang , Yiming Nie , Haoyang Li , Fanjie Kong , Baobao Zhang , Shunxin Huang , Kai Fu , Chen Min , Liang Xiao

In autonomous driving, dynamic environment and corner cases pose significant challenges to the robustness of ego vehicle's decision-making. To address these challenges, commencing with the representation of state-action mapping in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ziang Guo , Konstantin Gubernatorov , Selamawit Asfaw , Zakhar Yagudin , Dzmitry Tsetserukou

Learning universal policies from cross-embodied data remains a fundamental challenge in robotics. Although Vision-Language-Action (VLA) models are pre-trained on large and diverse datasets, they typically rely on embodiment-specific…

Robotics · Computer Science 2026-05-26 Boyu Li , Chaoyi Xu , Haoqi Yuan , Xinrun Xu , Börje F. Karlsson , Dongbin Zhao , Haoran Li , Zongqing Lu

Vision-Language-Action (VLA) models have achieved remarkable progress in robotic manipulation by mapping multimodal observations and instructions directly to actions. However, they typically mimic expert trajectories without predictive…

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

In recent years, diffusion models have demonstrated remarkable potential across diverse domains, from vision generation to language modeling. Transferring its generative capabilities to modern end-to-end autonomous driving systems has also…

Robotics · Computer Science 2025-09-17 Xuefeng Jiang , Yuan Ma , Pengxiang Li , Leimeng Xu , Xin Wen , Kun Zhan , Zhongpu Xia , Peng Jia , Xianpeng Lang , Sheng Sun

Autonomous driving heavily relies on accurate and robust spatial perception. Many failures arise from inaccuracies and instability, especially in long-tail scenarios and complex interactions. However, current vision-language models are weak…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jianhua Han , Meng Tian , Jiangtong Zhu , Fan He , Huixin Zhang , Sitong Guo , Dechang Zhu , Hao Tang , Pei Xu , Yuze Guo , Minzhe Niu , Haojie Zhu , Qichao Dong , Xuechao Yan , Siyuan Dong , Lu Hou , Qingqiu Huang , Xiaosong Jia , Hang Xu

We present LLaDA2.0-Uni, a unified discrete diffusion large language model (dLLM) that supports multimodal understanding and generation within a natively integrated framework. Its architecture combines a fully semantic discrete tokenizer, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Inclusion AI , Tiwei Bie , Haoxing Chen , Tieyuan Chen , Zhenglin Cheng , Long Cui , Kai Gan , Zhicheng Huang , Zhenzhong Lan , Haoquan Li , Jianguo Li , Tao Lin , Qi Qin , Hongjun Wang , Xiaomei Wang , Haoyuan Wu , Yi Xin , Junbo Zhao

This paper proposes a novel inverse reinforcement learning framework using a diffusion-based adaptive lookahead planner (IRL-DAL) for autonomous vehicles. Training begins with imitation from an expert finite state machine (FSM) controller…

Robotics · Computer Science 2026-02-02 Seyed Ahmad Hosseini Miangoleh , Amin Jalal Aghdasian , Farzaneh Abdollahi

Decision-making stands as a pivotal component in the realm of autonomous vehicles (AVs), playing a crucial role in navigating the intricacies of autonomous driving. Amidst the evolving landscape of data-driven methodologies, enhancing…

Robotics · Computer Science 2024-04-08 Jiaqi Liu , Peng Hang , Xiaocong Zhao , Jianqiang Wang , Jian Sun

In this work, we provide a systematic survey of Discrete Diffusion Language Models (dLLMs) and Discrete Diffusion Multimodal Language Models (dMLLMs). Unlike autoregressive (AR) models, dLLMs and dMLLMs adopt a multi-token, parallel…

Machine Learning · Computer Science 2025-09-22 Runpeng Yu , Qi Li , Xinchao Wang

Diffusion models have demonstrated exceptional visual quality in video generation, making them promising for autonomous driving world modeling. However, existing video diffusion-based world models struggle with flexible-length, long-horizon…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Kaiwen Zhang , Zhenyu Tang , Xiaotao Hu , Xingang Pan , Xiaoyang Guo , Yuan Liu , Jingwei Huang , Li Yuan , Qian Zhang , Xiao-Xiao Long , Xun Cao , Wei Yin

Autoregressive (AR) large audio language models (LALMs) such as Qwen-2.5-Omni have achieved strong performance on audio understanding and interaction, but scaling them remains costly in data and computation, and strictly sequential decoding…

Sound · Computer Science 2026-02-02 Jiaming Zhou , Xuxin Cheng , Shiwan Zhao , Yuhang Jia , Cao Liu , Ke Zeng , Xunliang Cai , Yong Qin

Vision-language-action models have reshaped autonomous driving to incorporate languages into the decision-making process. However, most existing pipelines only utilize the language modality for scene descriptions or reasoning and lack the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sicheng Zuo , Yuxuan Li , Wenzhao Zheng , Zheng Zhu , Jie Zhou , Jiwen Lu

Diffusion-based decoding has recently emerged as an appealing alternative to autoregressive (AR) generation, offering the potential to update multiple tokens in parallel and reduce latency. However, diffusion vision language models (dVLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Lunbin Zeng , Jingfeng Yao , Bencheng Liao , Hongyuan Tao , Wenyu Liu , Xinggang Wang

While multimodal large language models (MLLMs) provide advanced reasoning for autonomous driving, translating their discrete semantic knowledge into continuous trajectories remains a fundamental challenge. Existing methods often rely on…

Robotics · Computer Science 2026-03-03 Fabian Schmidt , Karol Fedurko , Markus Enzweiler , Abhinav Valada

Vision-language-action (VLA) models aim to understand natural language instructions and visual observations and to execute corresponding actions as an embodied agent. Recent work integrates future images into the understanding-acting loop,…

Robotics · Computer Science 2026-03-26 Jiayi Chen , Wenxuan Song , Pengxiang Ding , Ziyang Zhou , Han Zhao , Feilong Tang , Donglin Wang , Haoang Li

Vision-language-action (VLA) models have shown strong generalization across tasks and embodiments; however, their reliance on large-scale human demonstrations limits their scalability owing to the cost and effort of manual data collection.…

Robotics · Computer Science 2025-09-30 Rushuai Yang , Hangxing Wei , Ran Zhang , Zhiyuan Feng , Xiaoyu Chen , Tong Li , Chuheng Zhang , Li Zhao , Jiang Bian , Xiu Su , Yi Chen