English
Related papers

Related papers: WAM-Diff: A Masked Diffusion VLA Framework with Mo…

200 papers

We present TimeAutoDiff, a unified latent-diffusion framework for four fundamental time-series tasks: unconditional generation, missing-data imputation, forecasting, and time-varying-metadata conditional generation. The model natively…

Machine Learning · Computer Science 2025-12-09 Namjoon Suh , Yuning Yang , Din-Yin Hsieh , Qitong Luan , Shirong Xu , Shixiang Zhu , Guang Cheng

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, while generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xingyu Chen

We present a masked diffusion language modeling framework for data-efficient training for the BabyLM 2025 Challenge. Our approach applies diffusion training objectives to language modeling under strict data constraints, incorporating…

Computation and Language · Computer Science 2025-09-08 Despoina Kosmopoulou , Efthymios Georgiou , Vaggelis Dorovatas , Georgios Paraskevopoulos , Alexandros Potamianos

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize both a differentiable…

Machine Learning · Computer Science 2024-07-18 Brian Yang , Huangyuan Su , Nikolaos Gkanatsios , Tsung-Wei Ke , Ayush Jain , Jeff Schneider , Katerina Fragkiadaki

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

Robotics · Computer Science 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

End-to-end autonomous driving has evolved from the conventional paradigm based on sparse perception into vision-language-action (VLA) models, which focus on learning language descriptions as an auxiliary task to facilitate planning. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Hanbing Li , Long Chen , Zhi-Xin Yang , Jiwen Lu

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Steering language model generation toward desired textual properties is essential for practical deployment, and inference-time methods are particularly appealing because they enable controllable generation without retraining. Recent work…

Computation and Language · Computer Science 2026-05-29 Hyeseon An , Yo-Sub Han

We present OpenDriveVLA, a Vision Language Action model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially grounded driving actions by leveraging multimodal inputs,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Xingcheng Zhou , Xuyuan Han , Feng Yang , Yunpu Ma , Volker Tresp , Alois Knoll

Recent advances in offline Reinforcement Learning (RL) have proven that effective policy learning can benefit from imposing conservative constraints on pre-collected datasets. However, such static datasets often exhibit distribution bias,…

Machine Learning · Computer Science 2026-05-15 Yunpeng Qing , Yixiao Chi , Shuo Chen , Shunyu Liu , Kexuan Zhou , Sixu Lin , Litao Liu , Changqing Zou

While diffusion Multimodal Large Language Models (dMLLMs) have recently achieved remarkable strides in multimodal generation, the development of interpretability mechanisms has lagged behind their architectural evolution. Unlike traditional…

Artificial Intelligence · Computer Science 2026-04-14 Haomin Zuo , Yidi Li , Luoxiao Yang , Xiaofeng Zhang

Vision-Language-Action (VLA) models have demonstrated potential in autonomous driving. However, two critical challenges hinder their development: (1) Existing VLA architectures are typically based on imitation learning in open-loop setup…

Artificial Intelligence · Computer Science 2025-08-18 Anqing Jiang , Yu Gao , Yiru Wang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun , Shichen Tang , Lijuan Zhu , Jinhao Chai , Jijun Wang , Zichong Gu , Hao Jiang , Li Sun

This paper introduces a discrete diffusion model (DDM) framework for text-aligned speech tokenization and reconstruction. By replacing the auto-regressive speech decoder with a discrete diffusion counterpart, our model achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Pin-Jui Ku , He Huang , Jean-Marie Lemercier , Subham Sekhar Sahoo , Zhehuai Chen , Ante Jukić

Autoregressive (AR) transformers have emerged as a powerful paradigm for visual generation, largely due to their scalability, computational efficiency and unified architecture with language and vision. Among them, next scale prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Amandeep Kumar , Nithin Gopalakrishnan Nair , Vishal M. Patel

In this work, we reconceptualize autonomous driving as a generalized language problem and formulate the trajectory planning task as next waypoint prediction. We introduce Max-V1, a novel framework for one-stage end-to-end autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Sheng Yang , Tong Zhan , Guancheng Chen , Yanfeng Lu , Jian Wang

Image and language modeling is of crucial importance for vision-language pre-training (VLP), which aims to learn multi-modal representations from large-scale paired image-text data. However, we observe that most existing VLP methods focus…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Chen Wu , Xiujun Shu , Bo Ren

Scaling Vision-Language-Action (VLA) models on large-scale data offers a promising path to achieving a more generalized driving intelligence. However, VLA models are limited by a ``supervision deficit'': the vast model capacity is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yingyan Li , Shuyao Shang , Weisong Liu , Bing Zhan , Haochen Wang , Yuqi Wang , Yuntao Chen , Xiaoman Wang , Yasong An , Chufeng Tang , Lu Hou , Lue Fan , Zhaoxiang Zhang

Diffusion-based large language models (DLLMs) have recently attracted growing interest as an alternative to autoregressive decoders. In this work, we present an empirical study on using the diffusion-based large language model LLaDA for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-02 Mengqi Wang , Zhan Liu , Zengrui Jin , Guangzhi Sun , Chao Zhang , Philip C. Woodland

Motion planning in dynamic urban environments requires balancing immediate safety with long-term goals. While diffusion models effectively capture multi-modal decision-making, existing approaches treat trajectories as monolithic entities,…

Robotics · Computer Science 2026-03-27 Xiang Li , Bikun Wang , John Zhang , Jianjun Wang

Diffusion-based large language models (dLLMs) have exhibited substantial potential for parallel text generation, which may enable more efficient generation compared to autoregressive models. However, current dLLMs suffer from fixed…

Computation and Language · Computer Science 2025-10-29 Yicun Yang , Cong Wang , Shaobo Wang , Zichen Wen , Biqing Qi , Hanlin Xu , Linfeng Zhang