English
Related papers

Related papers: LAD-Drive: Bridging Language and Trajectory with A…

200 papers

Groundbreaking advancements in text-to-image generation have recently been achieved with the emergence of diffusion models. These models exhibit a remarkable ability to generate highly artistic and intricately detailed images based on…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Ziyi Dong , Yao Xiao , Pengxu Wei , Liang Lin

Service-level mobile traffic prediction for individual users is essential for network efficiency and quality of service enhancement. However, current prediction methods are limited in their adaptability across different urban environments…

Machine Learning · Computer Science 2025-07-25 Shiyuan Zhang , Tong Li , Zhu Xiao , Hongyang Du , Kaibin Huang

Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jiageng Mao , Junjie Ye , Yuxi Qian , Marco Pavone , Yue Wang

Autonomous driving requires generating safe and reliable trajectories from complex multimodal inputs. Traditional modular pipelines separate perception, prediction, and planning, while recent end-to-end (E2E) systems learn them jointly.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihang Peng , Xuesong Chen , Chenye Yang , Shaoshuai Shi , Hongsheng Li

Research interest in end-to-end autonomous driving has surged owing to its fully differentiable design integrating modular tasks, i.e. perception, prediction and planing, which enables optimization in pursuit of the ultimate goal. Despite…

Artificial Intelligence · Computer Science 2025-06-04 Anqing Jiang , Yu Gao , Zhigang Sun , Yiru Wang , Jijun Wang , Jinghao Chai , Qian Cao , Yuweng Heng , Hao Jiang , Yunda Dong , Zongzheng Zhang , Xianda Guo , Hao Sun , Hao Zhao

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn

Diffusion-based semantic communication methods have shown significant advantages in image transmission by harnessing the generative power of diffusion models. However, they still face challenges, including generation randomness that leads…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Weixuan Chen , Qianqian Yang

Large language models (LLMs) exhibit strong general intelligence, yet their multilingual performance remains highly imbalanced. Although LLMs encode substantial cross-lingual knowledge in a unified semantic space, they often struggle to…

Computation and Language · Computer Science 2026-04-17 Mengyu Bu , Yang Feng

Language models (LMs) are machine learning models designed to predict linguistic patterns by estimating the probability of word sequences based on large-scale datasets, such as text. LMs have a wide range of applications in natural language…

Accurate motion forecasting is crucial for safe autonomous driving (AD). This study proposes CoT-Drive, a novel approach that enhances motion forecasting by leveraging large language models (LLMs) and a chain-of-thought (CoT) prompting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haicheng Liao , Hanlin Kong , Bonan Wang , Chengyue Wang , Wang Ye , Zhengbing He , Chengzhong Xu , Zhenning Li

Emerging generative world models and vision-language-action (VLA) systems are rapidly reshaping automated driving by enabling scalable simulation, long-horizon forecasting, and capability-rich decision making. Across these directions,…

Robotics · Computer Science 2026-03-11 Rongxiang Zeng , Yongqi Dong

Diffusion models have achieved great success in modeling continuous data modalities such as images, audio, and video, but have seen limited use in discrete domains such as language. Recent attempts to adapt diffusion to language have…

Computation and Language · Computer Science 2023-11-08 Justin Lovelace , Varsha Kishore , Chao Wan , Eliot Shekhtman , Kilian Q. Weinberger

End-to-End (E2E) solutions have emerged as a mainstream approach for autonomous driving systems, with Vision-Language-Action (VLA) models representing a new paradigm that leverages pre-trained multimodal knowledge from Vision-Language…

Robotics · Computer Science 2025-09-25 Pengxiang Li , Yinan Zheng , Yue Wang , Huimin Wang , Hang Zhao , Jingjing Liu , Xianyuan Zhan , Kun Zhan , Xianpeng Lang

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

Machine Learning · Computer Science 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

This paper introduces TBAC-UniImage, a novel unified model for multimodal understanding and generation. We achieve this by deeply integrating a pre-trained Diffusion Model, acting as a generative ladder, with a Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Junzhe Xu , Yuyang Yin , Xi Chen

Integrating vision-language models (VLMs) into end-to-end (E2E) autonomous driving (AD) systems has shown promise in improving scene understanding. However, existing integration strategies suffer from several limitations: they either…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Wenhui Huang , Songyan Zhang , Qihang Huang , Zhidong Wang , Zhiqi Mao , Collister Chua , Zhan Chen , Long Chen , Chen Lv

While showing sophisticated reasoning abilities, large language models (LLMs) still struggle with long-horizon decision-making tasks due to deficient exploration and long-term credit assignment, especially in sparse-reward scenarios.…

Artificial Intelligence · Computer Science 2025-05-27 Zican Hu , Wei Liu , Xiaoye Qu , Xiangyu Yue , Chunlin Chen , Zhi Wang , Yu Cheng

We present a unified probabilistic model that learns a representative set of discrete vehicle actions and predicts the probability of each action given a particular scenario. Our model also enables us to estimate the distribution over…

Robotics · Computer Science 2022-12-15 Charles Richter , Patrick R. Barragán , Sertac Karaman

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Haoyu Fu , Diankun Zhang , Zongchuang Zhao , Jianfeng Cui , Hongwei Xie , Bing Wang , Guang Chen , Dingkang Liang , Xiang Bai

Large language models (LLMs) have recently demonstrated strong potential for autonomous vehicle motion planning by reformulating trajectory prediction as a language generation problem. However, deploying capable LLMs in resource-constrained…

Robotics · Computer Science 2026-04-10 Amirhossein Afsharrad , Amirhesam Abedsoltan , Ahmadreza Moradipari , Sanjay Lall