English
Related papers

Related papers: DriveDiTFit: Fine-tuning Diffusion Transformers fo…

200 papers

Unlike discriminative approaches in autonomous driving that predict a fixed set of candidate trajectories of the ego vehicle, generative methods, such as diffusion models, learn the underlying distribution of future motion, enabling more…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Liuhan Yin , Runkun Ju , Guodong Guo , Erkang Cheng

Accurate trajectory prediction is crucial for the safe and efficient operation of autonomous vehicles. The growing popularity of deep learning has led to the development of numerous methods for trajectory prediction. While deterministic…

Machine Learning · Computer Science 2023-08-30 Kehua Chen , Xianda Chen , Zihan Yu , Meixin Zhu , Hai Yang

Layout generation is a foundation task of graphic design, which requires the integration of visual aesthetics and harmonious expression of content delivery. However, existing methods still face challenges in generating precise and visually…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yu Li , Yifan Chen , Gongye Liu , Fei Yin , Qingyan Bai , Jie Wu , Hongfa Wang , Ruihang Chu , Yujiu Yang

Most end-to-end autonomous driving methods rely on imitation learning from single expert demonstrations, often leading to conservative and homogeneous behaviors that limit generalization in complex real-world scenarios. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ziying Song , Lin Liu , Hongyu Pan , Bencheng Liao , Mingzhe Guo , Lei Yang , Yongchang Zhang , Shaoqing Xu , Caiyan Jia , Yadan Luo

Recently, the diffusion model has emerged as a powerful generative technique for robotic policy learning, capable of modeling multi-mode action distributions. Leveraging its capability for end-to-end autonomous driving is a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Bencheng Liao , Shaoyu Chen , Haoran Yin , Bo Jiang , Cheng Wang , Sixu Yan , Xinbang Zhang , Xiangyu Li , Ying Zhang , Qian Zhang , Xinggang Wang

The scale and quality of a dataset significantly impact the performance of deep models. However, acquiring large-scale annotated datasets is both a costly and time-consuming endeavor. To address this challenge, dataset expansion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Haowei Zhu , Ling Yang , Jun-Hai Yong , Hongzhi Yin , Jiawei Jiang , Meng Xiao , Wentao Zhang , Bin Wang

In autonomous driving, vision-centric 3D object detection recognizes and localizes 3D objects from RGB images. However, due to high annotation costs and diverse outdoor scenes, training data often fails to cover all possible test scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hongbin Lin , Yiming Yang , Chaoda Zheng , Yifan Zhang , Shuaicheng Niu , Zilu Guo , Yafeng Li , Gui Gui , Shuguang Cui , Zhen Li

Diffusion model deployment has been suffering from high energy consumption and inference latency despite its superior performance in visual generation tasks. Dynamic voltage and frequency scaling (DVFS) offers a promising solution to…

Hardware Architecture · Computer Science 2026-04-13 Jinqi Wen , Tong Xie , Runsheng Wang , Meng Li

Diffusion models have become leading approaches for high-fidelity image generation. Recent DiT-based diffusion models, in particular, achieve strong prompt adherence while producing high-quality samples. We propose SHIFT, a simple but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Nina Konovalova , Andrey Kuznetsov , Aibek Alanov

Latent-space modeling has been the standard for Diffusion Transformers (DiTs). However, it relies on a two-stage pipeline where the pretrained autoencoder introduces lossy reconstruction, leading to error accumulation while hindering joint…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yongsheng Yu , Wei Xiong , Weili Nie , Yichen Sheng , Shiqiu Liu , Jiebo Luo

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo

Image fusion seeks to seamlessly integrate foreground objects with background scenes, producing realistic and harmonious fused images. Unlike existing methods that directly insert objects into the background, adaptive and interactive fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junjia Huang , Pengxiang Yan , Jiyang Liu , Jie Wu , Zhao Wang , Yitong Wang , Liang Lin , Guanbin Li

Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion transformer models (DiTs). Among diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xudong Lu , Aojun Zhou , Ziyi Lin , Qi Liu , Yuhui Xu , Renrui Zhang , Xue Yang , Junchi Yan , Peng Gao , Hongsheng Li

Achieving human-like driving behaviors in complex open-world environments is a critical challenge in autonomous driving. Contemporary learning-based planning approaches such as imitation learning methods often struggle to balance competing…

Benefiting from prompt tuning, recent years have witnessed the promising performance of pre-trained vision-language models, e.g., CLIP, on versatile downstream tasks. In this paper, we focus on a particular setting of learning adaptive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Yong Liu , Salman Khan , Wangmeng Zuo

Feature Transformation (FT) crafts new features from original ones via mathematical operations to enhance dataset expressiveness for downstream models. However, existing FT methods exhibit critical limitations: discrete search struggles…

Machine Learning · Computer Science 2025-05-22 Nanxu Gong , Zijun Li , Sixun Dong , Haoyue Bai , Wangyang Ying , Xinyuan Wang , Yanjie Fu

Autonomous driving demands accurate perception and safe decision-making. To achieve this, automated vehicles are now equipped with multiple sensors (e.g., camera, Lidar, etc.), enabling them to exploit complementary environmental context by…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Xiaoming Zeng , Zhendong Wang , Yang Hu

Generating high-fidelity, temporally consistent videos in autonomous driving scenarios faces a significant challenge, e.g. problematic maneuvers in corner cases. Despite recent video generation works are proposed to tackcle the mentioned…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Junpeng Jiang , Gangyi Hong , Lijun Zhou , Enhui Ma , Hengtong Hu , Xia Zhou , Jie Xiang , Fan Liu , Kaicheng Yu , Haiyang Sun , Kun Zhan , Peng Jia , Miao Zhang

As one of the most successful generative models, diffusion models have demonstrated remarkable efficacy in synthesizing high-quality images. These models learn the underlying high-dimensional data distribution in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Min Hou , Yueying Wu , Chang Xu , Yu-Hao Huang , Chenxi Bai , Le Wu , Jiang Bian