English
Related papers

Related papers: Accelerating Parallel Diffusion Model Serving with…

200 papers

The application of diffusion transformers is suffering from their significant inference costs. Recently, feature caching has been proposed to solve this problem by reusing features from previous timesteps, thereby skipping computation in…

Incorporating diffusion models in the image compression domain has the potential to produce realistic and detailed reconstructions, especially at extremely low bitrates. Previous methods focus on using diffusion models as expressive…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Lucas Relic , Roberto Azevedo , Markus Gross , Christopher Schroers

Diffusion-based image generators can now produce high-quality and diverse samples, but their success has yet to fully translate to 3D generation: existing diffusion methods can either generate low-resolution but 3D consistent outputs, or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Animesh Karnewar , Niloy J. Mitra , Andrea Vedaldi , David Novotny

The explosive growth of multi-source multimedia data has significantly increased the demands for transmission and storage, placing substantial pressure on bandwidth and storage infrastructures. While Autoregressive Compression Models (ACMs)…

Information Theory · Computer Science 2025-07-28 Zeyi Lu , Xiaoxiao Ma , Yujun Huang , Minxiao Chen , Bin Chen , Baoyi An , Shu-Tao Xia

Diffusion Transformers have emerged as the preeminent models for a wide array of generative tasks, demonstrating superior performance and efficacy across various applications. The promising results come at the cost of slow inference, as…

Machine Learning · Computer Science 2025-03-24 Xuan Shen , Zhao Song , Yufa Zhou , Bo Chen , Yanyu Li , Yifan Gong , Kai Zhang , Hao Tan , Jason Kuen , Henghui Ding , Zhihao Shu , Wei Niu , Pu Zhao , Yanzhi Wang , Jiuxiang Gu

Current crowd-counting models often rely on single-modal inputs, such as visual images or wireless signal data, which can result in significant information loss and suboptimal recognition performance. To address these shortcomings, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Zhe Cui , Yuli Li , Le-Nam Tran

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Pipeline-parallel distributed optimization is essential for large-scale machine learning but is challenged by significant communication overhead from transmitting high-dimensional activations and gradients between workers. Existing…

Optimization and Control · Mathematics 2025-09-24 Boao Kong , Xu Huang , Yuqi Xu , Yixuan Liang , Bin Wang , Kun Yuan

Diffusion-based generative image compression has demonstrated remarkable potential for achieving realistic reconstruction at ultra-low bitrates. The key to unlocking this potential lies in making the entire compression process…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xihua Sheng , Lingyu Zhu , Tianyu Zhang , Dong Liu , Shiqi Wang , Jing Wang

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in high-quality image and video generation but incur substantial compute cost at inference. A common observation is that DiT latent noise vectors change slowly across…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Austin Silveria , Soham V. Govande , Daniel Y. Fu

Histological artifacts pose challenges for both pathologists and Computer-Aided Diagnosis (CAD) systems, leading to errors in analysis. Current approaches for histological artifact restoration, based on Generative Adversarial Networks…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Zhenqi He , Wenrui Liu , Minghao Yin , Kai Han

Diffusion models deliver high-fidelity synthesis but remain slow due to iterative sampling. We empirically observe there exists feature invariance in deterministic sampling, and present InvarDiff, a training-free acceleration method that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Zihao Wu

Event-based video reconstruction has garnered increasing attention due to its advantages, such as high dynamic range and rapid motion capture capabilities. However, current methods often prioritize the extraction of temporal information…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Lin Zhu , Yunlong Zheng , Yijun Zhang , Xiao Wang , Lizhi Wang , Hua Huang

Video diffusion models have rapidly become the dominant paradigm for high-fidelity generative video synthesis, but their practical deployment remains constrained by severe inference costs. Compared with image generation, video synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Shitong Shao , Lichen Bai , Pengfei Wan , James Kwok , Zeke Xie

Diffusion models are a powerful class of generative models that iteratively denoise samples to produce data. While many works have focused on the number of iterations in this sampling procedure, few have focused on the cost of each…

Machine Learning · Computer Science 2022-07-12 Troy Luhman , Eric Luhman

Diffusion models represent a powerful family of generative models widely used for image and video generation. However, the time-consuming deployment, long inference time, and requirements on large memory hinder their applications on…

Machine Learning · Computer Science 2025-04-18 Kafeng Wang , Jianfei Chen , He Li , Zhenpeng Mi , Jun Zhu

Real-time, high-quality, 3D scanning of large-scale scenes is key to mixed reality and robotic applications. However, scalability brings challenges of drift in pose estimation, introducing significant errors in the accumulated model.…

Graphics · Computer Science 2017-02-09 Angela Dai , Matthias Nießner , Michael Zollhöfer , Shahram Izadi , Christian Theobalt

Multi-satellite, multi-modality in-orbit fusion is a challenging task as it explores the fusion representation of complex high-dimensional data under limited computational resources. Deep neural networks can reveal the underlying…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 DaiXun Li , Weiying Xie , Yunsong Li , Leyuan Fang

Diffusion Transformers (DiTs) are increasingly adopted in scientific computing, yet growing model sizes and resolutions make distributed multi-GPU inference essential. Ulysses sequence parallelism scales DiT inference but introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-22 Bin Ma , Xingjian Ding , Tekin Bicer , Pengfei Su , Dong Li

In this paper, we propose a novel training strategy called SupFusion, which provides an auxiliary feature level supervision for effective LiDAR-Camera fusion and significantly boosts detection performance. Our strategy involves a data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Yiran Qin , Chaoqun Wang , Zijian Kang , Ningning Ma , Zhen Li , Ruimao Zhang