English
Related papers

Related papers: Relational Feature Caching for Accelerating Diffus…

200 papers

Transfer learning has become a central paradigm in modern machine learning, yet it suffers from the long-standing problem of negative transfer, where leveraging source representations can harm rather than help performance on the target…

Machine Learning · Computer Science 2026-04-28 Yichen Xu , Ryumei Nakada , Linjun Zhang , Lexin Li

Diffusion models have achieved remarkable performance on a wide range of generative tasks, yet training them from scratch is notoriously resource-intensive, typically requiring millions of training images and many GPU days. Motivated by a…

Machine Learning · Computer Science 2026-03-16 Rui Huang , Shitong Shao , Zikai Zhou , Pukun Zhao , Hangyu Guo , Tian Ye , Lichen Bai , Shuo Yang , Zeke Xie

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

Generative models, particularly Diffusion Models (DM), have shown strong potential for Computed Tomography (CT) reconstruction serving as expressive priors for solving ill-posed inverse problems. However, diffusion-based reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Jiayang Shi , Lincen Yang , Zhong Li , Tristan Van Leeuwen , Daniel M. Pelt , K. Joost Batenburg

Local feature matching is an essential technique in image matching and plays a critical role in a wide range of vision-based applications. However, existing Transformer-based detector-free local feature matching methods encounter challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Naijian Cao , Renjie He , Yuchao Dai , Mingyi He

Diffusion models have emerged as state-of-the-art in image generation, but their practical deployment is hindered by the significant computational cost of their iterative denoising process. While existing caching techniques can accelerate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Mingyu Sung , Il-Min Kim , Sangseok Yun , Jae-Mo Kang

Imputation methods play a critical role in enhancing the quality of practical time-series data, which often suffer from pervasive missing values. Recently, diffusion-based generative imputation methods have demonstrated remarkable success…

Machine Learning · Computer Science 2025-10-03 Zeqi Ye , Minshuo Chen

Text-to-Video applications receive increasing attention from the public. Among these, diffusion models have emerged as the most prominent approach, offering impressive quality in visual content generation. However, it still suffers from…

Multimedia · Computer Science 2025-01-09 Desen Sun , Henry Tian , Tim Lu , Sihang Liu

A dramatic influx of diffusion-generated images has marked recent years, posing unique challenges to current detection technologies. While the task of identifying these images falls under binary classification, a seemingly straightforward…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yewon Lim , Changyeon Lee , Aerin Kim , Oren Etzioni

Diffusion Transformers (DiTs) achieve state-of-the-art generation quality but require long sequential denoising trajectories, leading to high inference latency. Recent speculative inference methods enable lossless parallel sampling in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xinwan Wen , Bowen Li , Jiajun Luo , Ye Li , Zhi Wang

We introduce a diffusion-transformer (DiT) framework for single-image reflection removal that leverages the generalization strengths of foundation diffusion models in the restoration setting. Rather than relying on task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Daniyar Zakarin , Thiemo Wandel , Anton Obukhov , Dengxin Dai

In this letter, we derive the probability density function (PDF) and cumulative distribution function (CDF) of the minimum of two non-central Chi-square random variables with two degrees of freedom in terms of power series. With the help of…

Information Theory · Computer Science 2014-07-07 Manav R. Bhatnagar

Wireless connectivity promises to unshackle virtual reality (VR) experiences, allowing users to engage from anywhere, anytime. However, delivering seamless, high-quality, real-time VR video wirelessly is challenging due to the stringent…

Machine Learning · Computer Science 2025-12-04 Krishnendu S. Tharakan , Carlo Fischione

The predominant approach to advancing text-to-image generation has been training-time scaling, where larger models are trained on more data using greater computational resources. While effective, this approach is computationally expensive,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Shufan Li , Konstantinos Kallidromitis , Akash Gokul , Arsh Koneru , Yusuke Kato , Kazuki Kozuka , Aditya Grover

Diffusion Transformers (DiT) excel in video generation but encounter significant computational challenges due to the quadratic complexity of attention. Notably, attention differences between adjacent diffusion steps follow a U-shaped…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Wenzhang Sun , Qirui Hou , Donglin Di , Jiahui Yang , Yongjia Ma , Jianxun Cui

Diffusion Transformers (DiTs) with billions of model parameters form the backbone of popular image and video generation models like DALL.E, Stable-Diffusion and SORA. Though these models are necessary in many low-latency applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Vignesh Sundaresha

Diffusion transformers have demonstrated remarkable capabilities in generating videos. However, their practical deployment is severely constrained by high memory usage and computational cost. Post-Training Quantization provides a practical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Rundong Su , Jintao Zhang , Zhihang Yuan , Haojie Duanmu , Jianfei Chen , Jun Zhu

Caching is crucial for enabling high-throughput networks for data intensive applications. Traditional caching technology relies on DRAM, as it can transfer data at a high rate. However, DRAM capacity is subject to contention by most system…

Networking and Internet Architecture · Computer Science 2023-10-12 Faruk Volkan Mutlu , Edmund Yeh

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

Dense pixel matching problems such as optical flow and disparity estimation are among the most challenging tasks in computer vision. Recently, several deep learning methods designed for these problems have been successful. A sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Ali Salehi , Madhusudhanan Balasubramanian