English
Related papers

Related papers: UltraViCo: Breaking Extrapolation Limits in Video …

200 papers

Video restoration is a low-level vision task that seeks to restore clean, sharp videos from quality-degraded frames. One would use the temporal information from adjacent frames to make video restoration successful. Recently, the success of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Fu-Jen Tsai , Yan-Tsung Peng , Chen-Yu Chang , Chan-Yu Li , Yen-Yu Lin , Chung-Chi Tsai , Chia-Wen Lin

Image diffusion models have been adapted for real-world video super-resolution to tackle over-smoothing issues in GAN-based methods. However, these models struggle to maintain temporal consistency, as they are trained on static images,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Rui Xie , Yinhong Liu , Penghao Zhou , Chen Zhao , Jun Zhou , Kai Zhang , Zhenyu Zhang , Jian Yang , Zhenheng Yang , Ying Tai

The quadratic complexity of full attention mechanisms poses a significant bottleneck for Video Diffusion Models (VDMs) aiming to generate long-duration, high-resolution videos. While various sparse attention methods have been proposed, many…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jianzong Wu , Liang Hou , Haotian Yang , Xin Tao , Ye Tian , Pengfei Wan , Di Zhang , Yunhai Tong

Diffusion Transformers (DiT) excel in video generation but encounter significant computational challenges due to the quadratic complexity of attention. Notably, attention differences between adjacent diffusion steps follow a U-shaped…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Wenzhang Sun , Qirui Hou , Donglin Di , Jiahui Yang , Yongjia Ma , Jianxun Cui

Text-to-image diffusion models (DMs) are frequently abused to produce harmful or copyrighted content, violating public interests. Concept erasure (unlearning) is a promising paradigm to alleviate this issue. However, there exists a peculiar…

Machine Learning · Computer Science 2026-05-08 Manyi Li , Yufan Liu , Lai Jiang , Bing Li , Yuming Li , Weiming Hu

Video restoration and enhancement are critical not only for improving visual quality, but also as essential pre-processing steps to boost the performance of a wide range of downstream computer vision tasks. This survey presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Alexandra Malyugina , Yini Li , Joanne Lin , Nantheera Anantrasirichai

Diffusion Transformers (DiTs) achieve superior image generation quality but suffer from quadratic computational complexity relative to token count. While various token reduction (TR) methods have been proposed to mitigate this cost, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Hangyeol Lee , Hyojeong Lee , Joo-Young Kim

Colloquially speaking, image generation models based upon diffusion processes are frequently said to exhibit "hallucinations," samples that could never occur in the training data. But where do such hallucinations come from? In this paper,…

Machine Learning · Computer Science 2024-08-27 Sumukh K Aithal , Pratyush Maini , Zachary C. Lipton , J. Zico Kolter

Diffusion models (DMs) have recently gained attention with state-of-the-art performance in text-to-image synthesis. Abiding by the tradition in deep learning, DMs are trained and evaluated on the images with fixed sizes. However, users are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhiyu Jin , Xuli Shen , Bin Li , Xiangyang Xue

Minute-scale cinematic video generation is a central challenge for generative video models. Existing paradigms address only fragments of this challenge: single-shot extrapolation preserves an anchor but lacks cinematic structure, while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Akide Liu , Jinbo Xing , Chaojie Mao , Ye Li , Zeyu Zhang , Yefei He , Weijie Wang , Zihan Wang , Yu Liu , Gholamreza Haffari , Bohan Zhuang

Text-guided image generation and editing using diffusion models have achieved remarkable advancements. Among these, tuning-free methods have gained attention for their ability to perform edits without extensive model adjustments, offering…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen

Diffusion models have made significant advances in generating high-quality images, but their application to video generation has remained challenging due to the complexity of temporal motion. Zero-shot video editing offers a solution by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Xirui Li , Chao Ma , Xiaokang Yang , Ming-Hsuan Yang

Diffusion-based text-to-video generation (T2V) or image-to-video (I2V) generation have emerged as a prominent research focus. However, there exists a challenge in integrating the two generative paradigms into a unified model. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xinyu Xiao , Binbin Yang , Tingtian Li , Yipeng Yu , Sen Lei

Diffusion-based video generation has advanced substantially in visual fidelity and temporal coherence, but practical deployment remains limited by the quadratic complexity of full attention. Training-free sparse attention is attractive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xuzhe Zheng , Yuexiao Ma , Jing Xu , Xiawu Zheng , Rongrong Ji , Fei Chao

Vision Transformers have achieved impressive performance in video classification, while suffering from the quadratic complexity caused by the Softmax attention mechanism. Some studies alleviate the computational costs by reducing the number…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Kaiyue Lu , Zexiang Liu , Jianyuan Wang , Weixuan Sun , Zhen Qin , Dong Li , Xuyang Shen , Hui Deng , Xiaodong Han , Yuchao Dai , Yiran Zhong

Transformers are built upon multi-head scaled dot-product attention and positional encoding, which aim to learn the feature representations and token dependencies. In this work, we focus on enhancing the distinctive representation by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Litao Yu , Jian Zhang

Efficient Transformers have been developed for long sequence modeling, due to their subquadratic memory and time complexity. Sparse Transformer is a popular approach to improving the efficiency of Transformers by restricting self-attention…

Machine Learning · Computer Science 2023-02-01 Aosong Feng , Irene Li , Yuang Jiang , Rex Ying

Text-to-image (T2I) diffusion models have revolutionized visual content creation, but extending these capabilities to text-to-video (T2V) generation remains a challenge, particularly in preserving temporal consistency. Existing methods that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Dohun Lee , Bryan S Kim , Geon Yeong Park , Jong Chul Ye

Convolutional neural networks have achieved excellent results in compressed video quality enhancement task in recent years. State-of-the-art methods explore the spatiotemporal information of adjacent frames mainly by deformable convolution.…

Multimedia · Computer Science 2022-10-26 Li Yu , Wenshuai Chang , Shiyu Wu , Moncef Gabbouj

In real-world video super-resolution (VSR), videos suffer from in-the-wild degradations and artifacts. VSR methods, especially recurrent ones, tend to propagate artifacts over time in the real-world setting and are more vulnerable than…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuehan Zhang , Angela Yao