English
Related papers

Related papers: Ride the Wave: Precision-Allocated Sparse Attentio…

200 papers

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

Two dominant distributed computing strategies have emerged to overcome the computational bottleneck of supervised learning with big data: parallel data processing in the MapReduce paradigm and serial data processing in the online streaming…

Computation · Statistics 2021-11-02 Emily C. Hector , Lan Luo , Peter X. -K. Song

The increasing demand for long-context modeling in large language models (LLMs) is bottlenecked by the quadratic complexity of the standard self-attention mechanism. The community has proposed sparse attention to mitigate this issue.…

Artificial Intelligence · Computer Science 2025-11-18 Jingze Shi , Yifan Wu , Yiran Peng , Bingheng Wu , Liangdong Wang , Guang Liu , Yuyu Luo

Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation. We present Grid Partitioned Attention (GPA), a new…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Nikolay Jetchev , Gökhan Yildirim , Christian Bracher , Roland Vollgraf

The scalability of high-fidelity video diffusion models (VDMs) is constrained by two key sources of redundancy: the quadratic complexity of global spatio-temporal attention and the computational overhead of long iterative denoising…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Xinjian Wu , Hongmei Wang , Yuan Zhou , Qinglin Lu

Recent advancements in diffusion-based models have demonstrated significant success in generating images from text. However, video editing models have not yet reached the same level of visual quality and user control. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Ozgur Kara , Bariscan Kurtkaya , Hidir Yesiltepe , James M. Rehg , Pinar Yanardag

Diffusion models achieve state-of-the-art video generation quality, but their inference remains expensive due to the large number of sequential denoising steps. This has motivated a growing line of research on accelerating diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yasaman Haghighi , Alexandre Alahi

While diffusion models have achieved great success in the field of video generation, this progress is accompanied by a rapidly escalating computational burden. Among the existing acceleration methods, Feature Caching is popular due to its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chang Zou , Changlin Li , Yang Li , Patrol Li , Jianbing Wu , Xiao He , Songtao Liu , Zhao Zhong , Kailin Huang , Linfeng Zhang

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Processing long-form videos with Video Large Language Models (Video-LLMs) is computationally prohibitive. Current efficiency methods often compromise fine-grained perception through irreversible information disposal or inhibit long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Handong Li , Zikang Liu , Longteng Guo , Tongtian Yue , Yepeng Tang , Xinxin Zhu , Chuanyang Zheng , Ziming Wang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Jing Liu

Self-attention in transformer models is an incremental associative memory that maps key vectors to value vectors. One way to speed up self-attention is to employ GPU-compatible vector search algorithms based on standard partitioning methods…

Computation and Language · Computer Science 2025-06-04 Pierre-Emmanuel Mazaré , Gergely Szilvasy , Maria Lomeli , Francisco Massa , Naila Murray , Hervé Jégou , Matthijs Douze

The computational burden of attention in long-context language models has motivated two largely independent lines of work: sparse attention mechanisms that reduce complexity by attending to selected tokens, and gated attention variants that…

Artificial Intelligence · Computer Science 2026-01-23 Alfred Shen , Aaron Shen

Video diffusion models (DMs) have enabled high-quality video synthesis. However, their computation costs scale quadratically with sequence length because self-attention has quadratic complexity. While linear attention lowers the cost, fully…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yushi Huang , Xingtong Ge , Ruihao Gong , Chengtao Lv , Jun Zhang

Self-attention scales quadratically with input size, limiting its use for large-scale physical systems. Although sparse attention mechanisms provide a viable alternative, they are primarily designed for regular structures such as text or…

Machine Learning · Computer Science 2025-06-17 Catalin E. Brita , Hieu Nguyen , Lohithsai Yadala Chanchu , Domonkos Nagy , Maksim Zhdanov

The spatio-temporal complexity of video data presents significant challenges in tasks such as compression, generation, and inpainting. We present four key contributions to address the challenges of spatiotemporal video processing. First, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Onkar Susladkar , Jishu Sen Gupta , Chirag Sehgal , Sparsh Mittal , Rekha Singhal

Video generation based on diffusion models presents a challenging multimodal task, with video editing emerging as a pivotal direction in this field. Recent video editing approaches primarily fall into two categories: training-required and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Junhao Xia , Chaoyang Zhang , Yecheng Zhang , Chengyang Zhou , Zhichang Wang , Bochun Liu , Dongshuo Yin

Direction of arrival (DOA) estimation in array processing using uniform/sparse linear arrays is concerned in this paper. While sparse methods via approximate parameter discretization have been popular in the past decade, the discretization…

Information Theory · Computer Science 2014-10-24 Zai Yang , Lihua Xie , Cishen Zhang

Parameter-efficient fine-tuning (PEFT) has emerged as a popular solution for adapting pre-trained Vision Transformer (ViT) models to downstream applications by updating only a small subset of parameters. While current PEFT methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ting Liu , Xuyang Liu , Liangtao Shi , Zunnan Xu , Yue Hu , Siteng Huang , Yi Xin , Bineng Zhong , Donglin Wang

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Diffusion Transformers (DiTs) have become a leading backbone for video generation, yet their quadratic attention cost remains a major bottleneck. Sparse attention reduces this cost by computing only a subset of attention blocks. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xuanyi Zhou , Qiuyang Mang , Shuo Yang , Haocheng Xi , Jintao Zhang , Huanzhi Mao , Joseph E. Gonzalez , Kurt Keutzer , Ion Stoica , Alvin Cheung