English
Related papers

Related papers: Fourier-Mixed Window Attention: Accelerating Infor…

200 papers

Transformer-based language models have found many diverse applications requiring them to process sequences of increasing length. For these applications, the causal self-attention -- which is the only component scaling quadratically w.r.t.…

Machine Learning · Computer Science 2023-06-05 Matteo Pagliardini , Daniele Paliotta , Martin Jaggi , François Fleuret

Efficiently supporting long context length is crucial for Transformer models. The quadratic complexity of the self-attention computation plagues traditional Transformers. Sliding window-based static sparse attention mitigates the problem by…

Hardware Architecture · Computer Science 2024-05-28 Zhenyu Bai , Pranav Dangi , Huize Li , Tulika Mitra

Earth Observatory is a growing research area that can capitalize on the powers of AI for short time forecasting, a Now-casting scenario. In this work, we tackle the challenge of weather forecasting using a video transformer network. Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Alabi Bojesomo , Hasan Al Marzouqi , Panos Liatsis

Dengue fever is one of the most deadly mosquito-born tropical infectious diseases. Detailed long range forecast model is vital in controlling the spread of disease and making mitigation efforts. In this study, we examine methods used to…

Machine Learning · Computer Science 2024-03-13 Nhat Thanh Tran , Jack Xin , Guofa Zhou

Multi-scale representations are crucial for semantic segmentation. The community has witnessed the flourish of semantic segmentation convolutional neural networks (CNN) exploiting multi-scale contextual information. Motivated by that the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Haotian Yan , Chuang Zhang , Ming Wu

Vision Transformers (ViTs) have achieved impressive results in computer vision by leveraging self-attention to model long-range dependencies. However, their emphasis on global context often comes at the expense of local feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Puskal Khadka , Rodrigue Rizk , Longwei Wang , KC Santosh

Efficient and accurate feed-forward multi-view reconstruction has long been an important task in computer vision. Recent transformer-based models like VGGT, $\pi^3$ and MapAnything have demonstrated remarkable performance with relatively…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chung-Shien Brian Wang , Christian Schmidt , Jens Piekenbrinck , Bastian Leibe

With the popularity of Transformer architectures in computer vision, the research focus has shifted towards developing computationally efficient designs. Window-based local attention is one of the major techniques being adopted in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ammarah Farooq , Muhammad Awais , Sara Ahmed , Josef Kittler

Time series forecasting is a long-standing challenge due to the real-world information is in various scenario (e.g., energy, weather, traffic, economics, earthquake warning). However some mainstream forecasting model forecasting result is…

Artificial Intelligence · Computer Science 2022-12-05 Maowei Jiang , Pengyu Zeng , Kai Wang , Huan Liu , Wenbo Chen , Haoran Liu

Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Renjie Zou , Chunfeng Song , Zhaoxiang Zhang

We introduce Iwin Transformer, a novel position-embedding-free hierarchical vision transformer, which can be fine-tuned directly from low to high resolution, through the collaboration of innovative interleaved window attention and depthwise…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Simin Huo , Ning Li

Multivariate time series imputation is fundamental in applications such as healthcare, traffic forecasting, and biological modeling, where sensor failures and irregular sampling lead to pervasive missing values. However, existing…

Machine Learning · Computer Science 2025-12-18 Runze Li , Hanchen Wang , Wenjie Zhang , Binghao Li , Yu Zhang , Xuemin Lin , Ying Zhang

The attention mechanism has been the core component in modern transformer architectures. However, the computation of standard full attention scales quadratically with the sequence length, serving as a major bottleneck in long-context…

Computation and Language · Computer Science 2026-04-28 Yusheng Zhao , Hourun Li , Bohan Wu , Yichun Yin , Lifeng Shang , Jingyang Yuan , Meng Zhang , Ming Zhang

Transformer-based models have achieved remarkable success in multivariate time series forecasting (MTSF) by capturing long-range dependencies. However, their widespread adoption is hindered by the quadratic computational complexity of…

Machine Learning · Computer Science 2026-05-12 Fanpu Cao , Shu Yang , Zhengjian Chen , Ye Liu , Laizhong Cui

Inference with Transformer-based Large Language Models (LLMs) on long sequences is both costly and slow due to the quadratic complexity of the self-attention mechanism. We introduce Star Attention, a two-phase block-sparse approximation…

Computation and Language · Computer Science 2025-06-02 Shantanu Acharya , Fei Jia , Boris Ginsburg

Modern autoregressive models rely on attention, yet the Softmax full attention in Transformers scales quadratically with sequence length. Sliding Window Attention (SWA) achieves linear-time encoding/decoding by constraining the attention…

Machine Learning · Computer Science 2026-01-08 Jiaxu Liu , Yuhe Bai , Xiangyu Yin , Christos-Savvas Bouganis

Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art…

Machine Learning · Computer Science 2021-08-18 Jacek Klimek , Jakub Klimek , Witold Kraskiewicz , Mateusz Topolewski

Multi-head attention empowers the recent success of transformers, the state-of-the-art models that have achieved remarkable success in sequence modeling and beyond. These attention mechanisms compute the pairwise dot products between the…

Machine Learning · Computer Science 2022-06-02 Tan Nguyen , Minh Pham , Tam Nguyen , Khai Nguyen , Stanley J. Osher , Nhat Ho

Transformers are mostly relying on softmax attention, which introduces quadratic complexity with respect to sequence length and remains a major bottleneck for efficient inference. Prior work on linear or hybrid attention typically replaces…

Transformers have achieved remarkable progress in time series forecasting, yet their reliance on deterministic dot-product attention limits their capacity to model uncertainty and nonlinear dependencies across multivariate temporal…

Machine Learning · Computer Science 2026-03-24 Bulent Haznedar , Levent Karacan