English

Vision Transformer with Key-select Routing Attention for Single Image Dehazing

Computer Vision and Pattern Recognition 2024-07-01 v1
Authors: Lihan Tong , Weijia Li , Qingxia Yang , Liyuan Chen , Peng Chen
View on arXiv ↗ PDF ↗

Abstract

We present Ksformer, utilizing Multi-scale Key-select Routing Attention (MKRA) for intelligent selection of key areas through multi-channel, multi-scale windows with a top-k operator, and Lightweight Frequency Processing Module (LFPM) to enhance high-frequency features, outperforming other dehazing methods in tests.

Cite

@article{arxiv.2406.19703,
  title  = {Vision Transformer with Key-select Routing Attention for Single Image Dehazing},
  author = {Lihan Tong and Weijia Li and Qingxia Yang and Liyuan Chen and Peng Chen},
  journal= {arXiv preprint arXiv:2406.19703},
  year   = {2024}
}

Comments

5 pages,4 figures,IEICE Trans. Information and Systems

Related papers

View all related →
Image and Video Processing · Electrical Eng. & Systems
MSFA-Frequency-Aware Transformer for Hyperspectral Images Demosaicing
Haijin Zeng, Kai Feng, Shaoguang Huang, Jiezhang Cao +4
2023-03-24
Image and Video Processing · Electrical Eng. & Systems
LKFormer: Large Kernel Transformer for Infrared Image Super-Resolution
Feiwei Qin, Kang Yan, Changmiao Wang, Ruiquan Ge +2
2024-01-25
Computer Vision and Pattern Recognition · Computer Science
DeBiFormer: Vision Transformer with Deformable Agent Bi-level Routing Attention
Nguyen Huu Bao Long, Chenyu Zhang, Yuzhi Shi, Tsubasa Hirakawa +3
2024-10-14
Image and Video Processing · Electrical Eng. & Systems
Deformable Cross-Attention Transformer for Medical Image Registration
Junyu Chen, Yihao Liu, Yufan He, Yong Du
2023-03-14
Computer Vision and Pattern Recognition · Computer Science
Vision Transformers for Single Image Dehazing
Yuda Song, Zhuqing He, Hui Qian, Xin Du
2023-04-12
Machine Learning · Computer Science
Macformer: Transformer with Random Maclaurin Feature Attention
Yuhan Guo, Lizhong Ding, Ye Yuan, Guoren Wang
2024-08-22
Computer Vision and Pattern Recognition · Computer Science
Haze-Aware Attention Network for Single-Image Dehazing
Lihan Tong, Yun Liu, Weijia Li, Liyuan Chen +1
2024-07-17
Image and Video Processing · Electrical Eng. & Systems
TKwinFormer: Top k Window Attention in Vision Transformers for Feature Matching
Yun Liao, Yide Di, Hao Zhou, Kaijun Zhu +4
2025-04-01
Computer Vision and Pattern Recognition · Computer Science
DHFormer: A Vision Transformer-Based Attention Module for Image Dehazing
Abdul Wasi, O. Jeba Shiney
2023-12-18
Computer Vision and Pattern Recognition · Computer Science
Breaking Complexity Barriers: High-Resolution Image Restoration with Rank Enhanced Linear Attention
Yuang Ai, Huaibo Huang, Tao Wu, Qihang Fan +1
2025-05-23
Machine Learning · Computer Science
Sliceformer: Make Multi-head Attention as Simple as Sorting in Discriminative Tasks
Shen Yuan, Hongteng Xu
2023-10-30
Computer Vision and Pattern Recognition · Computer Science
Learning A Sparse Transformer Network for Effective Image Deraining
Xiang Chen, Hao Li, Mingqiang Li, Jinshan Pan
2023-03-22
Computer Vision and Pattern Recognition · Computer Science
BiFormer: Vision Transformer with Bi-Level Routing Attention
Lei Zhu, Xinjiang Wang, Zhanghan Ke, Wayne Zhang +1
2023-03-16
Computer Vision and Pattern Recognition · Computer Science
Compact Vision Transformer by Reduction of Kernel Complexity
Yancheng Wang, Yingzhen Yang
2025-07-18
Computer Vision and Pattern Recognition · Computer Science
U-shaped Vision Mamba for Single Image Dehazing
Zhuoran Zheng, Chen Wu
2024-02-19
Image and Video Processing · Electrical Eng. & Systems
Wavelet-Assisted Multi-Frequency Attention Network for Pansharpening
Jie Huang, Rui Huang, Jinghao Xu, Siran Pen +2
2025-02-10
Computer Vision and Pattern Recognition · Computer Science
CGFformer: Cluster-Guidance Frequency Transformer for Pansharpening
Zijian Zhou, Jianing Zhang, Kai Sun, Xiangyu Zhao +2
2026-05-05
Computer Vision and Pattern Recognition · Computer Science
Parallel Cross Strip Attention Network for Single Image Dehazing
Lihan Tong, Yun Liu, Tian Ye, Weijia Li +2
2024-05-10
Computer Vision and Pattern Recognition · Computer Science
A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localization
Ming Dai, Jianhong Hu, Jiedong Zhuang, Enhui Zheng
2022-01-25
Machine Learning · Computer Science
Towards Better Multi-head Attention via Channel-wise Sample Permutation
Shen Yuan, Hongteng Xu
2024-10-16
Computer Vision and Pattern Recognition · Computer Science
MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing
Yuwei Qiu, Kaihao Zhang, Chenxi Wang, Wenhan Luo +2
2023-08-31
Computer Vision and Pattern Recognition · Computer Science
TCSAFormer: Efficient Vision Transformer with Token Compression and Sparse Attention for Medical Image Segmentation
Zunhui Xia, Hongxing Li, Libin Lan
2025-08-07
Image and Video Processing · Electrical Eng. & Systems
Efficient Single Image Super-Resolution with Entropy Attention and Receptive Field Augmentation
Xiaole Zhao, Linze Li, Chengxing Xie, Xiaoming Zhang +4
2024-08-09
Artificial Intelligence · Computer Science
Mixture of Attention Schemes (MoAS): Learning to Route Between MHA, GQA, and MQA
Esmail Gumaan
2025-12-25
Computer Vision and Pattern Recognition · Computer Science
DMFormer: Closing the Gap Between CNN and Vision Transformers
Zimian Wei, Hengyue Pan, Lujun Li, Menglong Lu +3
2022-11-30
R2 v1 2026-06-28T17:22:18.177Z