English
Related papers

Related papers: HartleyMHA: Self-Attention in Frequency Domain for…

200 papers

Recent trackers adopt the Transformer to combine or replace the widely used ResNet as their new backbone network. Although their trackers work well in regular scenarios, however, they simply flatten the 2D features into a sequence to better…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Chuanming Tang , Xiao Wang , Yuanchao Bai , Zhe Wu , Jianlin Zhang , Yongmei Huang

Image deblurring is vital in computer vision, aiming to recover sharp images from blurry ones caused by motion or camera shake. While deep learning approaches such as CNNs and Vision Transformers (ViTs) have advanced this field, they often…

Image and Video Processing · Electrical Eng. & Systems 2025-11-17 Syed Mumtahin Mahmud , Mahdi Mohd Hossain Noki , Prothito Shovon Majumder , Abdul Mohaimen Al Radi , Md. Haider Ali , Md. Mosaddek Khan

We propose Frequency-Guided Attention (FGA), a lightweight upsampling module for single image super-resolution. Conventional upsamplers, such as Sub-Pixel Convolution, are efficient but frequently fail to reconstruct high-frequency details…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Daejune Choi , Youchan No , Jinhyung Lee , Duksu Kim

We propose an effective lightweight dynamic local and global self-attention network (DLGSANet) to solve image super-resolution. Our method explores the properties of Transformers while having low computational costs. Motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Xiang Li , Jinshan Pan , Jinhui Tang , Jiangxin Dong

Deep learning-based medical image segmentation technology aims at automatic recognizing and annotating objects on the medical image. Non-local attention and feature learning by multi-scale methods are widely used to model network, which…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bo Wang , Lei Wang , Junyang Chen , Zhenghua Xu , Thomas Lukasiewicz , Zhigang Fu

Saliency Prediction aims to predict the attention distribution of human eyes given an RGB image. Most of the recent state-of-the-art methods are based on deep image feature representations from traditional CNNs. However, the traditional…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Shuo Zhang

Medical image processing tasks such as segmentation often require capturing non-local information. As organs, bones, and tissues share common characteristics such as intensity, shape, and texture, the contextual information plays a critical…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Samuel Joutard , Reuben Dorent , Amanda Isaac , Sebastien Ourselin , Tom Vercauteren , Marc Modat

In computer vision, the performance of deep neural networks (DNNs) is highly related to the feature extraction ability, i.e., the ability to recognize and focus on key pixel regions in an image. However, in this paper, we quantitatively and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Shanshan Zhong , Wushao Wen , Jinghui Qin , Qiangpu Chen , Zhongzhan Huang

Generating 3D models from multi-view 2D RGB images has gained significant attention, extending the capabilities of technologies like Virtual Reality, Robotic Vision, and human-machine interaction. In this paper, we introduce a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ajith Balakrishnan , Sreeja S , Linu Shine

Image super-resolution (SR) has significantly advanced through the adoption of Transformer architectures. However, conventional techniques aimed at enlarging the self-attention window to capture broader contexts come with inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chengxing Xie , Xiaoming Zhang , Linze Li , Yuqian Fu , Biao Gong , Tianrui Li , Kai Zhang

Cancer is an abnormal growth with potential to invade locally and metastasize to distant organs. Accurate auto-segmentation of the tumor and surrounding normal tissues is required for radiotherapy treatment plan optimization. Recent…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Syed Haider Ali , Asrar Ahmad , Muhammad Ali , Asifullah Khan , Nadeem Shaukat

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

Deep neural networks, especially transformer-based architectures, have achieved remarkable success in semantic segmentation for environmental perception. However, existing models process video frames independently, thus failing to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Serin Varghese , Kevin Ross , Fabian Hueger , Kira Maag

Recently, 3D medical image reconstruction (MIR) and segmentation (MIS) based on deep neural networks have been developed with promising results, and attention mechanism has been further designed to capture global contextual information for…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Hang Zhang , Jinwei Zhang , Rongguang Wang , Qihao Zhang , Pascal Spincemaille , Thanh D. Nguyen , Yi Wang

Diffusion models have recently gained state of the art performance on many image generation tasks. However, most models require significant computational resources to achieve this. This becomes apparent in the application of medical image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Karan Jain , Mohammad Nayeem Teli

Multi-Head Attention (MHA) is a critical computational kernel in transformer-based AI models. Emerging scalable tile-based accelerator architectures integrate increasing numbers of tightly-packed processing elements (PEs) with tensor units.…

Hardware Architecture · Computer Science 2025-05-27 Chi Zhang , Luca Colagrande , Renzo Andri , Thomas Benz , Gamze Islamoglu , Alessandro Nadalini , Francesco Conti , Yawei Li , Luca Benini

Event cameras detect changes in per-pixel intensity to generate asynchronous `event streams'. They offer great potential for accurate semantic map retrieval in real-time autonomous systems owing to their much higher temporal resolution and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Shristi Das Biswas , Adarsh Kosta , Chamika Liyanagedera , Marco Apolinario , Kaushik Roy

As intensities of MRI volumes are inconsistent across institutes, it is essential to extract universal features of multi-modal MRIs to precisely segment brain tumors. In this concept, we propose a volumetric vision transformer that follows…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Himashi Peiris , Munawar Hayat , Zhaolin Chen , Gary Egan , Mehrtash Harandi

Thermal management in 3D ICs is increasingly challenging due to higher power densities. Traditional PDE-solving-based methods, while accurate, are too slow for iterative design. Machine learning approaches like FNO provide faster…

Machine Learning · Computer Science 2025-10-21 Zhen Huang , Hong Wang , Wenkai Yang , Muxi Tang , Depeng Xie , Ting-Jung Lin , Yu Zhang , Wei W. Xing , Lei He

Brain tumor segmentation models have aided diagnosis in recent years. However, they face MRI complexity and variability challenges, including irregular shapes and unclear boundaries, leading to noise, misclassification, and incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruoxin Wang , Tianyi Tang , Haiming Du , Yuxuan Cheng , Yu Wang , Lingjie Yang , Xiaohui Duan , Yunfang Yu , Yu Zhou , Donglong Chen