English
Related papers

Related papers: Learning Image Deraining Transformer Network with …

200 papers

Identifying robust and accurate correspondences across images is a fundamental problem in computer vision that enables various downstream tasks. Recent semi-dense matching methods emphasize the effectiveness of fusing relevant cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hongkai Chen , Zixin Luo , Yurun Tian , Xuyang Bai , Ziyu Wang , Lei Zhou , Mingmin Zhen , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Labeling medical images depends on professional knowledge, making it difficult to acquire large amount of annotated medical images with high quality in a short time. Thus, making good use of limited labeled samples in a small dataset to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Peng Jiang , Juan Liu , Lang Wang , Zhihui Ynag , Hongyu Dong , Jing Feng

Distributed radar sensors enable robust human activity recognition. However, scaling the number of coordinated nodes introduces challenges in feature extraction from large datasets, and transparent data fusion. We propose an end-to-end…

Signal Processing · Electrical Eng. & Systems 2026-01-07 Mina Shahbazifar , Zolfa Zeinalpour-Yazdi , Matthias Hollick , Arash Asadi , Vahid Jamali

Transformer networks have achieved remarkable success across diverse domains, leveraging a variety of architectural innovations, including residual connections. However, traditional residual connections, which simply sum the outputs of…

Machine Learning · Computer Science 2025-07-25 Mike Heddes , Adel Javanmard , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

Recently, denoising methods based on supervised learning have exhibited promising performance. However, their reliance on external datasets containing noisy-clean image pairs restricts their applicability. To address this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jaekyun Ko , Sanghwan Lee

Although transformer has achieved great progress on computer vision tasks, the scale variation in dense image prediction is still the key challenge. Few effective multi-scale techniques are applied in transformer and there are two main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Zekun Li , Yufan Liu , Bing Li , Weiming Hu , Kebin Wu , Pei Wang

Image dehazing aims to restore clean images from hazy ones. Convolutional Neural Networks (CNNs) and Transformers have demonstrated exceptional performance in local and global feature extraction, respectively, and currently represent the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Huichun Liu , Xiaosong Li , Tianshu Tan

Convolutional Neural networks (CNN) have been the first choice of paradigm in many computer vision applications. The convolution operation however has a significant weakness which is it only operates on a local neighborhood of pixels, thus…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Michael Yang

Transformer-based deep models for single image super-resolution (SISR) have greatly improved the performance of lightweight SISR tasks in recent years. However, they often suffer from heavy computational burden and slow inference due to the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Xiaole Zhao , Linze Li , Chengxing Xie , Xiaoming Zhang , Ting Jiang , Wenjie Lin , Shuaicheng Liu , Tianrui Li

Low-light image enhancement aims to improve the perception of images collected in dim environments and provide high-quality data support for image recognition tasks. When dealing with photos captured under non-uniform illumination, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiao Fang , Xin Gao , Baofeng Li , Feng Zhai , Yu Qin , Zhihang Meng , Jiansheng Lu , Chun Xiao

Neural networks equipped with self-attention have parallelizable computation, light-weight structure, and the ability to capture both long-range and local dependencies. Further, their expressive power and performance can be boosted by using…

Computation and Language · Computer Science 2019-03-27 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

In recent years, Vision Transformer-based approaches for low-level vision tasks have achieved widespread success. Unlike CNN-based models, Transformers are more adept at capturing long-range dependencies, enabling the reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chih-Chung Hsu , Chia-Ming Lee , Yi-Shiuan Chou

Image generation has been successfully cast as an autoregressive sequence generation or transformation problem. Recent work has shown that self-attention is an effective way of modeling textual sequences. In this work, we generalize a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Niki Parmar , Ashish Vaswani , Jakob Uszkoreit , Łukasz Kaiser , Noam Shazeer , Alexander Ku , Dustin Tran

In recent years, convolutional neural networks (CNNs) with channel-wise feature refining mechanisms have brought noticeable benefits to modelling channel dependencies. However, current attention paradigms fail to infer an optimal channel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Nick Nikzad , Yongsheng Gao , Jun Zhou

This paper introduces a novel attention mechanism, called dual attention, which is both efficient and effective. The dual attention mechanism consists of two parallel components: local attention generated by Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhengkai Jiang , Liang Liu , Jiangning Zhang , Yabiao Wang , Mingang Chen , Chengjie Wang

Transformers have been successfully used in various fields and are becoming the standard tools in computer vision. However, self-attention, a core component of transformers, has a quadratic complexity problem, which limits the use of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jiuk Hong , Chaehyeon Lee , Soyoun Bang , Heechul Jung

In this paper, we propose a computational efficient end-to-end training deep neural network (CEDNN) model and spatial attention maps based on difference images. Firstly, the difference image is generated by image processing. Then five…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jing Chen , Chenhui Wang , Kejun Wang , Meichen Liu

Recent work has made clear that the residual pathway is not mere optimization plumbing; it is part of the model's representational machinery. We agree, but argue that the cleanest way to organize this design space is through a two-axis view…

Machine Learning · Computer Science 2026-05-15 Yifan Zhang

Lesion segmentation requires both speed and accuracy. In this paper, we propose a simple yet efficient network DSNet, which consists of a encoder based on Transformer and a convolutional neural network(CNN)-based distinct pyramid decoder…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Yunxiao Liu

Image keypoints and descriptors play a crucial role in many visual measurement tasks. In recent years, deep neural networks have been widely used to improve the performance of keypoint and descriptor extraction. However, the conventional…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Xiaoming Zhao , Xingming Wu , Weihai Chen , Peter C. Y. Chen , Qingsong Xu , Zhengguo Li