English
Related papers

Related papers: Learning Image Deraining Transformer Network with …

200 papers

Transfer learning through fine-tuning a pre-trained neural network with an extremely large dataset, such as ImageNet, can significantly accelerate training while the accuracy is frequently bottlenecked by the limited dataset size of the new…

Machine Learning · Computer Science 2020-05-14 Xingjian Li , Haoyi Xiong , Hanchao Wang , Yuxuan Rao , Liping Liu , Zeyu Chen , Jun Huan

Recent advances have demonstrated the powerful capability of transformer architecture in image restoration. However, our analysis indicates that existing transformerbased methods can not establish both exact global and local dependencies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhijun Tu , Kunpeng Du , Hanting Chen , Hailing Wang , Wei Li , Jie Hu , Yunhe Wang

Deep imitation learning is promising for solving dexterous manipulation tasks because it does not require an environment model and pre-programmed robot behavior. However, its application to dual-arm manipulation tasks remains challenging.…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Hyperspectral image (HSI) denoising is of crucial importance for many subsequent applications, such as HSI classification and interpretation. In this paper, we propose an attention-based deep residual network to directly learn a mapping…

Image and Video Processing · Electrical Eng. & Systems 2020-03-05 Yongsen Zhao , Deming Zhai , Junjun Jiang , Xianming Liu

Transformers use the dense self-attention mechanism which gives a lot of flexibility for long-range connectivity. Over multiple layers of a deep transformer, the number of possible connectivity patterns increases exponentially. However,…

Machine Learning · Computer Science 2023-06-05 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

Deep convolutional neural networks (CNNs) for image denoising can effectively exploit rich hierarchical features and have achieved great success. However, many deep CNN-based denoising models equally utilize the hierarchical features of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Wencong Wu , An Ge , Guannan Lv , Yuelong Xia , Yungang Zhang , Wen Xiong

Light field (LF) images can be used to improve the performance of image super-resolution (SR) because both angular and spatial information is available. It is challenging to incorporate distinctive information from different views for LF…

Image and Video Processing · Electrical Eng. & Systems 2021-11-29 Yu Mo , Yingqian Wang , Chao Xiao , Jungang Yang , Wei An

CNNs and Self attention have achieved great success in multimedia applications for dynamic association learning of self-attention and convolution in image restoration. However, CNNs have at least two shortcomings: 1) limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Kui Jiang , Xuemei Jia , Wenxin Huang , Wenbin Wang , Zheng Wang , Junjun Jiang

In image denoising, deep convolutional neural networks (CNNs) can obtain favorable performance on removing spatially invariant noise. However, many of these networks cannot perform well on removing the real noise (i.e. spatially variant…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Wencong Wu , Shijie Liu , Yi Zhou , Yungang Zhang , Yu Xiang

Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation. However, the prevailing CNN-based approaches have shown limitations in building long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Mingjin Zhang , Chi Zhang , Qiming Zhang , Jie Guo , Xinbo Gao , Jing Zhang

Since convolutional neural networks perform well in learning generalizable image priors from large-scale data, these models have been widely used in image denoising tasks. However, the computational complexity increases dramatically as well…

Image and Video Processing · Electrical Eng. & Systems 2022-07-29 Yuanfan Zhang , Gen Li , Lei Sun

Due to spatial redundancy in remote sensing images, sparse tokens containing rich information are usually involved in self-attention (SA) to reduce the overall token numbers within the calculation, avoiding the high computational cost issue…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Wentao Jiang , Jing Zhang , Di Wang , Qiming Zhang , Zengmao Wang , Bo Du

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

The recently developed transformer networks have achieved impressive performance in image denoising by exploiting the self-attention (SA) in images. However, the existing methods mostly use a relatively small window to compute SA due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Shi Guo , Hongwei Yong , Xindong Zhang , Jianqi Ma , Lei Zhang

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Usman Muhammad , Jorma Laaksonen

Deep learning methods have shown outstanding performance in many applications, including single-image super-resolution (SISR). With residual connection architecture, deeply stacked convolutional neural networks provide a substantial…

Image and Video Processing · Electrical Eng. & Systems 2022-01-02 Karam Park , Jae Woong Soh , Nam Ik Cho

The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led to a growing interest in incorporating the self-attention mechanism and transformer-based architecture into Spiking Neural Networks (SNNs). While…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Xinyu Shi , Zecheng Hao , Zhaofei Yu

Recent years have witnessed the remarkable performance of diffusion models in various vision tasks. However, for image restoration that aims to recover clear images with sharper details from given degraded observations, diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Liyan Wang , Qinyu Yang , Cong Wang , Wei Wang , Jinshan Pan , Zhixun Su

Single image deraining is a crucial problem because rain severely degenerates the visibility of images and affects the performance of computer vision tasks like outdoor surveillance systems and intelligent vehicles. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Hao-Hsiang Yang , Chao-Han Huck Yang , Yu-Chiang Frank Wang

Recently, numerous studies have been conducted on supervised learning-based image denoising methods. However, these methods rely on large-scale noisy-clean image pairs, which are difficult to obtain in practice. Denoising methods with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Young-Joo Han , Ha-Jin Yu