English
Related papers

Related papers: Learning A Sparse Transformer Network for Effectiv…

200 papers

Single image deraining is an important and challenging task for some downstream artificial intelligence applications such as video surveillance and self-driving systems. Most of the existing deep-learning-based methods constrain the network…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Cong Wang , Jinshan Pan , Xiao-Ming Wu

Since convolutional neural networks perform well in learning generalizable image priors from large-scale data, these models have been widely used in image denoising tasks. However, the computational complexity increases dramatically as well…

Image and Video Processing · Electrical Eng. & Systems 2022-07-29 Yuanfan Zhang , Gen Li , Lei Sun

Convolutional neural networks (CNNs) depend on deep network architectures to extract accurate information for image super-resolution. However, obtained information of these CNNs cannot completely express predicted high-quality images for…

Image and Video Processing · Electrical Eng. & Systems 2024-03-25 Chunwei Tian , Xuanyu Zhang , Qi Zhang , Mingming Yang , Zhaojie Ju

It is challenging to remove rain-steaks from a single rainy image because the rain steaks are spatially varying in the rainy image. Although the CNN based methods have reported promising performance recently, there are still some defects,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Chaobing Zheng , Jun Jiang , Wenjian Ying , Shiqian Wu

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Networks (DenseNet), have achieved great success for image representation by discovering deep hierarchical information. However, most existing networks simply stacks the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Zhao Zhang , Zemin Tang , Yang Wang , Zheng Zhang , Choujun Zhan , Zhengjun Zha , Meng Wang

Recently, image restoration transformers have achieved comparable performance with previous state-of-the-art CNNs. However, how to efficiently leverage such architectures remains an open problem. In this work, we present Dual-former whose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Sixiang Chen , Tian Ye , Yun Liu , Erkang Chen

The increasing availability of advanced image editing tools has led to a significant rise in manipulated digital content, posing serious challenges for digital forensics and information security. This study presents a transfer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Fatma Betul Buyuk , Gozde Karatas Baydogmus , Ali Buldu , Ayaulym Tulendiyeva , Zhuldyz Baizhumanova

How to effectively explore multi-scale representations of rain streaks is important for image deraining. In contrast to existing Transformer-based methods that depend mostly on single-scale rain appearance, we develop an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiang Chen , Jinshan Pan , Jiangxin Dong

Recently Transformers have provided state-of-the-art performance in sparse matching, crucial to realize high-performance 3D vision applications. Yet, these Transformers lack efficiency due to the quadratic computational complexity of their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Suwichaya Suwanwimolkul , Satoshi Komorita

Convolutional neural network has recently achieved great success for image restoration (IR) and also offered hierarchical features. However, most deep CNN based IR models do not make full use of the hierarchical features from the original…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Yulun Zhang , Yapeng Tian , Yu Kong , Bineng Zhong , Yun Fu

Transformer-based methods have achieved remarkable results in image super-resolution tasks because they can capture non-local dependencies in low-quality input images. However, this feature-intensive modeling approach is computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wei Long , Xingyu Zhou , Leheng Zhang , Shuhang Gu

Deep convolutional neural networks (CNNs) depend on feedforward and feedback ways to obtain good performance in image denoising. However, how to obtain effective structural information via CNNs to efficiently represent given noisy images is…

Image and Video Processing · Electrical Eng. & Systems 2023-10-17 Chunwei Tian , Menghua Zheng , Wangmeng Zuo , Shichao Zhang , Yanning Zhang , Chia-Wen Ling

Different rain models and novel network structures have been proposed to remove rain streaks from single rainy images. In this work, we bring attention to the intrinsic priors and multi-scale features of the rainy images, and develop…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Yinglong Wang , Chao Ma , Bing Zeng

Sparsifying the Transformer has garnered considerable interest, as training the Transformer is very computationally demanding. Prior efforts to sparsify the Transformer have either used a fixed pattern or data-driven approach to reduce the…

Machine Learning · Computer Science 2023-09-25 Bokyeong Yoon , Yoonsang Han , Gordon Euhyun Moon

Currently, this paper is under review in IEEE. Transformers have intrigued the vision research community with their state-of-the-art performance in natural language processing. With their superior performance, transformers have found their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Preetam Ghosh , Swalpa Kumar Roy , Bikram Koirala , Behnood Rasti , Paul Scheunders

To accelerate deep CNN models, this paper proposes a novel spatially adaptive framework that can dynamically generate pixel-wise sparsity according to the input image. The sparse scheme is pixel-wise refined, regional adaptive under a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Chen Tang , Wenyu Sun , Zhuqing Yuan , Yongpan Liu

In the real world, image degradations caused by rain often exhibit a combination of rain streaks and raindrops, thereby increasing the challenges of recovering the underlying clean image. Note that the rain streaks and raindrops have…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Sixiang Chen , Tian Ye , Jinbin Bai , Erkang Chen , Jun Shi , Lei Zhu

Fine-grained image recognition is challenging because discriminative clues are usually fragmented, whether from a single image or multiple images. Despite their significant improvements, most existing methods still focus on the most…

Multimedia · Computer Science 2022-06-07 Xinda Liu , Lili Wang , Xiaoguang Han

Image deraining plays a pivotal role in low-level computer vision, serving as a prerequisite for robust outdoor surveillance and autonomous driving systems. While deep learning paradigms have achieved remarkable success in firmly aligned…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Kangbo Zhao , Miaoxin Guan , Xiang Chen , Yukai Shi , Jinshan Pan

Despite strong empirical performance for image classification, deep neural networks are often regarded as ``black boxes'' and they are difficult to interpret. On the other hand, sparse convolutional models, which assume that a signal can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xili Dai , Mingyang Li , Pengyuan Zhai , Shengbang Tong , Xingjian Gao , Shao-Lun Huang , Zhihui Zhu , Chong You , Yi Ma