English
Related papers

Related papers: Learning A Sparse Transformer Network for Effectiv…

200 papers

Images taken in dynamic scenes may contain unwanted motion blur, which significantly degrades visual quality. Such blur causes short- and long-range region-specific smoothing artifacts that are often directional and non-uniform, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Fu-Jen Tsai , Yan-Tsung Peng , Yen-Yu Lin , Chung-Chi Tsai , Chia-Wen Lin

The Vision Transformer architecture is a deep learning model inspired by the success of the Transformer model in Natural Language Processing. However, the self-attention mechanism, large number of parameters, and the requirement for a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yogi Prasetyo , Novanto Yudistira , Agus Wahyu Widodo

Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation. However, the prevailing CNN-based approaches have shown limitations in building long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Mingjin Zhang , Chi Zhang , Qiming Zhang , Jie Guo , Xinbo Gao , Jing Zhang

Attention mechanism has been crucial for image diffusion models, however, their quadratic computational complexity limits the sizes of images we can process within reasonable time and memory constraints. This paper investigates the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Ethan Smith , Nayan Saxena , Aninda Saha

In this paper, we propose a very deep fully convolutional encoding-decoding framework for image restoration such as denoising and super-resolution. The network is composed of multiple layers of convolution and de-convolution operators,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

We describe a new class of subsampling techniques for CNNs, termed multisampling, that significantly increases the amount of information kept by feature maps through subsampling layers. One version of our method, which we call checkered…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shayan Sadigh , Pradeep Sen

The audio denoising technique has captured widespread attention in the deep neural network field. Recently, the audio denoising problem has been converted into an image generation task, and deep learning-based approaches have been applied…

Sound · Computer Science 2024-06-14 Junhui Li , Pu Wang , Jialu Li , Youshan Zhang

We study the problem of reconstructing an image from information stored at contour locations. We show that high-quality reconstructions with high fidelity to the source image can be obtained from sparse input, e.g., comprising less than…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Tali Dekel , Chuang Gan , Dilip Krishnan , Ce Liu , William T. Freeman

Given the broad application of infrared technology across diverse fields, there is an increasing emphasis on investigating super-resolution techniques for infrared images within the realm of deep learning. Despite the impressive results of…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Feiwei Qin , Kang Yan , Changmiao Wang , Ruiquan Ge , Yong Peng , Kai Zhang

Pansharpening aims to fuse a registered high-resolution panchromatic image (PAN) with a low-resolution hyperspectral image (LR-HSI) to generate an enhanced HSI with high spectral and spatial resolution. Existing pansharpening approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Wele Gedara Chaminda Bandara , Vishal M. Patel

The global and local contexts significantly contribute to the integrity of predictions in Salient Object Detection (SOD). Unfortunately, existing methods still struggle to generate complete predictions with fine details. There are two major…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Yi Ke Yun , Weisi Lin

We present an effective and efficient method that explores the properties of Transformers in the frequency domain for high-quality image deblurring. Our method is motivated by the convolution theorem that the correlation or convolution of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Lingshun Kong , Jiangxin Dong , Mingqiang Li , Jianjun Ge , Jinshan Pan

Salient object detection on RGB-D images is an active topic in computer vision. Although the existing methods have achieved appreciable performance, there are still some challenges. The locality of convolutional neural network requires that…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xian Fang , Jinshao Zhu , Xiuli Shao , Hongpeng Wang

Learning expressive representations for high-dimensional yet sparse features has been a longstanding problem in information retrieval. Though recent deep learning methods can partially solve the problem, they often fail to handle the…

Information Retrieval · Computer Science 2023-05-30 Kaize Ding , Albert Jiongqian Liang , Bryan Perrozi , Ting Chen , Ruoxi Wang , Lichan Hong , Ed H. Chi , Huan Liu , Derek Zhiyuan Cheng

Under-Display Camera (UDC) is an emerging technology that achieves full-screen display via hiding the camera under the display panel. However, the current implementation of UDC causes serious degradation. The incident light required for…

Image and Video Processing · Electrical Eng. & Systems 2025-03-21 Jingyun Xue , Tao Wang , Pengwen Dai , Kaihao Zhang

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Zhaowen Wang , Ding Liu , Jianchao Yang , Wei Han , Thomas Huang

Nowadays advanced image editing tools and technical skills produce tampered images more realistically, which can easily evade image forensic systems and make authenticity verification of images more difficult. To tackle this challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jing Hao , Zhixin Zhang , Shicai Yang , Di Xie , Shiliang Pu

In image denoising, deep convolutional neural networks (CNNs) can obtain favorable performance on removing spatially invariant noise. However, many of these networks cannot perform well on removing the real noise (i.e. spatially variant…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Wencong Wu , Shijie Liu , Yi Zhou , Yungang Zhang , Yu Xiang

Linearization of attention using various kernel approximation and kernel learning techniques has shown promise. Past methods used a subset of combinations of component functions and weight matrices within the random feature paradigm. We…

Machine Learning · Computer Science 2025-09-24 Duke Nguyen , Du Yin , Aditya Joshi , Flora Salim

The Transformer architecture model, based on self-attention and multi-head attention, has achieved remarkable success in offline end-to-end Automatic Speech Recognition (ASR). However, self-attention and multi-head attention cannot be…

Computation and Language · Computer Science 2022-10-03 Chendong Zhao , Jianzong Wang , Wen qi Wei , Xiaoyang Qu , Haoqian Wang , Jing Xiao