English
Related papers

Related papers: DARTS: Double Attention Reference-based Transforme…

200 papers

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique used in transformer…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Abhisek Ray , Gaurav Kumar , Maheshkumar H. Kolekar

Most models of visual attention aim at predicting either top-down or bottom-up control, as studied using different visual search and free-viewing tasks. In this paper we propose the Human Attention Transformer (HAT), a single model that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhibo Yang , Sounak Mondal , Seoyoung Ahn , Ruoyu Xue , Gregory Zelinsky , Minh Hoai , Dimitris Samaras

The Transformer translation model is based on the multi-head attention mechanism, which can be parallelized easily. The multi-head attention network performs the scaled dot-product attention function in parallel, empowering the model by…

Computation and Language · Computer Science 2021-09-13 Hongfei Xu , Qiuhui Liu , Josef van Genabith , Deyi Xiong

Convolutional Neural Networks (CNNs) have been consistently proved state-of-the-art results in image Super-Resolution (SR), representing an exceptional opportunity for the remote sensing field to extract further information and knowledge…

Image and Video Processing · Electrical Eng. & Systems 2020-11-02 Francesco Salvetti , Vittorio Mazzia , Aleem Khaliq , Marcello Chiaberge

Transformer architectures have exhibited remarkable performance in image super-resolution (SR). Since the quadratic computational complexity of the self-attention (SA) in Transformer, existing methods tend to adopt SA in a local region to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zheng Chen , Yulun Zhang , Jinjin Gu , Linghe Kong , Xiaokang Yang

Single image super resolution is of great importance as a low-level computer vision task. Recent approaches with deep convolutional neural networks have achieved im-pressive performance. However, existing architectures have limitations due…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Xi Cheng , Xiang Li , Jian Yang

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

This work introduced a novel GAN architecture for unsupervised image translation on the task of face style transform. A spectral attention-based mechanism is embedded into the design along with spatial attention on the image contents. We…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qizhou Wang , Maksim Makarenko

Hyperspectral image super-resolution is essential for enhancing the spatial fidelity of HSI data, yet existing deep learning methods often struggle with substantial spectral redundancy and the limited non-linear modeling capacity of…

Image and Video Processing · Electrical Eng. & Systems 2026-05-01 Tengya Zhang , Feng Gao , Lin Qi , Junyu Dong , Qian Du

Change detection, which aims to distinguish surface changes based on bi-temporal images, plays a vital role in ecological protection and urban planning. Since high resolution (HR) images cannot be typically acquired continuously over time,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Mengxi Liu , Qian Shi , Andrea Marinoni , Da He , Xiaoping Liu , Liangpei Zhang

In most recent years, deep convolutional neural networks (DCNNs) based image super-resolution (SR) has gained increasing attention in multimedia and computer vision communities, focusing on restoring the high-resolution (HR) image from a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Jingcai Guo , Shiheng Ma , Song Guo

Given the wide and ever growing range of different efficient Transformer attention mechanisms, it is important to identify which attention is most effective when given a task. In this work, we are also interested in combining different…

Machine Learning · Computer Science 2022-10-04 Jason Ross Brown , Yiren Zhao , Ilia Shumailov , Robert D Mullins

Recently, deep learning based single image super-resolution(SR) approaches have achieved great development. The state-of-the-art SR methods usually adopt a feed-forward pipeline to establish a non-linear mapping between low-res(LR) and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Jinghui Qin , Ziwei Xie , Yukai Shi , Wushao Wen

By integrating certain optimization solvers with deep neural networks, deep unfolding network (DUN) with good interpretability and high performance has attracted growing attention in compressive sensing (CS). However, existing DUNs often…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Jiechong Song , Chong Mou , Shiqi Wang , Siwei Ma , Jian Zhang

In this paper, we consider two challenging issues in reference-based super-resolution (RefSR), (i) how to choose a proper reference image, and (ii) how to learn real-world RefSR in a self-supervised manner. Particularly, we present a novel…

Image and Video Processing · Electrical Eng. & Systems 2022-07-21 Zhilu Zhang , Ruohao Wang , Hongzhi Zhang , Yunjin Chen , Wangmeng Zuo

We present a novel approach to reference-based super-resolution (RefSR) with the focus on dual-camera super-resolution (DCSR), which utilizes reference images for high-quality and high-fidelity results. Our proposed method generalizes the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Tengfei Wang , Jiaxin Xie , Wenxiu Sun , Qiong Yan , Qifeng Chen

Since context modeling is critical for estimating depth from a single image, researchers put tremendous effort into obtaining global context. Many global manipulations are designed for traditional CNN-based architectures to overcome the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Chang Shu , Ziming Chen , Lei Chen , Kuan Ma , Minghui Wang , Haibing Ren

Deep Convolutional Neural Networks (DCNNs) have achieved impressive performance in Single Image Super-Resolution (SISR). To further improve the performance, existing CNN-based methods generally focus on designing deeper architecture of the…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Wenjie Ai , Xiaoguang Tu , Shilei Cheng , Mei Xie

Jet tagging is a crucial classification task in high energy physics. Recently the performance of jet tagging has been significantly improved by the application of deep learning techniques. In this study, we introduce a new architecture for…

High Energy Physics - Phenomenology · Physics 2023-11-29 Minxuan He , Daohan Wang

Unsupervised image translation aims to learn the transformation from a source domain to another target domain given unpaired training data. Several state-of-the-art works have yielded impressive results in the GANs-based unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Taewon Kang , Kwang Hee Lee