English
Related papers

Related papers: AMPA-Net: Optimization-Inspired Attention Neural N…

200 papers

Tomographic SAR technique has attracted remarkable interest for its ability of three-dimensional resolving along the elevation direction via a stack of SAR images collected from different cross-track angles. The emerged compressed sensing…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Muhan Wang , Zhe Zhang , Xiaolan Qiu , Silin Gao , Yue Wang

This paper proposes a novel Attention-based Multi-Reference Super-resolution network (AMRSR) that, given a low-resolution image, learns to adaptively transfer the most similar texture from multiple reference images to the super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Marco Pesavento , Marco Volino , Adrian Hilton

Attention Mechanism is a widely used method for improving the performance of convolutional neural networks (CNNs) on computer vision tasks. Despite its pervasiveness, we have a poor understanding of what its effectiveness stems from. It is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xiang Ye , Zihang He , Heng Wang , Yong Li

Scene-dependent adaptive compressive sensing (CS) has been a long pursuing goal which has huge potential in significantly improving the performance of CS. However, without accessing to the ground truth image, how to design the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chenxi Qiu , Tao Yue , Xuemei Hu

We introduce a theoretical approach for designing generalizations of the approximate message passing (AMP) algorithm for compressed sensing which are valid for large observation matrices that are drawn from an invariant random matrix…

Information Theory · Computer Science 2017-05-12 Burak Çakmak , Manfred Opper , Ole Winther , Bernard H. Fleury

Semantic matching is of central significance to the answer selection task which aims to select correct answers for a given question from a candidate answer pool. A useful method is to employ neural networks with attention to generate…

Computation and Language · Computer Science 2021-05-10 Jie Huang

The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led to a growing interest in incorporating the self-attention mechanism and transformer-based architecture into Spiking Neural Networks (SNNs). While…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Xinyu Shi , Zecheng Hao , Zhaofei Yu

Light field photography has been studied thoroughly in recent years. One of its drawbacks is the need for multi-lens in the imaging. To compensate that, compressed light field photography has been proposed to tackle the trade-offs between…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Ofir Nabati , David Mendlovic , Raja Giryes

Compressed video action recognition has recently drawn growing attention, since it remarkably reduces the storage and computational cost via replacing raw videos by sparsely sampled RGB frames and compressed motion cues (e.g., motion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Bing Li , Jiaxin Chen , Dongming Zhang , Xiuguo Bao , Di Huang

Deep neural networks with short residual connections have demonstrated remarkable success across domains, but increasing depth often introduces computational redundancy without corresponding improvements in representation quality. We…

Machine Learning · Computer Science 2025-11-10 Vaggelis Dorovatas , Georgios Paraskevopoulos , Alexandros Potamianos

Approximate message passing (AMP) is an efficient iterative signal recovery algorithm for compressed sensing (CS). For sensing matrices with independent and identically distributed (i.i.d.) Gaussian entries, the behavior of AMP can be…

Information Theory · Computer Science 2016-10-20 Zhipeng Xue , Junjie Ma , Xiaojun Yuan

This paper proposes Bayes-optimal convolutional approximate message-passing (CAMP) for signal recovery in compressed sensing. CAMP uses the same low-complexity matched filter (MF) for interference suppression as approximate message-passing…

Information Theory · Computer Science 2021-04-05 Keigo Takeuchi

We consider network-based decentralized optimization problems, where each node in the network possesses a local function and the objective is to collectively attain a consensus solution that minimizes the sum of all the local functions. A…

Optimization and Control · Mathematics 2023-09-07 Suhail M. Shah , Albert S. Berahas , Raghu Bollapragada

Convolutional Neural Networks (CNN) are more suitable, indeed. However, fixed kernel sizes make traditional CNN too specific, neither flexible nor conducive to feature learning, thus impacting on the classification accuracy. The convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Muhammad Ahmad , Adil Mehmood Khan , Manuel Mazzara , Salvatore Distefano , Swalpa Kumar Roy , Xin Wu

The deep convolutional neural networks have achieved significant improvements in accuracy and speed for single image super-resolution. However, as the depth of network grows, the information flow is weakened and the training becomes harder…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Yanting Hu , Xinbo Gao , Jie Li , Yuanfei Huang , Hanzi Wang

Single image super-resolution is an effective way to enhance the spatial resolution of remote sensing image, which is crucial for many applications such as target detection and image classification. However, existing methods based on the…

Image and Video Processing · Electrical Eng. & Systems 2020-11-22 Wenjia Xu , Guangluan Xu , Yang Wang , Xian Sun , Daoyu Lin , Yirong Wu

In the past decade, Convolutional Neural Networks (CNNs) and Transformers have achieved wide applicaiton in semantic segmentation tasks. Although CNNs with Transformer models greatly improve performance, the global context modeling remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Feixiang Du , Shengkun Wu

Semantic segmentation of remote sensing images is essential for various applications, including vegetation monitoring, disaster management, and urban planning. Previous studies have demonstrated that the self-attention mechanism (SA) is an…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Wei Long , Yongjun Zhang , Zhongwei Cui , Yujie Xu , Xuexue Zhang

Deep networks have achieved remarkable success in image compressed sensing (CS) task, namely reconstructing a high-fidelity image from its compressed measurement. However, existing works are deficient inincoherent compressed measurement at…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Gang Qu , Ping Wang , Siming Zheng , Xin Yuan

Recent work showed neural-network-based approaches to reconstructing images from compressively sensed measurements offer significant improvements in accuracy and signal compression. Such methods can dramatically boost the capability of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Fangliang Bai , Jinchao Liu , Xiaojuan Liu , Margarita Osadchy , Chao Wang , Stuart J. Gibson