English
Related papers

Related papers: Empowering Image Recovery_ A Multi-Attention Appro…

200 papers

Transformer-based approaches have gained significant attention in image restoration, where the core component, i.e, Multi-Head Attention (MHA), plays a crucial role in capturing diverse features and recovering high-quality results. In MHA,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Shihao Zhou , Dayu Li , Jinshan Pan , Juncheng Zhou , Jinglei Shi , Jufeng Yang

Recently, learning-based approaches for 3D reconstruction from 2D images have gained popularity due to its modern applications, e.g., 3D printers, autonomous robots, self-driving cars, virtual reality, and augmented reality. The computer…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Andrey Salvi , Nathan Gavenski , Eduardo Pooch , Felipe Tasoniero , Rodrigo Barros

In recent years, Transformers-based models have made significant progress in the field of image restoration by leveraging their inherent ability to capture complex contextual features. Recently, Mamba models have made a splash in the field…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Juan Wen , Weiyan Hou , Luc Van Gool , Radu Timofte

Object Detection with Transformers (DETR) and related works reach or even surpass the highly-optimized Faster-RCNN baseline with self-attention network architectures. Inspired by the evidence that pure self-attention possesses a strong…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Wenchi Ma , Tianxiao Zhang , Guanghui Wang

Domain Adaptation (DA) aims to leverage the knowledge learned from a source domain with ample labeled data to a target domain with unlabeled data only. Most existing studies on DA contribute to learning domain-invariant feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xiyu Wang , Pengxin Guo , Yu Zhang

Instance-level image retrieval is the task of searching in a large database for images that match an object in a query image. To address this task, systems usually rely on a retrieval step that uses global image descriptors, and a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Fuwen Tan , Jiangbo Yuan , Vicente Ordonez

Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a fine-grained manner.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hui Chen , Guiguang Ding , Xudong Liu , Zijia Lin , Ji Liu , Jungong Han

Self-similarity refers to the image prior widely used in image restoration algorithms that small but similar patterns tend to occur at different locations and scales. However, recent advanced deep convolutional neural network based methods…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Yiqun Mei , Yuchen Fan , Yulun Zhang , Jiahui Yu , Yuqian Zhou , Ding Liu , Yun Fu , Thomas S. Huang , Humphrey Shi

Image restoration (IR) is challenging due to the complexity of real-world degradations. While many specialized and all-in-one IR models have been developed, they fail to effectively handle complex, mixed degradations. Recent agentic methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xu Jiang , Gehui Li , Bin Chen , Jian Zhang

Long-context understanding is crucial for many NLP applications, yet transformers struggle with efficiency due to the quadratic complexity of self-attention. Sparse attention methods alleviate this cost but often impose static, predefined…

Computation and Language · Computer Science 2025-06-16 Hanzhi Zhang , Heng Fan , Kewei Sha , Yan Huang , Yunhe Feng

Computed tomography (CT) uses X-ray measurements taken from sensors around the body to generate tomographic images of the human body. Conventional reconstruction algorithms can be used if the X-ray data are adequately sampled and of high…

Image and Video Processing · Electrical Eng. & Systems 2021-12-28 Ruiwen Xing , Thomas Humphries , Dong Si

A variety of attention mechanisms have been studied to improve the performance of various computer vision tasks. However, the prior methods overlooked the significance of retaining the information on both channel and spatial aspects to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Yichao Liu , Zongru Shao , Nico Hoffmann

Restoring images affected by various types of degradation, such as noise, blur, or improper exposure, remains a significant challenge in computer vision. While recent trends favor complex monolithic all-in-one architectures, these models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Joanna Wiekiera , Martyna Zur

Local and non-local attention-based methods have been well studied in various image restoration tasks while leading to promising performance. However, most of the existing methods solely focus on one type of attention mechanism (local or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Chong Mou , Jian Zhang , Xiaopeng Fan , Hangfan Liu , Ronggang Wang

Purpose: To develop a deep-learning-based image reconstruction framework for reproducible research in MRI. Methods: The BART toolbox offers a rich set of implementations of calibration and reconstruction algorithms for parallel imaging and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Moritz Blumenthal , Guanxiong Luo , Martin Schilling , H. Christian M. Holme , Martin Uecker

Transformer-based models have emerged as a leading architecture for natural language processing, natural language generation, and image generation tasks. A fundamental element of the transformer architecture is self-attention, which allows…

Machine Learning · Computer Science 2025-07-01 Venmugil Elango

Recent advances have demonstrated the powerful capability of transformer architecture in image restoration. However, our analysis indicates that existing transformerbased methods can not establish both exact global and local dependencies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhijun Tu , Kunpeng Du , Hanting Chen , Hailing Wang , Wei Li , Jie Hu , Yunhe Wang

Multi-image super-resolution (MISR) can achieve higher image quality than single-image super-resolution (SISR) by aggregating sub-pixel information from multiple spatially shifted frames. Among MISR tasks, burst super-resolution (BurstSR)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tengda Huang , Yu Zhang , Tianren Li , Yufu Qu , Fulin Liu , Zhenzhong Wei

Image restoration aims to recover the high-quality images from their degraded observations. Since most existing methods have been dedicated into single degradation removal, they may not yield optimal results on other types of degradations,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Hu Gao , Depeng Dang

Transformer-based approaches have achieved superior performance in image restoration, since they can model long-term dependencies well. However, the limitation in capturing local information restricts their capacity to remove degradations.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shihao Zhou , Duosheng Chen , Jinshan Pan , Jufeng Yang