English
Related papers

Related papers: Estimating Extreme 3D Image Rotation with Transfor…

200 papers

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Attention plays a critical role in human visual experience. Furthermore, it has recently been demonstrated that attention can also play an important role in the context of applying artificial neural networks to a variety of tasks from…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Sergey Zagoruyko , Nikos Komodakis

Transformer-based methods have shown impressive performance in low-level vision tasks, such as image super-resolution. However, we find that these networks can only utilize a limited spatial range of input information through attribution…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Xiangyu Chen , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transformer architectures have been proposed and they show promising…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Pichao Wang , Xue Wang , Fan Wang , Ming Lin , Shuning Chang , Hao Li , Rong Jin

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Usman Muhammad , Jorma Laaksonen

Transformer networks have achieved remarkable success across diverse domains, leveraging a variety of architectural innovations, including residual connections. However, traditional residual connections, which simply sum the outputs of…

Machine Learning · Computer Science 2025-07-25 Mike Heddes , Adel Javanmard , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

The convolutional neural network (CNN) has become a powerful tool for various biomedical image analysis tasks, but there is a lack of visual explanation for the machinery of CNNs. In this paper, we present a novel algorithm,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Guannan Zhao , Bo Zhou , Kaiwen Wang , Rui Jiang , Min Xu

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global spatial-spectral…

Image and Video Processing · Electrical Eng. & Systems 2023-11-30 Shi Chen , Lefei Zhang , Liangpei Zhang

Rotation equivariance is a desirable property in many practical applications such as motion forecasting and 3D perception, where it can offer benefits like sample efficiency, better generalization, and robustness to input perturbations.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Serge Assaad , Carlton Downey , Rami Al-Rfou , Nigamaa Nayakanti , Ben Sapp

Camera pose regression methods apply a single forward pass to the query image to estimate the camera pose. As such, they offer a fast and light-weight alternative to traditional localization schemes based on image retrieval. Pose regression…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yoli Shavit , Ron Ferens , Yosi Keller

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

Attention is a powerful concept in computer vision. End-to-end networks that learn to focus selectively on regions of an image or video often perform strongly. However, other image regions, while not necessarily containing the signal of…

Image and Video Processing · Electrical Eng. & Systems 2020-10-16 Ewa Nowara , Daniel McDuff , Ashok Veeraraghavan

Rotation invariance has been studied in the computer vision community primarily in the context of small in-plane rotations. This is usually achieved by building invariant image features. However, the problem of achieving invariance for…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Lokesh Boominathan , Suraj Srinivas , R. Venkatesh Babu

Following their success in natural language processing, transformers have recently shown much promise for computer vision. The self-attention operation underlying transformers yields global interactions between all tokens ,i.e. words or…

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Bastian Wittmann , Fernando Navarro , Suprosanna Shit , Bjoern Menze

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Chun-Fu Chen , Quanfu Fan , Rameswar Panda

Nonuniform rotational distortion (NURD) correction is vital for endoscopic optical coherence tomography (OCT) imaging and its functional extensions, such as angiography and elastography. Current NURD correction methods require…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Haoran Zhang , Jianlong Yang , Jingqian Zhang , Shiqing Zhao , Aili Zhang

Aiming at the problems that the convolutional neural networks neglect to capture the inherent attributes of natural images and extract features only in a single scale in the field of image super-resolution reconstruction, a network…

Image and Video Processing · Electrical Eng. & Systems 2020-04-09 Jiawen Lyn , Sen Yan

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

The current models of image representation based on Convolutional Neural Networks (CNN) have shown tremendous performance in image retrieval. Such models are inspired by the information flow along the visual pathway in the human visual…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Zakaria Laskar , Juho Kannala