English
Related papers

Related papers: Going deeper with Image Transformers

200 papers

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Large Transformer models routinely achieve state-of-the-art results on a number of tasks but training these models can be prohibitively costly, especially on long sequences. We introduce two techniques to improve the efficiency of…

Machine Learning · Computer Science 2020-02-19 Nikita Kitaev , Łukasz Kaiser , Anselm Levskaya

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

Training deep networks that generalize to a wide range of variations in test data is essential to building accurate and robust image classifiers. One standard strategy is to apply data augmentation to synthetically enlarge the training set.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Yunhan Zhao , Ye Tian , Charless Fowlkes , Wei Shen , Alan Yuille

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

Image harmonization has been significantly advanced with large-scale harmonization dataset. However, the current way to build dataset is still labor-intensive, which adversely affects the extendability of dataset. To address this problem,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Junyan Cao , Wenyan Cong , Li Niu , Jianfu Zhang , Liqing Zhang

Parameter fine tuning is a transfer learning approach whereby learned parameters from pre-trained source network are transferred to the target network followed by fine-tuning. Prior research has shown that this approach is capable of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tasfia Shermin , Shyh Wei Teng , Manzur Murshed , Guojun Lu , Ferdous Sohel , Manoranjan Paul

Although automatic shot transition detection approaches are already investigated for more than two decades, an effective universal human-level model was not proposed yet. Even for common shot transitions like hard cuts or simple gradual…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Tomáš Souček , Jakub Lokoč

Semantic segmentation necessitates approaches that learn high-level characteristics while dealing with enormous amounts of data. Convolutional neural networks (CNNs) can learn unique and adaptive features to achieve this aim. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hasan AlMarzouqi , Lyes Saad Saoud

In recent years, deep learning networks have made remarkable strides in the domain of multi-exposure image fusion. Nonetheless, prevailing approaches often involve directly feeding over-exposed and under-exposed images into the network,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Pan Mu , Zhiying Du , Jinyuan Liu , Cong Bai

Images captured in challenging environments often experience various forms of degradation, including noise, color cast, blur, and light scattering. These effects significantly reduce image quality, hindering their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Abbas Anwar , Mohammad Shullar , Ali Arshad Nasir , Mudassir Masood , Saeed Anwar

Modern neural networks are over-parameterized and thus rely on strong regularization such as data augmentation and weight decay to reduce overfitting and improve generalization. The dominant form of data augmentation applies invariant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Yang Liu , Shen Yan , Laura Leal-Taixé , James Hays , Deva Ramanan

Deformable medical image registration plays an important role in clinical diagnosis and treatment. Recently, the deep learning (DL) based image registration methods have been widely investigated and showed excellent performance in…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yibo Wang , Wen Qian , Xuming Zhang

We propose an end-to-end image compression and analysis model with Transformers, targeting to the cloud-based image classification application. Instead of placing an existing Transformer-based image classification model directly after an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yuanchao Bai , Xu Yang , Xianming Liu , Junjun Jiang , Yaowei Wang , Xiangyang Ji , Wen Gao

Recently, pure transformer-based models have shown great potentials for vision tasks such as image classification and detection. However, the design of transformer networks is challenging. It has been observed that the depth, embedding…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Minghao Chen , Houwen Peng , Jianlong Fu , Haibin Ling

Deep generative models have become increasingly effective at producing realistic images from randomly sampled seeds, but using such models for controllable manipulation of existing images remains challenging. We propose the Swapping…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Taesung Park , Jun-Yan Zhu , Oliver Wang , Jingwan Lu , Eli Shechtman , Alexei A. Efros , Richard Zhang

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Zhaowen Wang , Ding Liu , Jianchao Yang , Wei Han , Thomas Huang

The powerful representation capacity of deep learning has made it inevitable for the underwater image enhancement community to employ its potential. The exploration of deep underwater image enhancement networks is increasing over time, and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Saeed Anwar , Chongyi Li

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen