English
Related papers

Related papers: Taming Transformers for High-Resolution Image Synt…

200 papers

It is commonly agreed that the use of relevant invariances as a good statistical bias is important in machine-learning. However, most approaches that explicitly incorporate invariances into a model architecture only make use of very simple…

Machine Learning · Computer Science 2017-11-01 Yannic Kilcher , Gary Becigneul , Thomas Hofmann

Transformer emerges as a powerful tool for visual recognition. In addition to demonstrating competitive performance on a broad range of visual benchmarks, recent works also argue that Transformers are much more robust than Convolutions…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Yutong Bai , Jieru Mei , Alan Yuille , Cihang Xie

This project aims to create an automated image captioning system that generates natural language descriptions for input images by integrating techniques from computer vision and natural language processing. We employ various different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Joshua Adrian Cahyono , Jeremy Nathan Jusuf

Existing image-to-image transformation approaches primarily focus on synthesizing visually pleasing data. Generating images with correct identity labels is challenging yet much less explored. It is even more challenging to deal with image…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wei Xiong , Yutong He , Yixuan Zhang , Wenhan Luo , Lin Ma , Jiebo Luo

We show how transformers can be used to vastly simplify neural video compression. Previous methods have been relying on an increasing number of architectural biases and priors, including motion prediction and warping operations, resulting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Fabian Mentzer , George Toderici , David Minnen , Sung-Jin Hwang , Sergi Caelles , Mario Lucic , Eirikur Agustsson

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

We present recurrent transformer networks (RTNs) for obtaining dense correspondences between semantically similar images. Our networks accomplish this through an iterative process of estimating spatial transformations between the input…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Seungryong Kim , Stephen Lin , Sangryul Jeon , Dongbo Min , Kwanghoon Sohn

Neural networks have proven their capabilities by outperforming many other approaches on regression or classification tasks on various kinds of data. Other astonishing results have been achieved using neural nets as data generators,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Andrej Junginger , Markus Hanselmann , Thilo Strauss , Sebastian Boblest , Jens Buchner , Holger Ulmer

In the field of deep learning, large architectures often obtain the best performance for many tasks, but also require massive datasets. In the histological domain, tissue images are expensive to obtain and constitute sensitive medical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Andrei-Alexandru Preda , Iulian-Marius Tăiatu , Dumitru-Clementin Cercel

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance on a variety of computer vision tasks, particularly visual classification problems, where new algorithms reported to achieve or even surpass the human…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Hossein Hosseini , Baicen Xiao , Mayoore Jaiswal , Radha Poovendran

Unpaired image-to-image translation is to translate an image from a source domain to a target domain without paired training data. By utilizing CNN in extracting local semantics, various techniques have been developed to improve the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Wanfeng Zheng , Qiang Li , Guoxin Zhang , Pengfei Wan , Zhongyuan Wang

Transformer is a deep neural network that employs a self-attention mechanism to comprehend the contextual relationships within sequential data. Unlike conventional neural networks or updated versions of Recurrent Neural Networks (RNNs) such…

Machine Learning · Computer Science 2023-06-14 Saidul Islam , Hanae Elmekki , Ahmed Elsebai , Jamal Bentahar , Najat Drawel , Gaith Rjoub , Witold Pedrycz

Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or text descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Renato Sortino , Simone Palazzo , Concetto Spampinato

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learning long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Reza Azad , Amirhossein Kazerouni , Moein Heidari , Ehsan Khodapanah Aghdam , Amirali Molaei , Yiwei Jia , Abin Jose , Rijo Roy , Dorit Merhof

Transfer learning makes it possible to use large vision networks on a variety of domains, by specializing their models' general filters to new tasks. However, these networks assume the input images to have 3 input channels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Mariette Schönfeld , Laurens Devos , Wannes Meert , Hendrik Blockeel

Recently, convolutional neural networks (CNN) have been successfully applied to view synthesis problems. However, such CNN-based methods can suffer from lack of texture details, shape distortions, or high computational complexity. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-03-08 Dinghuang Ji , Junghyun Kwon , Max McFarland , Silvio Savarese

Vision Transformers (VTs) are becoming a valuable alternative to Convolutional Neural Networks (CNNs) when it comes to problems involving high-dimensional and spatially organized inputs such as images. However, their Transfer Learning (TL)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Vincent Tonkes , Matthia Sabatelli

Vision transformers have been successfully applied to image recognition tasks due to their ability to capture long-range dependencies within an image. However, there are still gaps in both performance and computational cost between…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Xinghao Chen , Yunhe Wang , Chang Xu

Transform and entropy models are the two core components in deep image compression neural networks. Most existing learning-based image compression methods utilize convolutional-based transform, which lacks the ability to model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Atefeh Khoshkhahtinat , Ali Zafari , Piyush M. Mehta , Mohammad Akyash , Hossein Kashiani , Nasser M. Nasrabadi