English
Related papers

Related papers: Combining Transformer Generators with Convolutiona…

200 papers

Disentangled generative models map a latent code vector to a target space, while enforcing that a subset of the learned latent codes are interpretable and associated with distinct properties of the target distribution. Recent advances have…

Machine Learning · Computer Science 2020-08-10 Zinan Lin , Kiran Koshy Thekumparampil , Giulia Fanti , Sewoong Oh

Although convolutional networks (ConvNets) have enjoyed great success in computer vision (CV), it suffers from capturing global information crucial to dense prediction tasks such as object detection and segmentation. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Haotian Yan , Zhe Li , Weijian Li , Changhu Wang , Ming Wu , Chuang Zhang

Generative Adversarial Networks (GAN) are cutting-edge algorithms for generating new data samples based on the learned data distribution. However, its performance comes at a significant cost in terms of computation and memory requirements.…

Machine Learning · Computer Science 2022-01-25 Azzam Alhussain , Mingjie Lin

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

Machine Learning · Computer Science 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao

Region proposal based methods like R-CNN and Faster R-CNN models have proven to be extremely successful in object detection and segmentation tasks. Recently, Transformers have also gained popularity in the domain of Computer Vision, and are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Deepanshu Pandey , Pradyumna Gupta , Sumit Bhattacharya , Aman Sinha , Rohit Agarwal

The biggest challenge faced by a Machine Learning Engineer is the lack of data they have, especially for 2-dimensional images. The image is processed to be trained into a Machine Learning model so that it can recognize patterns in the data…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Anugrah Akbar Praramadhan , Guntur Eka Saputra

Discriminator plays a vital role in training generative adversarial networks (GANs) via distinguishing real and synthesized samples. While the real data distribution remains the same, the synthesis distribution keeps varying because of the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Ceyuan Yang , Yujun Shen , Yinghao Xu , Deli Zhao , Bo Dai , Bolei Zhou

In this paper, we propose a novel generative model named Stacked Generative Adversarial Networks (SGAN), which is trained to invert the hierarchical representations of a bottom-up discriminative network. Our model consists of a top-down…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Xun Huang , Yixuan Li , Omid Poursaeed , John Hopcroft , Serge Belongie

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

Generative Adversarial Networks (GANs) have been widely-used in image translation, but their high computation and storage costs impede the deployment on mobile devices. Prevalent methods for CNN compression cannot be directly applied to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Shaojie Li , Mingbao Lin , Yan Wang , Fei Chao , Ling Shao , Rongrong Ji

Generative Adversarial Networks (GANs) have gained significant attention in several computer vision tasks for generating high-quality synthetic data. Various medical applications including diagnostic imaging and radiation therapy can…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

Generative adversarial network (GAN) is one of the widely-adopted machine-learning frameworks for a wide range of applications such as generating high-quality images, video, and audio contents. However, training a GAN could become…

Quantum Physics · Physics 2024-02-06 Runqiu Shu , Xusheng Xu , Man-Hong Yung , Wei Cui

In this paper, an image recognition algorithm based on the combination of deep learning and generative adversarial network (GAN) is studied, and compared with traditional image recognition methods. The purpose of this study is to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yihao Zhong , Yijing Wei , Yingbin Liang , Xiqing Liu , Rongwei Ji , Yiru Cang

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Soumik Mukhopadhyay , Matthew Gwilliam , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Srinidhi Hegde , Tianyi Zhou , Abhinav Shrivastava

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Systems that perform image manipulation using deep convolutional networks have achieved remarkable realism. Perceptual losses and losses based on adversarial discriminators are the two main classes of learning objectives behind these…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Diana Sungatullina , Egor Zakharov , Dmitry Ulyanov , Victor Lempitsky

Federated learning is an emerging research paradigm enabling collaborative training of machine learning models among different organizations while keeping data private at each institution. Despite recent progress, there remain fundamental…

Machine Learning · Computer Science 2022-04-15 Liangqiong Qu , Yuyin Zhou , Paul Pu Liang , Yingda Xia , Feifei Wang , Ehsan Adeli , Li Fei-Fei , Daniel Rubin

In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as…

Machine Learning · Statistics 2019-06-18 Han Zhang , Ian Goodfellow , Dimitris Metaxas , Augustus Odena

Novelty detection, a widely studied problem in machine learning, is the problem of detecting a novel class of data that has not been previously observed. A common setting for novelty detection is inductive whereby only examples of the…

Machine Learning · Computer Science 2022-03-31 Najiba Toron , Janaina Mourao-Miranda , John Shawe-Taylor