English
Related papers

Related papers: Exploring Sparse MoE in GANs for Text-conditioned …

200 papers

We propose a novel approach for generating unrestricted adversarial examples by manipulating fine-grained aspects of image generation. Unlike existing unrestricted attacks that typically hand-craft geometric transformations, we learn…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Omid Poursaeed , Tianxing Jiang , Yordanos Goshu , Harry Yang , Serge Belongie , Ser-Nam Lim

To generate new images for a given category, most deep generative models require abundant training images from this category, which are often too expensive to acquire. To achieve the goal of generation based on only a few images, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Yan Hong , Li Niu , Jianfu Zhang , Liqing Zhang

In this research, we introduce an innovative method for synthesizing medical images using generative adversarial networks (GANs). Our proposed GANs method demonstrates the capability to produce realistic synthetic images even when trained…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Yinqiu Feng , Bo Zhang , Lingxi Xiao , Yutian Yang , Tana Gegen , Zexi Chen

Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has demonstrated a great promise to enable high-accuracy and ultra-efficient model inference. Despite the growing popularity of MoE, little work investigated its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yihua Zhang , Ruisi Cai , Tianlong Chen , Guanhua Zhang , Huan Zhang , Pin-Yu Chen , Shiyu Chang , Zhangyang Wang , Sijia Liu

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

In recent years, deep neural networks have been utilized in a wide variety of applications including image generation. In particular, generative adversarial networks (GANs) are able to produce highly realistic pictures as part of tasks such…

Image and Video Processing · Electrical Eng. & Systems 2020-04-20 Hyunsuk Ko , Dae Yeol Lee , Seunghyun Cho , Alan C. Bovik

Text-to-Image generation in the general domain has long been an open problem, which requires both a powerful generative model and cross-modal understanding. We propose CogView, a 4-billion-parameter Transformer with VQ-VAE tokenizer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Ming Ding , Zhuoyi Yang , Wenyi Hong , Wendi Zheng , Chang Zhou , Da Yin , Junyang Lin , Xu Zou , Zhou Shao , Hongxia Yang , Jie Tang

Synthesizing high resolution photorealistic images has been a long-standing challenge in machine learning. In this paper we introduce new methods for the improved training of generative adversarial networks (GANs) for image synthesis. We…

Machine Learning · Statistics 2017-07-24 Augustus Odena , Christopher Olah , Jonathon Shlens

Generative Adversarial Networks (GANs) have received a great deal of attention due in part to recent success in generating original, high-quality samples from visual domains. However, most current methods only allow for users to guide this…

Graphics · Computer Science 2019-04-05 Eric Heim

Synthetic data has a key role to play in data sharing by statistical agencies and other generators of statistical data products. Generative Adversarial Networks (GANs), typically applied to image synthesis, are also a promising method for…

Machine Learning · Computer Science 2024-04-17 Nian Ran , Bahrul Ilmi Nasution , Claire Little , Richard Allmendinger , Mark Elliot

Mixture-of-experts (MoE) is becoming popular due to its success in improving the model quality, especially in Transformers. By routing tokens with a sparse gate to a few experts (i.e., a small pieces of the full model), MoE can easily…

Machine Learning · Computer Science 2022-10-11 Xiaonan Nie , Xupeng Miao , Shijie Cao , Lingxiao Ma , Qibin Liu , Jilong Xue , Youshan Miao , Yi Liu , Zhi Yang , Bin Cui

Sparsely-activated Mixture-of-Experts (SMoE) models offer efficient pre-training and low latency but their large parameter counts create significant memory overhead, motivating research into expert compression. Contrary to recent findings…

Machine Learning · Computer Science 2026-05-14 Mike Lasby , Ivan Lazarevich , Nish Sinnadurai , Sean Lie , Yani Ioannou , Vithursan Thangarasa

For optical coherence tomography angiography (OCTA) images, a limited scanning rate leads to a trade-off between field-of-view (FOV) and imaging resolution. Although larger FOV images may reveal more parafoveal vascular lesions, their…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Weiwen Zhang , Dawei Yang , Haoxuan Che , An Ran Ran , Carol Y. Cheung , Hao Chen

This paper presents an energy-efficient stable diffusion processor for text-to-image generation. While stable diffusion attained attention for high-quality image synthesis results, its inherent characteristics hinder its deployment on…

Hardware Architecture · Computer Science 2024-09-24 Jiwon Choi , Wooyoung Jo , Seongyon Hong , Beomseok Kwon , Wonhoon Park , Hoi-Jun Yoo

In this paper, we propose in our novel generative framework the use of Generative Adversarial Networks (GANs) to generate features that provide robustness for object detection on reduced quality images. The proposed GAN-based Detection of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Charan D. Prakash , Lina J. Karam

Generative Adversarial Networks (GANs) have become predominant in image generation tasks. Their success is attributed to the training regime which employs two models: a generator G and discriminator D that compete in a minimax zero sum…

Machine Learning · Computer Science 2020-11-25 Ariel Ruiz-Garcia , Ibrahim Almakky , Vasile Palade , Luke Hicks

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32x32), and…

Machine Learning · Computer Science 2020-10-27 Yang Song , Stefano Ermon

With the widespread adoption of Large Language Models (LLMs), many deep learning practitioners are looking for strategies of running these models more efficiently. One such strategy is to use sparse Mixture-of-Experts (MoE) - a type of…

Machine Learning · Computer Science 2023-12-29 Artyom Eliseev , Denis Mazur

Mixture-of-Experts (MoE) networks have been proposed as an efficient way to scale up model capacity and implement conditional computing. However, the study of MoE components mostly focused on the feedforward layer in Transformer…

Computation and Language · Computer Science 2022-10-12 Xiaofeng Zhang , Yikang Shen , Zeyu Huang , Jie Zhou , Wenge Rong , Zhang Xiong

Semantic image synthesis, i.e., generating images from user-provided semantic label maps, is an important conditional image generation task as it allows to control both the content as well as the spatial layout of generated images. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Tariq Berrada , Jakob Verbeek , Camille Couprie , Karteek Alahari