English
Related papers

Related papers: Exploring Sparse MoE in GANs for Text-conditioned …

200 papers

Sparse mixture of expert architectures (MoEs) scale model capacity without significant increases in training or inference costs. Despite their success, MoEs suffer from a number of issues: training instability, token dropping, inability to…

Machine Learning · Computer Science 2024-05-28 Joan Puigcerver , Carlos Riquelme , Basil Mustafa , Neil Houlsby

Unconditional image generation has recently been dominated by generative adversarial networks (GANs). GAN methods train a generator which regresses images from random noise vectors, as well as a discriminator that attempts to differentiate…

Machine Learning · Computer Science 2018-12-24 Yedid Hoshen , Jitendra Malik

AI technologies have become more widely adopted in wireless communications. As an emerging type of AI technologies, the generative artificial intelligence (GAI) gains lots of attention in communication security. Due to its powerful learning…

Cryptography and Security · Computer Science 2024-05-08 Changyuan Zhao , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim , Xuemin , Shen , Khaled B. Letaief

Training Generative Adversarial Networks (GAN) on high-fidelity images usually requires large-scale GPU-clusters and a vast number of training images. In this paper, we study the few-shot image synthesis task for GAN with minimum computing…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Bingchen Liu , Yizhe Zhu , Kunpeng Song , Ahmed Elgammal

Mixture-of-Experts (MoE) models can achieve promising results with outrageous large amount of parameters but constant computation cost, and thus it has become a trend in model scaling. Still it is a mystery how MoE layers bring quality…

Machine Learning · Computer Science 2021-08-10 An Yang , Junyang Lin , Rui Men , Chang Zhou , Le Jiang , Xianyan Jia , Ang Wang , Jie Zhang , Jiamang Wang , Yong Li , Di Zhang , Wei Lin , Lin Qu , Jingren Zhou , Hongxia Yang

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Diffusion Transformer (DiT) has demonstrated remarkable performance in text-to-image generation; however, its large parameter size results in substantial inference overhead. Existing parameter compression methods primarily focus on pruning,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Youwei Zheng , Yuxi Ren , Xin Xia , Xuefeng Xiao , Xiaohua Xie

Generative Adversarial Networks (GANs) have long been used to understand the semantic relationship between the text and image. However, there are problems with mode collapsing in the image generation that causes some preferred output modes.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Naitik Bhise , Zhenfei Zhang , Tien D. Bui

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

Sparse Mixture of Experts (MoE) models offer a scalable and efficient architecture for training large neural networks by activating only a subset of parameters ("experts") for each input. A learned router computes a distribution over these…

Machine Learning · Computer Science 2025-10-14 Nabil Omi , Siddhartha Sen , Ali Farhadi

Recent GAN-based (Generative adversarial networks) inpainting methods show remarkable improvements and generate plausible images using multi-stage networks or Contextual Attention Modules (CAM). However, these techniques increase the model…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Mohamed Abbas Hedjazi , Yakup Genc

We introduce a novel generative autoencoder network model that learns to encode and reconstruct images with high quality and resolution, and supports smooth random sampling from the latent space of the encoder. Generative adversarial…

Machine Learning · Computer Science 2018-10-10 Ari Heljakka , Arno Solin , Juho Kannala

Recent advances in large language models highlighted the excessive quadratic cost of self-attention. Despite the significant research efforts, subquadratic attention methods still suffer from inferior performance in practice. We hypothesize…

Machine Learning · Computer Science 2025-05-02 Piotr Piękos , Róbert Csordás , Jürgen Schmidhuber

The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pre-training and has achieved promising results due to its model capacity. However, with trillions of parameters, MoE is hard to be deployed on cloud or mobile…

Machine Learning · Computer Science 2022-06-03 Tianyu Chen , Shaohan Huang , Yuan Xie , Binxing Jiao , Daxin Jiang , Haoyi Zhou , Jianxin Li , Furu Wei

Mixture-of-Experts layers achieve compute efficiency through weight sparsity: each token activates only a subset of experts. Data sparsity, where each expert processes only a subset of tokens, offers a complementary axis. Expert-choice…

Machine Learning · Computer Science 2026-01-23 Maciej Kilian , Oleg Mkrtchyan , Luke Zettlemoyer , Akshat Shrivastava , Armen Aghajanyan

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit…

Machine Learning · Computer Science 2019-10-10 Marco Menardi , Alex Falcon , Saida S. Mohamed , Lorenzo Seidenari , Giuseppe Serra , Alberto Del Bimbo , Carlo Tasso

Sparse Mixture-of-Experts models (MoEs) have recently gained popularity due to their ability to decouple model size from inference efficiency by only activating a small subset of the model parameters for any given input token. As such,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Erik Daxberger , Floris Weers , Bowen Zhang , Tom Gunter , Ruoming Pang , Marcin Eichner , Michael Emmersberger , Yinfei Yang , Alexander Toshev , Xianzhi Du

We present a learned image compression system based on GANs, operating at extremely low bitrates. Our proposed framework combines an encoder, decoder/generator and a multi-scale discriminator, which we train jointly for a generative learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Eirikur Agustsson , Michael Tschannen , Fabian Mentzer , Radu Timofte , Luc Van Gool

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

Reconstruction of field quantities from sparse measurements is a problem arising in a broad spectrum of applications. This task is particularly challenging when the mapping between sparse measurements and field quantities is performed in an…

Fluid Dynamics · Physics 2022-10-20 Alejandro Güemes , Carlos Sanmiguel Vila , Stefano Discetti