中文
相关论文

相关论文: Exploring Sparse MoE in GANs for Text-conditioned …

200 篇论文

We propose a novel approach for generating unrestricted adversarial examples by manipulating fine-grained aspects of image generation. Unlike existing unrestricted attacks that typically hand-craft geometric transformations, we learn…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Omid Poursaeed , Tianxing Jiang , Yordanos Goshu , Harry Yang , Serge Belongie , Ser-Nam Lim

To generate new images for a given category, most deep generative models require abundant training images from this category, which are often too expensive to acquire. To achieve the goal of generation based on only a few images, we propose…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Yan Hong , Li Niu , Jianfu Zhang , Liqing Zhang

In this research, we introduce an innovative method for synthesizing medical images using generative adversarial networks (GANs). Our proposed GANs method demonstrates the capability to produce realistic synthetic images even when trained…

图像与视频处理 · 电气工程与系统科学 2024-06-28 Yinqiu Feng , Bo Zhang , Lingxi Xiao , Yutian Yang , Tana Gegen , Zexi Chen

Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has demonstrated a great promise to enable high-accuracy and ultra-efficient model inference. Despite the growing popularity of MoE, little work investigated its…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Yihua Zhang , Ruisi Cai , Tianlong Chen , Guanhua Zhang , Huan Zhang , Pin-Yu Chen , Shiyu Chang , Zhangyang Wang , Sijia Liu

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

In recent years, deep neural networks have been utilized in a wide variety of applications including image generation. In particular, generative adversarial networks (GANs) are able to produce highly realistic pictures as part of tasks such…

图像与视频处理 · 电气工程与系统科学 2020-04-20 Hyunsuk Ko , Dae Yeol Lee , Seunghyun Cho , Alan C. Bovik

Text-to-Image generation in the general domain has long been an open problem, which requires both a powerful generative model and cross-modal understanding. We propose CogView, a 4-billion-parameter Transformer with VQ-VAE tokenizer to…

计算机视觉与模式识别 · 计算机科学 2021-11-08 Ming Ding , Zhuoyi Yang , Wenyi Hong , Wendi Zheng , Chang Zhou , Da Yin , Junyang Lin , Xu Zou , Zhou Shao , Hongxia Yang , Jie Tang

Synthesizing high resolution photorealistic images has been a long-standing challenge in machine learning. In this paper we introduce new methods for the improved training of generative adversarial networks (GANs) for image synthesis. We…

机器学习 · 统计学 2017-07-24 Augustus Odena , Christopher Olah , Jonathon Shlens

Generative Adversarial Networks (GANs) have received a great deal of attention due in part to recent success in generating original, high-quality samples from visual domains. However, most current methods only allow for users to guide this…

图形学 · 计算机科学 2019-04-05 Eric Heim

Synthetic data has a key role to play in data sharing by statistical agencies and other generators of statistical data products. Generative Adversarial Networks (GANs), typically applied to image synthesis, are also a promising method for…

机器学习 · 计算机科学 2024-04-17 Nian Ran , Bahrul Ilmi Nasution , Claire Little , Richard Allmendinger , Mark Elliot

Mixture-of-experts (MoE) is becoming popular due to its success in improving the model quality, especially in Transformers. By routing tokens with a sparse gate to a few experts (i.e., a small pieces of the full model), MoE can easily…

机器学习 · 计算机科学 2022-10-11 Xiaonan Nie , Xupeng Miao , Shijie Cao , Lingxiao Ma , Qibin Liu , Jilong Xue , Youshan Miao , Yi Liu , Zhi Yang , Bin Cui

Sparsely-activated Mixture-of-Experts (SMoE) models offer efficient pre-training and low latency but their large parameter counts create significant memory overhead, motivating research into expert compression. Contrary to recent findings…

机器学习 · 计算机科学 2026-05-14 Mike Lasby , Ivan Lazarevich , Nish Sinnadurai , Sean Lie , Yani Ioannou , Vithursan Thangarasa

For optical coherence tomography angiography (OCTA) images, a limited scanning rate leads to a trade-off between field-of-view (FOV) and imaging resolution. Although larger FOV images may reveal more parafoveal vascular lesions, their…

图像与视频处理 · 电气工程与系统科学 2024-12-06 Weiwen Zhang , Dawei Yang , Haoxuan Che , An Ran Ran , Carol Y. Cheung , Hao Chen

This paper presents an energy-efficient stable diffusion processor for text-to-image generation. While stable diffusion attained attention for high-quality image synthesis results, its inherent characteristics hinder its deployment on…

硬件体系结构 · 计算机科学 2024-09-24 Jiwon Choi , Wooyoung Jo , Seongyon Hong , Beomseok Kwon , Wonhoon Park , Hoi-Jun Yoo

In this paper, we propose in our novel generative framework the use of Generative Adversarial Networks (GANs) to generate features that provide robustness for object detection on reduced quality images. The proposed GAN-based Detection of…

计算机视觉与模式识别 · 计算机科学 2022-08-10 Charan D. Prakash , Lina J. Karam

Generative Adversarial Networks (GANs) have become predominant in image generation tasks. Their success is attributed to the training regime which employs two models: a generator G and discriminator D that compete in a minimax zero sum…

机器学习 · 计算机科学 2020-11-25 Ariel Ruiz-Garcia , Ibrahim Almakky , Vasile Palade , Luke Hicks

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32x32), and…

机器学习 · 计算机科学 2020-10-27 Yang Song , Stefano Ermon

With the widespread adoption of Large Language Models (LLMs), many deep learning practitioners are looking for strategies of running these models more efficiently. One such strategy is to use sparse Mixture-of-Experts (MoE) - a type of…

机器学习 · 计算机科学 2023-12-29 Artyom Eliseev , Denis Mazur

Mixture-of-Experts (MoE) networks have been proposed as an efficient way to scale up model capacity and implement conditional computing. However, the study of MoE components mostly focused on the feedforward layer in Transformer…

计算与语言 · 计算机科学 2022-10-12 Xiaofeng Zhang , Yikang Shen , Zeyu Huang , Jie Zhou , Wenge Rong , Zhang Xiong

Semantic image synthesis, i.e., generating images from user-provided semantic label maps, is an important conditional image generation task as it allows to control both the content as well as the spatial layout of generated images. Although…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Tariq Berrada , Jakob Verbeek , Camille Couprie , Karteek Alahari