English
Related papers

Related papers: A Decentralized Parallel Algorithm for Training Ge…

200 papers

We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept…

Machine Learning · Computer Science 2018-11-14 Michael Kamp , Linara Adilova , Joachim Sicking , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

In recent years, Generative Adversarial Networks (GANs) have received significant attention from the research community. With a straightforward implementation and outstanding results, GANs have been used for numerous applications. Despite…

Machine Learning · Computer Science 2019-08-01 P Manisha , Sujit Gujar

Motivated by the need for decentralized learning, this paper aims at designing a distributed algorithm for solving nonconvex problems with general linear constraints over a multi-agent network. In the considered problem, each agent owns…

Optimization and Control · Mathematics 2022-06-23 Jiawei Zhang , Songyang Ge , Tsung-Hui Chang , Zhi-Quan Luo

Recently, Generative Adversarial Networks (GANs) have demonstrated their potential in federated learning, i.e., learning a centralized model from data privately hosted by multiple sites. A federatedGAN jointly trains a centralized generator…

Machine Learning · Computer Science 2021-02-10 Yikai Zhang , Hui Qu , Qi Chang , Huidong Liu , Dimitris Metaxas , Chao Chen

Since their inception in 2014, Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains, including computer vision and other applied areas. Consisting of…

Machine Learning · Computer Science 2025-02-18 Tanujit Chakraborty , Ujjwal Reddy K S , Shraddha M. Naik , Madhurima Panja , Bayapureddy Manvitha

Generative Adversarial Networks (GANs) have demonstrated remarkable advancements in generative modeling; however, their training is often resource-intensive, requiring extensive computational time and hundreds of thousands of epochs. This…

Machine Learning · Computer Science 2024-10-28 Beka Modrekiladze

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

Machine Learning · Statistics 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

We present an alternative perspective on the training of generative adversarial networks (GANs), showing that the training step for a GAN generator decomposes into two implicit subproblems. In the first, the discriminator provides new…

Machine Learning · Computer Science 2021-05-13 Romann M. Weber

Distributed training algorithms of deep neural networks show impressive convergence speedup properties on very large problems. However, they inherently suffer from communication related slowdowns and communication topology becomes a crucial…

Machine Learning · Computer Science 2022-03-25 Tomer Avidor , Nadav Tal Israel

We propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Massimiliano Lupo Pasini , Vittorio Gabbi , Junqi Yin , Simona Perotto , Nouamane Laanait

Generative Adversarial Networks (GANs) are a class of generative models used for various applications, but they have been known to suffer from the mode collapse problem, in which some modes of the target distribution are ignored by the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Karttikeya Mangalam , Rohin Garg

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert

Generative Adversarial Networks (GANs) have become the most used networks towards solving the problem of image generation. Self-supervised GANs are later proposed to avoid the catastrophic forgetting of the discriminator and to improve the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Gulcin Baykal , Furkan Ozcelik , Gozde Unal

Generative Adversarial Networks (GAN) have received wide attention in the machine learning field for their potential to learn high-dimensional, complex real data distribution. Specifically, they do not rely on any assumptions about the…

Machine Learning · Computer Science 2019-03-01 Yongjun Hong , Uiwon Hwang , Jaeyoon Yoo , Sungroh Yoon

Generative Adversarial Network (GAN) and its variants serve as a perfect representation of the data generation model, providing researchers with a large amount of high-quality generated data. They illustrate a promising direction for…

Machine Learning · Computer Science 2020-04-21 Yi Liu , Jialiang Peng , James J. Q Yu , Yi Wu

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to…

Social and Information Networks · Computer Science 2018-09-05 Ming Ding , Jie Tang , Jie Zhang

Since the creation of Generative Adversarial Networks (GANs), much work has been done to improve their training stability, their generated image quality, their range of application but nearly none of them explored their self-training…

Machine Learning · Computer Science 2017-10-31 Alan Do-Omri , Dalei Wu , Xiaohua Liu

Supervised super-resolution deep convolutional neural networks (CNNs) have gained significant attention for their potential in reconstructing velocity and scalar fields in turbulent flows. Despite their popularity, CNNs currently lack the…

Decentralized learning enables edge users to collaboratively train models by exchanging information via device-to-device communication, yet prior works have been limited to wireless networks with fixed topologies and reliable workers. In…

Information Theory · Computer Science 2022-02-03 Eunjeong Jeong , Matteo Zecchin , Marios Kountouris

Generative Adversarial Networks (GAN) have attracted much research attention recently, leading to impressive results for natural image generation. However, to date little success was observed in using GAN generated images for improving…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Xinlong Wang , Zhipeng Man , Mingyu You , Chunhua Shen