English
Related papers

Related papers: Data-Free Knowledge Amalgamation via Group-Stack D…

200 papers

Conventional transfer learning leverages weights of pre-trained networks, but mandates the need for similar neural architectures. Alternatively, knowledge distillation can transfer knowledge between heterogeneous networks but often requires…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Shuhang Wang , Vivek Kumar Singh , Alex Benjamin , Mercy Asiedu , Elham Yousef Kalafi , Eugene Cheah , Viksit Kumar , Anthony Samir

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Learning disentangled and interpretable representations is an important step towards accomplishing comprehensive data representations on the manifold. In this paper, we propose a novel representation learning algorithm which combines the…

Machine Learning · Computer Science 2021-07-13 Fei Ye , Adrian G. Bors

Recent successes in Generative Adversarial Networks (GAN) have affirmed the importance of using more data in GAN training. Yet it is expensive to collect data in many domains such as medical applications. Data Augmentation (DA) has been…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Trung-Kien Nguyen , Ngai-Man Cheung

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin

Collaborative learning has successfully applied knowledge transfer to guide a pool of small student networks towards robust local minima. However, previous approaches typically struggle with drastically aggravated student homogenization…

Machine Learning · Computer Science 2021-02-23 Shaoxiong Feng , Hongshen Chen , Xuancheng Ren , Zhuoye Ding , Kan Li , Xu Sun

We introduce DeepInversion, a new method for synthesizing images from the image distribution used to train a deep neural network. We 'invert' a trained network (teacher) to synthesize class-conditional input images starting from random…

Machine Learning · Computer Science 2020-06-17 Hongxu Yin , Pavlo Molchanov , Zhizhong Li , Jose M. Alvarez , Arun Mallya , Derek Hoiem , Niraj K. Jha , Jan Kautz

Suffering from the extreme training data imbalance between seen and unseen classes, most of existing state-of-the-art approaches fail to achieve satisfactory results for the challenging generalized zero-shot learning task. To circumvent the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Yongqin Xian , Tobias Lorenz , Bernt Schiele , Zeynep Akata

Without any specific way for imbalance data classification, artificial intelligence algorithm cannot recognize data from minority classes easily. In general, modifying the existing algorithm by assuming that the training data is imbalanced,…

Machine Learning · Computer Science 2018-07-16 Fanny , Tjeng Wawan Cenggoro

Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable…

Machine Learning · Computer Science 2024-02-27 José Manuel de Frutos , Pablo M. Olmos , Manuel A. Vázquez , Joaquín Míguez

Training Generative Adversarial Networks (GANs) remains a challenging problem. The discriminator trains the generator by learning the distribution of real/generated data. However, the distribution of generated data changes throughout the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Wentian Zhang , Haozhe Liu , Bing Li , Jinheng Xie , Yawen Huang , Yuexiang Li , Yefeng Zheng , Bernard Ghanem

Graph neural networks (GNNs) face significant challenges with class imbalance, leading to biased inference results. To address this issue in heterogeneous graphs, we propose a novel framework that combines Graph Neural Network (GNN) and…

Machine Learning · Computer Science 2024-11-26 Hung-Chun Hsu , Bo-Jun Wu , Ming-Yi Hong , Che Lin , Chih-Yu Wang

Fairness-aware learning is increasingly important in data mining. Discrimination prevention aims to prevent discrimination in the training data before it is used to conduct predictive analysis. In this paper, we focus on fair data…

Machine Learning · Computer Science 2018-05-30 Depeng Xu , Shuhan Yuan , Lu Zhang , Xintao Wu

Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statistics as the training samples. One major form of training…

Disordered Systems and Neural Networks · Physics 2022-12-12 Steven Durr , Youssef Mroueh , Yuhai Tu , Shenshen Wang

Generative adversarial networks (GANs) are widely used to learn generative models. GANs consist of two networks, a generator and a discriminator, that apply adversarial learning to optimize their parameters. This article presents a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Emiliano Perez , Sergio Nesmachnow , Jamal Toutouh , Erik Hemberg , Una-May O'Reilly

Image generation remains a fundamental problem in artificial intelligence in general and deep learning in specific. The generative adversarial network (GAN) was successful in generating high quality samples of natural images. We propose a…

Artificial Intelligence · Computer Science 2016-11-15 Hanock Kwak , Byoung-Tak Zhang

We present an alternative perspective on the training of generative adversarial networks (GANs), showing that the training step for a GAN generator decomposes into two implicit subproblems. In the first, the discriminator provides new…

Machine Learning · Computer Science 2021-05-13 Romann M. Weber

Federated Learning has gained attention for its ability to enable multiple nodes to collaboratively train machine learning models without sharing raw data. At the same time, Generative AI -- particularly Generative Adversarial Networks…

Machine Learning · Computer Science 2026-01-19 Youssef Tawfilis , Hossam Amer , Minar El-Aasser , Tallal Elshabrawy

Generative Adversarial Networks (GANs) are a powerful class of generative models in the deep learning community. Current practice on large-scale GAN training utilizes large models and distributed large-batch training strategies, and is…

Optimization and Control · Mathematics 2020-10-21 Mingrui Liu , Wei Zhang , Youssef Mroueh , Xiaodong Cui , Jerret Ross , Tianbao Yang , Payel Das

The collaboration between agents has gradually become an important topic in multi-agent systems. The key is how to efficiently solve the credit assignment problems. This paper introduces MGAN for collaborative multi-agent reinforcement…

Multiagent Systems · Computer Science 2021-05-14 Zhiwei Xu , Bin Zhang , Yunpeng Bai , Dapeng Li , Guoliang Fan