English
Related papers

Related papers: Data-Free Knowledge Amalgamation via Group-Stack D…

200 papers

Many large-scale knowledge graphs are now available and ready to provide semantically structured information that is regarded as an important resource for question answering and decision support tasks. However, they are built on rigid…

Computation and Language · Computer Science 2020-04-17 Jiehang Zeng , Lu Liu , Xiaoqing Zheng

Generative Adversarial Networks (GANs) have been used in several machine learning tasks such as domain transfer, super resolution, and synthetic data generation. State-of-the-art GANs often use tens of millions of parameters, making them…

Machine Learning · Computer Science 2019-02-04 Angeline Aguinaldo , Ping-Yeh Chiang , Alex Gain , Ameya Patil , Kolten Pearson , Soheil Feizi

Graph Neural Networks (GNNs) have shown strong performance on graph-structured data, but their reliance on graph connectivity often limits scalability and efficiency. Kolmogorov-Arnold Networks (KANs), a recent architecture with learnable…

Machine Learning · Computer Science 2025-08-12 Yuan-Hung Chao , Chia-Hsun Lu , Chih-Ya Shen

Network quantization is an essential procedure in deep learning for development of efficient fixed-point inference models on mobile or edge platforms. However, as datasets grow larger and privacy regulations become stricter, data sharing…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Yoojin Choi , Jihwan Choi , Mostafa El-Khamy , Jungwon Lee

Knowledge distillation between machine learning models has opened many new avenues for parameter count reduction, performance improvements, or amortizing training time when changing architectures between the teacher and student network. In…

Machine Learning · Computer Science 2020-11-24 Jonathan Raiman

In this paper, we propose a data privacy-preserving and communication efficient distributed GAN learning framework named Distributed Asynchronized Discriminator GAN (AsynDGAN). Our proposed framework aims to train a central generator learns…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Qi Chang , Hui Qu , Yikai Zhang , Mert Sabuncu , Chao Chen , Tong Zhang , Dimitris Metaxas

Many well-trained Convolutional Neural Network(CNN) models have now been released online by developers for the sake of effortless reproducing. In this paper, we treat such pre-trained networks as teachers and explore how to learn a target…

Machine Learning · Computer Science 2019-05-29 Jingwen Ye , Xinchao Wang , Yixin Ji , Kairi Ou , Mingli Song

Knowledge representation learning aims at modeling knowledge graph by encoding entities and relations into a low dimensional space. Most of the traditional works for knowledge embedding need negative sampling to minimize a margin-based…

Artificial Intelligence · Computer Science 2018-10-01 Peifeng Wang , Shuangyin Li , Rong pan

Despite Generative Adversarial Networks (GANs) have been widely used in various image-to-image translation tasks, they can be hardly applied on mobile devices due to their heavy computation and storage cost. Traditional network compression…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hanting Chen , Yunhe Wang , Han Shu , Changyuan Wen , Chunjing Xu , Boxin Shi , Chao Xu , Chang Xu

Supervised deep learning methods are enjoying enormous success in many practical applications of computer vision and have the potential to revolutionize robotics. However, the marked performance degradation to biases and imbalanced data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Aadarsh Sahoo , Ankit Singh , Rameswar Panda , Rogerio Feris , Abir Das

Recently, Generative Adversarial Networks (GANs) have demonstrated their potential in federated learning, i.e., learning a centralized model from data privately hosted by multiple sites. A federatedGAN jointly trains a centralized generator…

Machine Learning · Computer Science 2021-02-10 Yikai Zhang , Hui Qu , Qi Chang , Huidong Liu , Dimitris Metaxas , Chao Chen

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

Generative adversarial networks (GANs) provide a way to learn deep representations without extensively annotated training data. They achieve this through deriving backpropagation signals through a competitive process involving a pair of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Antonia Creswell , Tom White , Vincent Dumoulin , Kai Arulkumaran , Biswa Sengupta , Anil A Bharath

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

We introduce KBGAN, an adversarial learning framework to improve the performances of a wide range of existing knowledge graph embedding models. Because knowledge graphs typically only contain positive facts, sampling useful negative…

Computation and Language · Computer Science 2018-04-17 Liwei Cai , William Yang Wang

Generative adversarial networks (GANs) have been shown to provide an effective way to model complex distributions and have obtained impressive results on various challenging tasks. However, typical GANs require fully-observed data during…

Machine Learning · Computer Science 2019-02-27 Steven Cheng-Xian Li , Bo Jiang , Benjamin Marlin

Remarkable achievements have been attained with Generative Adversarial Networks (GANs) in image-to-image translation. However, due to a tremendous amount of parameters, state-of-the-art GANs usually suffer from low efficiency and bulky…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linfeng Zhang , Xin Chen , Xiaobing Tu , Pengfei Wan , Ning Xu , Kaisheng Ma

Generative Adversarial Networks (GANs) have achieved huge success in generating high-fidelity images, however, they suffer from low efficiency due to tremendous computational cost and bulky memory usage. Recent efforts on compression GANs…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Qing Jin , Jian Ren , Oliver J. Woodford , Jiazhuo Wang , Geng Yuan , Yanzhi Wang , Sergey Tulyakov

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

Machine Learning · Computer Science 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo