English
Related papers

Related papers: Information-Theoretic GAN Compression with Variati…

200 papers

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

Machine Learning · Computer Science 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao

Despite extensive research on training generative adversarial networks (GANs) with limited training data, learning to generate images from long-tailed training distributions remains fairly unexplored. In the presence of imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Saeed Khorram , Mingqi Jiang , Mohamad Shahbazi , Mohamad H. Danesh , Li Fuxin

Convolutional neural networks (CNNs) excel in computer vision but are susceptible to adversarial attacks, crafted perturbations designed to mislead predictions. Despite advances in adversarial training, a gap persists between model accuracy…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hayat Ullah , Syed Muhammad Talha Zaidi , Arslan Munir

Under the limited storage, computing and network bandwidth resources, the video compression coding technology plays an important role for visual communication. To efficiently compress raw video data, a colorization-based video compression…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Zhaoqing Pan , Feng Yuan , Jianjun Lei , Sam Kwong

Knowledge distillation is the technique of compressing a larger neural network, known as the teacher, into a smaller neural network, known as the student, while still trying to maintain the performance of the larger neural network as much…

Machine Learning · Computer Science 2023-05-11 Tianxun Zhou , Keng-Hwee Chiam

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

In this work, we study the image transformation problem, which targets at learning the underlying transformations (e.g., the transition of seasons) from a collection of unlabeled images. However, there could be countless of transformations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Kaiwen Zha , Yujun Shen , Bolei Zhou

Knowledge representation learning aims at modeling knowledge graph by encoding entities and relations into a low dimensional space. Most of the traditional works for knowledge embedding need negative sampling to minimize a margin-based…

Artificial Intelligence · Computer Science 2018-10-01 Peifeng Wang , Shuangyin Li , Rong pan

Many existing conditional Generative Adversarial Networks (cGANs) are limited to conditioning on pre-defined and fixed class-level semantic labels or attributes. We propose an open set GAN architecture (OpenGAN) that is conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Luke Ditria , Benjamin J. Meyer , Tom Drummond

Transformer-based reinforcement learning has emerged as a strong candidate for sequential control in residential energy management. In particular, the Decision Transformer can learn effective battery dispatch policies from historical data,…

Machine Learning · Computer Science 2026-03-30 Pascal Henrich , Jonas Sievers , Maximilian Beichter , Thomas Blank , Ralf Mikut , Veit Hagenmeyer

We introduce a generative adversarial network (GAN) model to simulate the 3-dimensional Lagrangian motion of particles trapped in the recirculation zone of a buoyancy-opposed flame. The GAN model comprises a stochastic recurrent neural…

Machine Learning · Statistics 2019-01-15 Jingwei Gan , Pai Liu , Rajan K. Chakrabarty

We consider the theoretical problem of designing an optimal adversarial attack on a decision system that maximally degrades the achievable performance of the system as measured by the mutual information between the degraded signal and the…

Machine Learning · Computer Science 2020-07-29 Jirong Yi , Raghu Mudumbai , Weiyu Xu

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

Addressing the challenges of climate change requires accurate and high-resolution mapping of geospatial data, especially climate and weather variables. However, many existing geospatial datasets, such as the gridded outputs of the…

Machine Learning · Computer Science 2024-08-08 Guiye Li , Guofeng Cao

Deep convolutional neural networks have been widely used in numerous applications, but their demanding storage and computational resource requirements prevent their applications on mobile devices. Knowledge distillation aims to optimize a…

Machine Learning · Computer Science 2018-12-18 Hanting Chen , Yunhe Wang , Chang Xu , Chao Xu , Dacheng Tao

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

The outcome of text recognition for degraded color documents is often unsatisfactory due to interference from various contaminants. To extract information more efficiently for text recognition, document image enhancement and binarization…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Rui-Yang Ju , KokSheik Wong , Jen-Shiun Chiang

Graph Neural Networks (GNNs) achieve an impressive performance on structured graphs by recursively updating the representation vector of each node based on its neighbors, during which parameterized transformation matrices should be learned…

Machine Learning · Computer Science 2019-06-14 Pengfei Chen , Weiwen Liu , Chang-Yu Hsieh , Guangyong Chen , Shengyu Zhang