English
Related papers

Related papers: Teachers Do More Than Teach: Compressing Image-to-…

200 papers

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

To reduce the overwhelming size of Deep Neural Networks (DNN) teacher-student methodology tries to transfer knowledge from a complex teacher network to a simple student network. We instead propose a novel method called the teacher-class…

Machine Learning · Computer Science 2021-11-02 Shaiq Munir Malik , Muhammad Umair Haider , Mohbat Tharani , Musab Rasheed , Murtaza Taj

There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Varun A. Kelkar , Sayantan Bhadra , Mark A. Anastasio

Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations…

To reduce the large computation and storage cost of a deep convolutional neural network, the knowledge distillation based methods have pioneered to transfer the generalization ability of a large (teacher) deep network to a light-weight…

Machine Learning · Computer Science 2018-10-19 Peiye Liu , Wu Liu , Huadong Ma , Tao Mei , Mingoo Seok

Generative adversarial networks (GANs) synthesize realistic images from a random latent vector. While many studies have explored various training configurations and architectures for GANs, the problem of inverting a generative model to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Nicky Bayat , Vahid Reza Khazaie , Yalda Mohsenzadeh

We propose a unified compression framework that uses generative adversarial networks (GAN) to compress image and speech signals. The compressed signal is represented by a latent vector fed into a generator network which is trained to…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Bowen Liu , Ang Cao , Hun-seok Kim

In agricultural image analysis, optimal model performance is keenly pursued for better fulfilling visual recognition tasks (e.g., image classification, segmentation, object detection and localization), in the presence of challenges with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ebenezer Olaniyi , Dong Chen , Yuzhen Lu , Yanbo Huang

We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition of the adversarial loss from the discriminator that is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Sebastian Lutz , Konstantinos Amplianitis , Aljosa Smolic

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to…

Social and Information Networks · Computer Science 2018-09-05 Ming Ding , Jie Tang , Jie Zhang

Quantum machine learning is expected to be one of the first practical applications of near-term quantum devices. Pioneer theoretical works suggest that quantum generative adversarial networks (GANs) may exhibit a potential exponential…

In this paper, an image recognition algorithm based on the combination of deep learning and generative adversarial network (GAN) is studied, and compared with traditional image recognition methods. The purpose of this study is to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yihao Zhong , Yijing Wei , Yingbin Liang , Xiqing Liu , Rongwei Ji , Yiru Cang

This paper presents a novel approach for deep visualization via a generative network, offering an improvement over existing methods. Our model simplifies the architecture by reducing the number of networks used, requiring only a generator…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Athanasios Karagounis

In recent years, Generative Adversarial Networks (GANs) have drawn a lot of attentions for learning the underlying distribution of data in various applications. Despite their wide applicability, training GANs is notoriously difficult. This…

Machine Learning · Computer Science 2019-04-23 Babak Barazandeh , Meisam Razaviyayn , Maziar Sanjabi

Generative adversarial networks (GANs) transform latent vectors into visually plausible images. It is generally thought that the original GAN formulation gives no out-of-the-box method to reverse the mapping, projecting images back into…

Machine Learning · Computer Science 2017-02-20 Zachary C. Lipton , Subarna Tripathi

We focus on the problem of training a deep neural network in generations. The flowchart is that, in order to optimize the target network (student), another network (teacher) with the same architecture is first trained, and used to provide…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Chenglin Yang , Lingxi Xie , Siyuan Qiao , Alan Yuille

In this work, we present a novel approach for training Generative Adversarial Networks (GANs). Using the attention maps produced by a Teacher- Network we are able to improve the quality of the generated images as well as perform weakly…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Dimitris Kastaniotis , Ioanna Ntinou , Dimitrios Tsourounis , George Economou , Spiros Fotopoulos

Learning performance data, such as correct or incorrect responses to questions in Intelligent Tutoring Systems (ITSs) is crucial for tracking and assessing the learners' progress and mastery of knowledge. However, the issue of data…

Machine Learning · Computer Science 2024-09-23 Liang Zhang , Mohammed Yeasin , Jionghao Lin , Felix Havugimana , Xiangen Hu

One of the biggest issues facing the use of machine learning in medical imaging is the lack of availability of large, labelled datasets. The annotation of medical images is not only expensive and time consuming but also highly dependent on…

Despite the significant advances in recent years, Generative Adversarial Networks (GANs) are still notoriously hard to train. In this paper, we propose three novel curriculum learning strategies for training GANs. All strategies are first…

Machine Learning · Computer Science 2019-10-24 Petru Soviany , Claudiu Ardei , Radu Tudor Ionescu , Marius Leordeanu