中文
相关论文

相关论文: Probability density distillation with generative a…

200 篇论文

We push forward neural network compression research by exploiting a novel challenging task of large-scale conditional generative adversarial networks (GANs) compression. To this end, we propose a gradually shrinking GAN (PPCD-GAN) by…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Duc Minh Vo , Akihiro Sugimoto , Hideki Nakayama

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

In this work, we propose a new solution for parallel wave generation by WaveNet. In contrast to parallel WaveNet (van den Oord et al., 2018), we distill a Gaussian inverse autoregressive flow from the autoregressive WaveNet by minimizing a…

计算与语言 · 计算机科学 2019-02-25 Wei Ping , Kainan Peng , Jitong Chen

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

机器学习 · 计算机科学 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

The projected gradient descent (PGD) method has shown to be effective in recovering compressed signals described in a data-driven way by a generative model, i.e., a generator which has learned the data distribution. Further reconstruction…

机器学习 · 计算机科学 2021-09-03 Muhammad Fadli Damara , Gregor Kornhardt , Peter Jung

Conditional waveform synthesis models learn a distribution of audio waveforms given conditioning such as text, mel-spectrograms, or MIDI. These systems employ deep generative models that model the waveform via either sequential…

音频与语音处理 · 电气工程与系统科学 2022-03-07 Max Morrison , Rithesh Kumar , Kundan Kumar , Prem Seetharaman , Aaron Courville , Yoshua Bengio

The intelligibility of speech severely degrades in the presence of environmental noise and reverberation. In this paper, we propose a novel deep learning based system for modifying the speech signal to increase its intelligibility under the…

音频与语音处理 · 电气工程与系统科学 2021-09-17 Haoyu Li , Junichi Yamagishi

More accurate machine learning models often demand more computation and memory at test time, making them difficult to deploy on CPU- or memory-constrained devices. Teacher-student compression (TSC), also known as distillation, alleviates…

机器学习 · 计算机科学 2020-03-24 Ruishan Liu , Nicolo Fusi , Lester Mackey

Research and education in machine learning needs diverse, representative, and open datasets that contain sufficient samples to handle the necessary training, validation, and testing tasks. Currently, the Recommender Systems area includes a…

信息检索 · 计算机科学 2023-03-03 Jesús Bobadilla , Abraham Gutiérrez , Raciel Yera , Luis Martínez

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

计算与语言 · 计算机科学 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

As a revolutionary generative paradigm of deep learning, generative adversarial networks (GANs) have been widely applied in various fields to synthesize realistic data. However, it is challenging for conventional GANs to synthesize raw…

信号处理 · 电气工程与系统科学 2023-06-27 Weidong Wang , Jiancheng An , Hongshu Liao , Lu Gan , Chau Yuen

While the success of deep learning relies on large amounts of training datasets, data is often limited in privacy-sensitive domains. To address this challenge, generative model learning with differential privacy has emerged as a solution to…

机器学习 · 计算机科学 2024-08-28 Bochao Liu , Pengju Wang , Shiming Ge

Generative Adversarial Networks (GANs) have been used in several machine learning tasks such as domain transfer, super resolution, and synthetic data generation. State-of-the-art GANs often use tens of millions of parameters, making them…

机器学习 · 计算机科学 2019-02-04 Angeline Aguinaldo , Ping-Yeh Chiang , Alex Gain , Ameya Patil , Kolten Pearson , Soheil Feizi

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones;…

Recent neural networks such as WaveNet and sampleRNN that learn directly from speech waveform samples have achieved very high-quality synthetic speech in terms of both naturalness and speaker similarity even in multi-speaker text-to-speech…

音频与语音处理 · 电气工程与系统科学 2018-08-01 Yi Zhao , Shinji Takaki , Hieu-Thi Luong , Junichi Yamagishi , Daisuke Saito , Nobuaki Minematsu

The diffusion model is capable of generating high-quality data through a probabilistic approach. However, it suffers from the drawback of slow generation speed due to the requirement of a large number of time steps. To address this…

声音 · 计算机科学 2024-04-30 Myeongjin Ko , Yong-Hoon Choi

Deep learning models for speech rely on large datasets, presenting computational challenges. Yet, performance hinges on training data size. Dataset Distillation (DD) aims to learn a smaller dataset without much performance degradation when…

One-class novelty detection is conducted to identify anomalous instances, with different distributions from the expected normal instances. In this paper, the Generative Adversarial Network based on the Encoder-Decoder-Encoder scheme…

计算机视觉与模式识别 · 计算机科学 2023-07-03 Zhiwei Zhang , Yu Dong , Hanyu Peng , Shifeng Chen

Several recent work on speech synthesis have employed generative adversarial networks (GANs) to produce raw waveforms. Although such methods improve the sampling efficiency and memory usage, their sample quality has not yet reached that of…

声音 · 计算机科学 2020-10-26 Jungil Kong , Jaehyeon Kim , Jaekyoung Bae