English
Related papers

Related papers: Deep Generative Variational Autoencoding for Repla…

200 papers

Variational Autoencoders (VAE) are probabilistic deep generative models underpinned by elegant theory, stable training processes, and meaningful manifold representations. However, they produce blurry images due to a lack of explicit…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Prashnna K Gyawali , Rudra Saha , Linwei Wang , VSR Veeravasarapu , Maneesh Singh

This paper presents an accurate phoneme alignment model that aims for speech analysis and video content creation. We propose a variational autoencoder (VAE)-based alignment model in which a probable path is searched using encoded acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Tomoki Koriyama

Deep generative models are stochastic neural networks capable of learning the distribution of data so as to generate new samples. Conditional Variational Autoencoder (CVAE) is a powerful deep generative model aiming at maximizing the lower…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Shima Kamyab , Rasool Sabzi , Zohreh Azimifar

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

Anti-spoofing for automatic speaker verification is now a well established area of research, with three competitive challenges having been held in the last 6 years. A great deal of research effort over this time has been invested into the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Hemlata Tak , Jose Patino , Andreas Nautsch , Nicholas Evans , Massimiliano Todisco

Recent years have seen growing efforts to develop spoofing countermeasures (CMs) to protect automatic speaker verification (ASV) systems from being deceived by manipulated or artificial inputs. The reliability of spoofing CMs is typically…

The automatic speaker verification system is sometimes vulnerable to various spoofing attacks. The 2-class Gaussian Mixture Model classifier for genuine and spoofed speech is usually used as the baseline for spoofing detection. However, the…

Sound · Computer Science 2024-07-09 Zhenchun Lei , Hui Yan , Changhong Liu , Minglei Ma , Yingen Yang

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

Machine Learning · Computer Science 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

In our previous work, we proposed a discriminative autoencoder (DcAE) for speech recognition. DcAE combines two training schemes into one. First, since DcAE aims to learn encoder-decoder mappings, the squared error between the reconstructed…

Sound · Computer Science 2022-06-16 Hung-Shin Lee , Pin-Tuan Huang , Yao-Fei Cheng , Hsin-Min Wang

Spoofing-robust speaker verification (SASV) combines the tasks of speaker and spoof detection to authenticate speakers under adversarial settings. Many SASV systems rely on fusion of speaker and spoof cues at embedding, score or decision…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Oğuzhan Kurnaz , Jagabandhu Mishra , Tomi H. Kinnunen , Cemal Hanilçi

Voice anti-spoofing systems are crucial auxiliaries for automatic speaker verification (ASV) systems. A major challenge is caused by unseen attacks empowered by advanced speech synthesis technologies. Our previous research on one-class…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Siwen Ding , You Zhang , Zhiyao Duan

Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Besides, deep generative models…

Machine Learning · Computer Science 2019-11-15 Xuhong Wang , Ying Du , Shijie Lin , Ping Cui , Yuntian Shen , Yupu Yang

The objective of automatic speaker verification (ASV) systems is to determine whether a given test speech utterance corresponds to a claimed enrolled speaker. These systems have a wide range of applications, and ensuring their reliability…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-27 Amro Asali , Yehuda Ben-Shimol , Itshak Lapidot

Automatic speaker verification (ASV) systems are vulnerable to spoofing attacks. We propose a spoofing-robust ASV system optimized directly for the recently introduced architecture-agnostic detection cost function (a-DCF), which allows…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-04 Oğuzhan Kurnaz , Jagabandhu Mishra , Tomi H. Kinnunen , Cemal Hanilçi

Leveraging the fact that speaker identity and content vary on different time scales, \acrlong{fhvae} (\acrshort{fhvae}) uses different latent variables to symbolize these two attributes. Disentanglement of these attributes is carried out by…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-16 Yuying Xie , Thomas Arildsen , Zheng-Hua Tan

Recent work in adversarial attacks has developed provably robust methods for training deep neural network classifiers. However, although they are often mentioned in the context of robustness, deep generative models themselves have received…

Machine Learning · Computer Science 2020-04-23 Filipe Condessa , Zico Kolter

Deep generative models have demonstrated their effectiveness in learning latent representation and modeling complex dependencies of time series. In this paper, we present a Smoothness-Inducing Sequential Variational Auto-Encoder (SISVAE)…

Machine Learning · Computer Science 2021-02-03 Longyuan Li , Junchi Yan , Haiyang Wang , Yaohui Jin

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

Continuous speech representations based on Variational Autoencoders (VAEs) have emerged as a promising alternative to traditional spectrogram or discrete token based features for speech generation and reconstruction. Recent research has…

Sound · Computer Science 2026-05-26 Changhao Cheng , Wei Wang , Wangyou Zhang , Dongya Jia , Jian Wu , Zhuo Chen , Yanmin Qian