English
Related papers

Related papers: A weighted-variance variational autoencoder model …

200 papers

In this paper we introduce a recurrent neural network (RNN) based variational autoencoder (VAE) model with a new constrained loss function that can generate more meaningful electroencephalography (EEG) features from raw EEG features to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-05 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Speech enhancement (SE) based on diffusion probabilistic models has exhibited impressive performance, while requiring a relatively high number of function evaluations (NFE). Recently, SE based on flow matching has been proposed, which…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-20 Seonggyu Lee , Sein Cheong , Sangwook Han , Kihyuk Kim , Jong Won Shin

Advancing defensive mechanisms against adversarial attacks in generative models is a critical research topic in machine learning. Our study focuses on a specific type of generative models - Variational Auto-Encoders (VAEs). Contrary to…

Latent variable generative models have emerged as powerful tools for generative tasks including image and video synthesis. These models are enabled by pretrained autoencoders that map high resolution data into a compressed lower dimensional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Data limitation is one of the most common issues in training machine learning classifiers for medical applications. Due to ethical concerns and data privacy, the number of people that can be recruited to such experiments is generally…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-14 Bahman Mirheidari , Yilin Pan , Daniel Blackburn , Ronan O'Malley , Traci Walker , Annalena Venneri , Markus Reuber , Heidi Christensen

Recent neural text-to-speech (TTS) models with fine-grained latent features enable precise control of the prosody of synthesized speech. Such models typically incorporate a fine-grained variational autoencoder (VAE) structure, extracting…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Guangzhi Sun , Yu Zhang , Ron J. Weiss , Yuan Cao , Heiga Zen , Andrew Rosenberg , Bhuvana Ramabhadran , Yonghui Wu

The use of machine learning to generate synthetic data has grown in popularity with the proliferation of text-to-image models and especially large language models. The core methodology these models use is to learn the distribution of the…

Statistical Finance · Quantitative Finance 2023-11-28 Ruslan Tepelyan , Achintya Gopal

Syntactic information contains structures and rules about how text sentences are arranged. Incorporating syntax into text modeling methods can potentially benefit both representation learning and generation. Variational autoencoders (VAEs)…

Computation and Language · Computer Science 2019-08-28 Yijun Xiao , William Yang Wang

Single-channel deep speech enhancement approaches often estimate a single multiplicative mask to extract clean speech without a measure of its accuracy. Instead, in this work, we propose to quantify the uncertainty associated with clean…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Huajian Fang , Timo Gerkmann

We study the problem of identifying change points in high-dimensional generalized linear models, and propose an approach based on sample-weighted empirical risk minimization. Our method, Weighted ERM, encodes priors on the change points via…

Methodology · Statistics 2026-04-14 Gabriel Arpino , Ramji Venkataramanan

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underline noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

Machine Learning · Computer Science 2021-06-17 Eliya Nachmani , Robin San Roman , Lior Wolf

Diffusion models are a new class of generative models that have shown outstanding performance in image generation literature. As a consequence, studies have attempted to apply diffusion models to other tasks, such as speech enhancement. A…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

Training deep generative models like Variational Autoencoders (VAEs) requires propagating gradients through stochastic latent variables, which introduces estimation variance that can slow convergence and degrade performance. In this paper,…

Machine Learning · Computer Science 2026-02-27 Zilei Shao , Anji Liu , Guy Van den Broeck

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

State-of-the-art neural language models (LMs) represented by Transformers are highly complex. Their use of fixed, deterministic parameter estimates fail to account for model uncertainty and lead to over-fitting and poor generalization when…

Computation and Language · Computer Science 2021-02-10 Boyang Xue , Jianwei Yu , Junhao Xu , Shansong Liu , Shoukang Hu , Zi Ye , Mengzhe Geng , Xunying Liu , Helen Meng

Scaling text-to-speech (TTS) with autoregressive language model (LM) to large-scale datasets by quantizing waveform into discrete speech tokens is making great progress to capture the diversity and expressiveness in human speech, but the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Chong Zhang , Yanqing Liu , Yang Zheng , Sheng Zhao

Data augmentation methods for Natural Language Processing tasks are explored in recent years, however they are limited and it is hard to capture the diversity on sentence level. Besides, it is not always possible to perform data…

Computation and Language · Computer Science 2022-05-20 M. Şafak Bilici , Mehmet Fatih Amasyali

Diffusion models have recently achieved remarkable success in generative modeling, yet their training dynamics across different noise levels remain highly imbalanced, which can lead to inefficient optimization and unstable learning…

Machine Learning · Computer Science 2026-03-12 Nanlong Sun , Lei Shi

Unsupervised disentangled representation learning from the unlabelled audio data, and high fidelity audio generation have become two linchpins in the machine learning research fields. However, the representation learned from an unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-20 Kazi Nazmul Haque , Rajib Rana , Björn W Schuller

This study presents a framework for predicting unsteady transonic wing pressure distributions, integrating an autoencoder architecture with graph convolutional networks and graph-based temporal layers to model time dependencies. The…

Machine Learning · Computer Science 2024-11-19 Gabriele Immordino , Andrea Vaiuso , Andrea Da Ronch , Marcello Righi