English
Related papers

Related papers: Autoregressive-Gaussian Mixture Models: Efficient …

200 papers

In probabilistic classification, a discriminative model based on the softmax function has a potential limitation in that it assumes unimodality for each class in the feature space. The mixture model can address this issue, although it leads…

Machine Learning · Computer Science 2021-05-10 Hideaki Hayashi , Seiichi Uchida

Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and well-calibrated…

Machine Learning · Computer Science 2018-12-31 Vincent Adam , Nicolas Durrande , ST John

We demonstrate the use of conditional autoregressive generative models (van den Oord et al., 2016a) over a discrete latent space (van den Oord et al., 2017b) for forward planning with MCTS. In order to test this method, we introduce a new…

Machine Learning · Computer Science 2018-11-27 Johanna Hansen , Kyle Kastner , Aaron Courville , Gregory Dudek

With the recent development of new geometric and angular-radial frameworks for multivariate extremes, reliably simulating from angular variables in moderate-to-high dimensions is of increasing importance. Empirical approaches have the…

Machine Learning · Statistics 2026-01-01 Jakob Benjamin Wessel , Callum J. R. Murphy-Barltrop , Emma S. Simpson

We propose Deep Residual Mixture Models (DRMMs), a novel deep generative model architecture. Compared to other deep models, DRMMs allow more flexible conditional sampling: The model can be trained once with all variables, and then used for…

Machine Learning · Computer Science 2021-07-22 Perttu Hämäläinen , Martin Trapp , Tuure Saloheimo , Arno Solin

Accurate learning of system dynamics is becoming increasingly crucial for advanced control and decision-making in engineering. However, real-world systems often exhibit multiple channels and highly nonlinear transition dynamics, challenging…

Machine Learning · Statistics 2025-10-20 Tengjie Zheng , Jilan Mei , Di Wu , Lin Cheng , Shengping Gong

For many survey-based spatial modelling problems, responses are observed as spatially aggregated over survey regions due to limited resources. Covariates, from weather models and satellite imageries, can be observed at many different…

Applications · Statistics 2022-04-04 Harrison Zhu , Adam Howes , Owen van Eer , Maxime Rischard , Yingzhen Li , Dino Sejdinovic , Seth Flaxman

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Power amplifiers (PAs) are essential components in wireless communication systems, and the design of their behavioral models has been an important research topic for many years. The widely used generalized memory polynomial (GMP) model…

Signal Processing · Electrical Eng. & Systems 2025-03-04 Yuchao Wang , Yimin Wei

A novel framework of compressed sensing, namely statistical compressed sensing (SCS), that aims at efficiently sampling a collection of signals that follow a statistical distribution, and achieving accurate reconstruction on average, is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-27 Guoshen Yu , Guillermo Sapiro

For many wireless communication applications, traffic pattern modeling of radio signals combined with channel effects is much needed. While analytical models are used to capture these phenomena, real world non-linear effects (e.g. device…

Signal Processing · Electrical Eng. & Systems 2022-06-30 Haythem Chaker , Soumaya Hamouda , Nicola Michailow

As a common method in Machine Learning, Ensemble Method is used to train multiple models from a data set and obtain better results through certain combination strategies. Stacking method, as representatives of Ensemble Learning methods, is…

Machine Learning · Computer Science 2020-09-15 Jiacheng Ruan , Jiahao Li

Hidden Markov Model (HMM) combined with Gaussian Process (GP) emission can be effectively used to estimate the hidden state with a sequence of complex input-output relational observations. Especially when the spectral mixture (SM) kernel is…

Machine Learning · Computer Science 2020-01-08 Yohan Jung , Jinkyoo Park

Autoregressive (AR) modeling is invaluable in signal processing, in particular in speech and audio fields. Attempts in the literature can be found that regularize or constrain either the time-domain signal values or the AR coefficients,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Ondřej Mokrý , Pavel Rajmic

We show that density models describing multiple observables with (i) hard boundaries and (ii) dependence on external parameters may be created using an auto-regressive Gaussian mixture model. The model is designed to capture how observable…

Data Analysis, Statistics and Probability · Physics 2022-02-01 Stephen B. Menary , Darren D. Price

We propose a new generative model of projected cosmic mass density maps inferred from weak gravitational lensing observations of distant galaxies (weak lensing mass maps). We construct the model based on a neural style transfer so that it…

Cosmology and Nongalactic Astrophysics · Physics 2024-05-24 Masato Shirasaki , Shiro Ikeda

Generation of simulated data is essential for data analysis in particle physics, but current Monte Carlo methods are very computationally expensive. Deep-learning-based generative models have successfully generated simulated data at lower…

Data Analysis, Statistics and Probability · Physics 2021-02-24 Yadong Lu , Julian Collado , Daniel Whiteson , Pierre Baldi

With the rapidly growing model complexity and data volume, training deep generative models (DGMs) for better performance has becoming an increasingly more important challenge. Previous research on this problem has mainly focused on…

Machine Learning · Computer Science 2021-12-08 Yufan Zhou , Chunyuan Li , Changyou Chen , Jinhui Xu

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang

This paper presents a novel compressed sensing (CS) approach to high dimensional wireless channel estimation by optimizing the input to a deep generative network. Channel estimation using generative networks relies on the assumption that…

Signal Processing · Electrical Eng. & Systems 2020-06-25 Eren Balevi , Akash Doshi , Ajil Jalal , Alexandros Dimakis , Jeffrey G. Andrews