English
Related papers

Related papers: Amortized Population Gibbs Samplers with Neural Su…

200 papers

Population synthesis is concerned with the generation of synthetic yet realistic representations of populations. It is a fundamental problem in the modeling of transport where the synthetic populations of micro-agents represent a key input…

Machine Learning · Statistics 2019-07-19 Stanislav S. Borysov , Jeppe Rich , Francisco C. Pereira

Building upon recent works on linesearch-free adaptive proximal gradient methods, this paper proposes adaPG$^{q,r}$, a framework that unifies and extends existing results by providing larger stepsize policies and improved lower bounds.…

Optimization and Control · Mathematics 2024-07-11 Puya Latafat , Andreas Themelis , Panagiotis Patrinos

Many complex domains, such as robotics control and real-time strategy (RTS) games, require an agent to learn a continuous control. In the former, an agent learns a policy over $\mathbb{R}^d$ and in the latter, over a discrete set of actions…

Machine Learning · Computer Science 2019-02-19 Carson Eisenach , Haichuan Yang , Ji Liu , Han Liu

This paper introduces a stochastic plug-and-play (PnP) sampling algorithm that leverages variable splitting to efficiently sample from a posterior distribution. The algorithm based on split Gibbs sampling (SGS) draws inspiration from the…

Machine Learning · Statistics 2023-04-24 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Deep generative models (DGMs) have shown promise in image generation. However, most of the existing work learn the model by simply optimizing a divergence between the marginal distributions of the model and the data, and often fail to…

Machine Learning · Computer Science 2019-06-11 Kun Xu , Chongxuan Li , Jun Zhu , Bo Zhang

Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and well-calibrated…

Machine Learning · Computer Science 2018-12-31 Vincent Adam , Nicolas Durrande , ST John

Restricted Boltzmann Machines and Deep Belief Networks have been successfully used in probabilistic generative model applications such as image occlusion removal, pattern completion and motion synthesis. Generative inference in such…

Neural and Evolutionary Computing · Computer Science 2016-02-22 Ojash Neopane , Srinjoy Das , Ery Arias-Castro , Kenneth Kreutz-Delgado

Negative sampling is essential for implicit-feedback-based collaborative filtering, which is used to constitute negative signals from massive unlabeled data to guide supervised learning. The state-of-the-art idea is to utilize hard negative…

Information Retrieval · Computer Science 2023-08-14 Yuhan Zhao , Rui Chen , Riwei Lai , Qilong Han , Hongtao Song , Li Chen

The majority of machine learning methods and algorithms give high priority to prediction performance which may not always correspond to the priority of the users. In many cases, practitioners and researchers in different fields, going from…

A learned generative model often produces biased statistics relative to the underlying data distribution. A standard technique to correct this bias is importance sampling, where samples from the model are weighted by the likelihood ratio…

Machine Learning · Statistics 2019-11-05 Aditya Grover , Jiaming Song , Alekh Agarwal , Kenneth Tran , Ashish Kapoor , Eric Horvitz , Stefano Ermon

Using the linear Gaussian latent variable model as a starting point we relax some of the constraints it imposes by deriving a nonparametric latent feature Gaussian variable model. This model introduces additional discrete latent variables…

Machine Learning · Statistics 2019-05-28 Adam Farooq , Yordan P. Raykov , Luc Evers , Max A. Little

Approximate Bayesian computation methods are useful for generative models with intractable likelihoods. These methods are however sensitive to the dimension of the parameter space, requiring exponentially increasing resources as this…

Computation · Statistics 2026-02-09 Grégoire Clarté , Christian P. Robert , Robin Ryder , Julien Stoehr

We propose an adaptive importance sampling scheme for Gaussian approximations of intractable posteriors. Optimization-based approximations like variational inference can be too inaccurate while existing Monte Carlo methods can be too slow.…

Computation · Statistics 2025-02-04 Willem van den Boom , Andrea Cremaschi , Alexandre H. Thiery

Exponential Random Graph Models (ERGMs) are an inferential model for analysing statistical networks. Recent development in ERGMs uses hierarchical Bayesian setup to jointly model a group of networks, which is called a multiple-network…

Methodology · Statistics 2025-06-06 Yefeng Fan , Simon Richard White

The core principle of Variational Inference (VI) is to convert the statistical inference problem of computing complex posterior probability densities into a tractable optimization problem. This property enables VI to be faster than several…

Machine Learning · Computer Science 2023-10-25 Ankush Ganguly , Sanjana Jain , Ukrit Watchareeruetai

Genetic Programming (GP) often uses large training sets and requires all individuals to be evaluated on all training cases during selection. Random down-sampled lexicase selection evaluates individuals on only a random subset of the…

Neural and Evolutionary Computing · Computer Science 2024-02-23 Ryan Boldi , Martin Briesch , Dominik Sobania , Alexander Lalejini , Thomas Helmuth , Franz Rothlauf , Charles Ofria , Lee Spector

Inference models are a key component in scaling variational inference to deep latent variable models, most notably as encoder networks in variational auto-encoders (VAEs). By replacing conventional optimization-based inference with a…

Machine Learning · Computer Science 2018-07-26 Joseph Marino , Yisong Yue , Stephan Mandt

Recently there has seen promising results on automatic stage scoring by extracting spatio-temporal features from electroencephalogram (EEG). Such methods entail laborious manual feature engineering and domain knowledge. In this study, we…

Signal Processing · Electrical Eng. & Systems 2022-04-08 Lingwei Zhu , Koki Odani , Ziwei Yang , Guang Shi , Yirong Kan , Zheng Chen , Renyuan Zhang

Learning graph generative models is a challenging task for deep learning and has wide applicability to a range of domains like chemistry, biology and social science. However current deep neural methods suffer from limited scalability: for a…

Machine Learning · Computer Science 2020-06-30 Hanjun Dai , Azade Nazi , Yujia Li , Bo Dai , Dale Schuurmans

We develop deep Poisson-gamma dynamical systems (DPGDS) to model sequentially observed multivariate count data, improving previously proposed models by not only mining deep hierarchical latent structure from the data, but also capturing…

Machine Learning · Statistics 2019-01-03 Dandan Guo , Bo Chen , Hao Zhang , Mingyuan Zhou