English
Related papers

Related papers: Forward Operator Estimation in Generative Models w…

200 papers

A latent force model is a Gaussian process with a covariance function inspired by a differential operator. Such covariance function is obtained by performing convolution integrals between Green's functions associated to the differential…

Machine Learning · Statistics 2021-04-20 Cristian Guarnizo , Mauricio A. Álvarez

Deep generative models have emerged as promising tools for detecting arbitrary anomalies in data, dispensing with the necessity for manual labelling. Recently, autoregressive transformers have achieved state-of-the-art performance for…

Morden deep ensembles technique achieves strong uncertainty estimation performance by going through multiple forward passes with different models. This is at the price of a high storage space and a slow speed in the inference (test) time.…

Machine Learning · Computer Science 2024-03-13 Ha Manh Bui , Anqi Liu

Generative transformer models have become increasingly complex, with large numbers of parameters and the ability to process multiple input modalities. Current methods for explaining their predictions are resource-intensive. Most crucially,…

Machine Learning · Computer Science 2025-01-08 Björn Deiseroth , Mayukh Deb , Samuel Weinbach , Manuel Brack , Patrick Schramowski , Kristian Kersting

Marginalising over families of Gaussian Process kernels produces flexible model classes with well-calibrated uncertainty estimates. Existing approaches require likelihood evaluations of many kernels, rendering them prohibitively expensive…

Machine Learning · Statistics 2023-03-16 Saad Hamid , Sebastian Schulze , Michael A. Osborne , Stephen J. Roberts

We develop a scalable deep non-parametric generative model by augmenting deep Gaussian processes with a recognition model. Inference is performed in a novel scalable variational framework where the variational posterior distributions are…

Machine Learning · Computer Science 2016-03-02 Zhenwen Dai , Andreas Damianou , Javier González , Neil Lawrence

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

Gaussian processes are rich distributions over functions, with generalization properties determined by a kernel function. When used for long-range extrapolation, predictions are particularly sensitive to the choice of kernel parameters. It…

Machine Learning · Statistics 2018-02-05 Phillip A. Jang , Andrew E. Loeb , Matthew B. Davidow , Andrew Gordon Wilson

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

Machine Learning · Computer Science 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger

The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order…

Machine Learning · Statistics 2017-11-16 Jean-Francois Ton , Seth Flaxman , Dino Sejdinovic , Samir Bhatt

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

Machine Learning · Computer Science 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

Probability density function estimation with weighted samples is the main foundation of all adaptive importance sampling algorithms. Classically, a target distribution is approximated either by a non-parametric model or within a parametric…

Machine Learning · Computer Science 2023-10-16 Julien Demange-Chryst , François Bachoc , Jérôme Morio , Timothé Krauth

This paper addresses the problem of learning the impulse responses characterizing forward models by means of a regularized kernel-based Prediction Error Method (PEM). The common approach to accomplish that is to approximate the system with…

Optimization and Control · Mathematics 2024-09-20 Giulio Fattore , Marco Peruzzo , Giacomo Sartori , Mattia Zorzi

Generative Adversarial Networks (GANs) have achieved huge success in generating high-fidelity images, however, they suffer from low efficiency due to tremendous computational cost and bulky memory usage. Recent efforts on compression GANs…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Qing Jin , Jian Ren , Oliver J. Woodford , Jiazhuo Wang , Geng Yuan , Yanzhi Wang , Sergey Tulyakov

We propose communication-efficient distributed estimation and inference methods for the transelliptical graphical model, a semiparametric extension of the elliptical distribution in the high dimensional regime. In detail, the proposed…

Machine Learning · Statistics 2016-12-30 Pan Xu , Lu Tian , Quanquan Gu

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Generative models have achieved remarkable progress with the emergence of flow matching (FM). It has demonstrated strong generative capabilities and attracted significant attention as a simulation-free flow-based framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Huynh Trinh Ngoc , Hoang Anh Nguyen Kim , Toan Nguyen Hai , Long Tran Quoc

It is well-known that non-linear approximation has an advantage over linear schemes in the sense that it provides comparable approximation rates to those of the linear schemes, but to a larger class of approximands. This was established for…

Classical Analysis and ODEs · Mathematics 2010-04-28 Thomas Hangelbroek , Amos Ron
‹ Prev 1 3 4 5 6 7 10 Next ›