中文
相关论文

相关论文: Mixtures of Gaussian process experts based on kern…

200 篇论文

Clustering multivariate data is a pervasive task in many applied problems, particularly in social studies and life science. Model-based approaches to clustering rely on mixture models, where each mixture component corresponds to the kernel…

统计方法学 · 统计学 2026-01-22 Laura Ferrini , Federico Castelletti

We introduce stochastic variational inference for Gaussian process models. This enables the application of Gaussian process (GP) models to data sets containing millions of data points. We show how GPs can be vari- ationally decomposed to…

机器学习 · 计算机科学 2013-09-27 James Hensman , Nicolo Fusi , Neil D. Lawrence

Functional covariates arise in many scientific and engineering applications when model inputs take the form of time-dependent or spatially distributed profiles, such as varying boundary conditions or changing material behaviours. In…

To improve the predictability of complex computational models in the experimentally-unknown domains, we propose a Bayesian statistical machine learning framework utilizing the Dirichlet distribution that combines results of several…

统计方法学 · 统计学 2023-11-06 Vojtech Kejzlar , Léo Neufcourt , Witold Nazarewicz

Gaussian Process bandit optimization has emerged as a powerful tool for optimizing noisy black box functions. One example in machine learning is hyper-parameter optimization where each evaluation of the target function requires training a…

机器学习 · 计算机科学 2016-11-15 Tarun Kathuria , Amit Deshpande , Pushmeet Kohli

We propose an effective method to solve the event sequence clustering problems based on a novel Dirichlet mixture model of a special but significant type of point processes --- Hawkes process. In this model, each event sequence belonging to…

机器学习 · 计算机科学 2017-09-22 Hongteng Xu , Hongyuan Zha

Although discrete mixture modeling has formed the backbone of the literature on Bayesian density estimation, there are some well known disadvantages. We propose an alternative class of priors based on random nonlinear functions of a uniform…

统计理论 · 数学 2015-03-19 Suprateek Kundu , David B. Dunson

Large language models, such as OpenAI's ChatGPT, have demonstrated exceptional language understanding capabilities in various NLP tasks. Sparsely activated mixture-of-experts (MoE) has emerged as a promising solution for scaling models…

计算与语言 · 计算机科学 2023-10-12 Jiamin Li , Qiang Su , Yitao Yang , Yimin Jiang , Cong Wang , Hong Xu

Within the past two decades, Gaussian process regression has been increasingly used for modeling dynamical systems due to some beneficial properties such as the bias variance trade-off and the strong connection to Bayesian mathematics. As…

系统与控制 · 电气工程与系统科学 2021-02-11 Thomas Beckers

Statistical modelling in the presence of data organized in groups is a crucial task in Bayesian statistics. The present paper conceives a mixture model based on a novel family of Bayesian priors designed for multilevel data and obtained by…

统计方法学 · 统计学 2024-07-01 Alessandro Colombi , Raffaele Argiento , Federico Camerlenghi , Lucia Paci

In data-mining applications, we are frequently faced with a large fraction of missing entries in the data matrix, which is problematic for most discriminant machine learning algorithms. A solution that we explore in this paper is the use of…

机器学习 · 计算机科学 2018-01-09 Olivier Delalleau , Aaron Courville , Yoshua Bengio

Diffusion probabilistic models can generate high-quality samples. Yet, their sampling process requires numerous denoising steps, making it slow and computationally intensive. We propose to reduce the sampling cost by pruning a pretrained…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Alireza Ganjdanesh , Yan Kang , Yuchen Liu , Richard Zhang , Zhe Lin , Heng Huang

The Gaussian mixture model is widely used in unsupervised learning, owing to its simplicity and interpretability. However, a fundamental limitation of the classical Gaussian mixture model is that it forces each observation to belong to…

机器学习 · 统计学 2026-04-27 Huan Qing

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

机器学习 · 计算机科学 2025-07-10 Jihao Andreas Lin

A mixture of factor analyzers is a semi-parametric density estimator that generalizes the well-known mixtures of Gaussians model by allowing each Gaussian in the mixture to be represented in a different lower-dimensional manifold. This…

机器学习 · 统计学 2015-10-23 Heysem Kaya , Albert Ali Salah

A mixture of experts models the conditional density of a response variable using a mixture of regression models with covariate-dependent mixture weights. We extend the finite mixture of experts model by allowing the parameters in both the…

统计计算 · 统计学 2022-10-14 Parfait Munezero , Mattias Villani , Robert Kohn

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

机器学习 · 统计学 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

Choosing the most adequate kernel is crucial in many Machine Learning applications. Gaussian Process is a state-of-the-art technique for regression and classification that heavily relies on a kernel function. However, in the Gaussian…

机器学习 · 计算机科学 2019-10-15 Ibai Roman , Roberto Santana , Alexander Mendiburu , Jose A. Lozano

We develop a framework for Gaussian processes regression constrained by boundary value problems. The framework may be applied to infer the solution of a well-posed boundary value problem with a known second-order differential operator and…

机器学习 · 计算机科学 2020-12-23 Mamikon Gulian , Ari Frankel , Laura Swiler

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

机器学习 · 统计学 2022-04-29 Alexander Terenin