English
Related papers

Related papers: Cluster-Specific Predictions with Multi-Task Gauss…

200 papers

Expectation Maximization (EM) is the standard method to learn Gaussian mixtures. Yet its classic, centralized form is often infeasible, due to privacy concerns and computational and communication bottlenecks. Prior work dealt with data…

Machine Learning · Computer Science 2022-01-26 Pedro Valdeira , Cláudia Soares , João Xavier

In cluster analysis interest lies in probabilistically capturing partitions of individuals, items or observations into groups, such that those belonging to the same group share similar attributes or relational profiles. Bayesian posterior…

Methodology · Statistics 2017-03-23 Riccardo Rastelli , Nial Friel

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

The ability of Gaussian processes (GPs) to predict the behavior of dynamical systems as a more sample-efficient alternative to parametric models seems promising for real-world robotics research. However, the computational complexity of GPs…

Robotics · Computer Science 2022-03-01 Abdolreza Taheri , Joni Pajarinen , Reza Ghabcheloo

We derive an efficient method to perform clustering of nodes in Gaussian graphical models directly from sample data. Nodes are clustered based on the similarity of their network neighborhoods, with edge weights defined by partial…

Machine Learning · Computer Science 2019-10-08 Keith Dillon

One iteration of standard $k$-means (i.e., Lloyd's algorithm) or standard EM for Gaussian mixture models (GMMs) scales linearly with the number of clusters $C$, data points $N$, and data dimensionality $D$. In this study, we explore whether…

Machine Learning · Statistics 2018-04-18 Dennis Forster , Jörg Lücke

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

In this article, a new method, called FWP, is proposed for clustering longitudinal curves. In the proposed method, clusters of mean functions are identified through a weighted concave pairwise fusion method. The EM algorithm and the…

Methodology · Statistics 2023-06-14 Xin Wang

Scientific and engineering problems often require the use of artificial intelligence to aid understanding and the search for promising designs. While Gaussian processes (GP) stand out as easy-to-use and interpretable learners, they have…

Machine Learning · Computer Science 2021-07-01 Liwei Wang , Suraj Yerramilli , Akshay Iyer , Daniel Apley , Ping Zhu , Wei Chen

To identify novel dynamic patterns of gene expression, we develop a statistical method to cluster noisy measurements of gene expression collected from multiple replicates at multiple time points, with an unknown number of clusters. We…

Applications · Statistics 2013-12-02 Audrey Qiuyan Fu , Steven Russell , Sarah J. Bray , Simon Tavaré

In this article, we discuss two specific classes of models - Gaussian Mixture Copula models and Mixture of Factor Analyzers - and the advantages of doing inference with gradient descent using automatic differentiation. Gaussian mixture…

Computation · Statistics 2018-12-17 Siva Rajesh Kasa , Vaibhav Rajan

Gaussian processes (GPs) are non-parametric, flexible, models that work well in many tasks. Combining GPs with deep learning methods via deep kernel learning (DKL) is especially compelling due to the strong representational power induced by…

Machine Learning · Computer Science 2021-07-14 Idan Achituve , Aviv Navon , Yochai Yemini , Gal Chechik , Ethan Fetaya

Partial differential equations (PDEs) have become an essential tool for modeling complex physical systems. Such equations are typically solved numerically via mesh-based methods, such as finite element methods, with solutions over the…

Methodology · Statistics 2024-02-15 Chih-Li Sung , Wenjia Wang , Liang Ding , Xingjian Wang

Some models of clustering processes are formulated and analytically solved employing generating functions methods. Those models include events which result from combined action of the coagulation and fragmentation processes. Fragmentation…

Statistical Mechanics · Physics 2009-11-07 Vladimir M. Dubovik , Arkadi G. Galperin , Viktor S. Richvitsky , Aleksey A. Lushnikov

Gaussian Mixture Models (GMM) do not adapt well to curved and strongly nonlinear data. However, we can use Gaussians in the curvilinear coordinate systems to solve this problem. Moreover, such a solution allows for the adaptation of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Krzysztof Byrski , Przemysław Spurek , Jacek Tabor

Gaussian mixture models (GMM) are the most widely used statistical model for the $k$-means clustering problem and form a popular framework for clustering in machine learning and data analysis. In this paper, we propose a natural semi-random…

Data Structures and Algorithms · Computer Science 2017-11-27 Pranjal Awasthi , Aravindan Vijayaraghavan

We study learning problems in which the conditional distribution of the output given the input varies as a function of additional task variables. In varying-coefficient models with Gaussian process priors, a Gaussian process generates the…

Machine Learning · Computer Science 2015-10-15 Matthias Bussas , Christoph Sawade , Tobias Scheffer , Niels Landwehr

Gaussian processes (GPs) are an important tool in machine learning and statistics with applications ranging from social and natural science through engineering. They constitute a powerful kernelized non-parametric method with…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

In science and engineering, we often work with models designed for accurate prediction of variables of interest. Recognizing that these models are approximations of reality, it becomes desirable to apply multiple models to the same data and…

Machine Learning · Computer Science 2024-04-03 Marzieh Ajirak , Daniel Waxman , Fernando Llorente , Petar M. Djuric

Determining the number of clusters is a fundamental issue in data clustering. Several algorithms have been proposed, including centroid-based algorithms using the Euclidean distance and model-based algorithms using a mixture of probability…

Machine Learning · Computer Science 2024-07-30 Ryosuke Motegi , Yoichi Seki