English
Related papers

Related papers: Large Scale Clustering with Variational EM for Gau…

200 papers

Mixtures of Unigrams are one of the simplest and most efficient tools for clustering textual data, as they assume that documents related to the same topic have similar distributions of terms, naturally described by Multinomials. When the…

Machine Learning · Statistics 2020-12-10 Cinzia Viroli , Laura Anderlucci

Significant progress has been made in learning image classification neural networks under long-tail data distribution using robust training algorithms such as data re-sampling, re-weighting, and margin adjustment. Those methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Lechao Cheng , Chaowei Fang , Dingwen Zhang , Guanbin Li , Gang Huang

We introduce a novel class of Bayesian mixtures for normal linear regression models which incorporates a further Gaussian random component for the distribution of the predictor variables. The proposed cluster-weighted model aims to…

Methodology · Statistics 2026-05-26 Panagiotis Papastamoulis , Konstantinos Perrakis

Massive volumes of high-dimensional data that evolves over time is continuously collected by contemporary information processing systems, which brings up the problem of organizing this data into clusters, i.e. achieve the purpose of…

Machine Learning · Computer Science 2019-10-22 Di Xu , Tianhang Long , Junbin Gao

Similar to many Machine Learning models, both accuracy and speed of the Cluster weighted models (CWMs) can be hampered by high-dimensional data, leading to previous works on a parsimonious technique to reduce the effect of "Curse of…

Machine Learning · Statistics 2022-08-03 Kehinde Olobatuyi

In this paper, we outline the use of Mixture Models in density estimation of large astronomical databases. This method of density estimation has been known in Statistics for some time but has not been implemented because of the large…

Astrophysics · Physics 2007-05-23 A. J. Connolly , C. Genovese , A. W. Moore , R. C. Nichol , J. Schneider , L. Wasserman

The stochastic blockmodel (SBM) models the connectivity within and between disjoint subsets of nodes in networks. Prior work demonstrated that the rows of an SBM's adjacency spectral embedding (ASE) and Laplacian spectral embedding (LSE)…

Methodology · Statistics 2022-05-04 Zachary M. Pisano , Joshua S. Agterberg , Carey E. Priebe , Daniel Q. Naiman

In this conceptual work, we present Deep Convolutional Gaussian Mixture Models (DCGMMs): a new formulation of deep hierarchical Gaussian Mixture Models (GMMs) that is particularly suitable for describing and generating images. Vanilla…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Alexander Gepperth , Benedikt Pfülb

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

Machine Learning · Computer Science 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

Many common clustering methods cannot be used for clustering multivariate longitudinal data in cases where variables exhibit high autocorrelations. In this article, a copula kernel mixture model (CKMM) is proposed for clustering data of…

Methodology · Statistics 2025-06-23 Xi Zhang , Orla A. Murphy , Paul D. McNicholas

The paper is motivated from clustering problem in high-throughput mixed datasets. Clustering of such datasets can provide much insight into biological associations. An open problem in this context is to simultaneously cluster…

Methodology · Statistics 2018-08-15 Chetkar Jha

In this paper we provide a new analysis of the SEM algorithm. Unlike previous work, we focus on the analysis of a single run of the algorithm. First, we discuss the algorithm for general mixture distributions. Second, we consider Gaussian…

Machine Learning · Computer Science 2014-07-03 Johannes Blömer , Kathrin Bujna , Daniel Kuntze

Cluster-and-aggregate techniques such as Vector of Locally Aggregated Descriptors (VLAD), and their end-to-end discriminatively trained equivalents like NetVLAD have recently been popular for video classification and action recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Sirjan Kafle , Aman Gupta , Xue Xia , Ananth Sankar , Xi Chen , Di Wen , Liang Zhang

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

Initialisation of the EM algorithm in model-based clustering is often crucial. Various starting points in the parameter space often lead to different local maxima of the likelihood function and, so to different clustering partitions. Among…

Methodology · Statistics 2015-07-28 Luca Scrucca , Adrian E. Raftery

Bayesian nonparametrics are a class of probabilistic models in which the model size is inferred from data. A recently developed methodology in this field is small-variance asymptotic analysis, a mathematical technique for deriving learning…

Machine Learning · Statistics 2017-07-27 Trevor Campbell , Brian Kulis , Jonathan How

We propose a generalized multiscale finite element method (GMsFEM) based on clustering algorithm to study the elliptic PDEs with random coefficients in the multi-query setting. Our method consists of offline and online stages. In the…

Numerical Analysis · Mathematics 2018-08-01 Eric T. Chung , Yalchin Efendiev , Wing Tat Leung , Zhiwen Zhang

Deep learning methods are primarily proposed for supervised learning of images or text with limited applications to clustering problems. In contrast, tabular data with heterogeneous features pose unique challenges in representation…

Machine Learning · Computer Science 2024-05-20 Shourav B. Rabbani , Ivan V. Medri , Manar D. Samad

Clustering is among the most fundamental tasks in computer vision and machine learning. In this paper, we propose Variational Deep Embedding (VaDE), a novel unsupervised generative clustering approach within the framework of Variational…

Computer Vision and Pattern Recognition · Computer Science 2017-06-29 Zhuxi Jiang , Yin Zheng , Huachun Tan , Bangsheng Tang , Hanning Zhou

LLM pre-training efficacy increasingly depends on data composition rather than sheer volume. Yet, optimal mixing is hindered by categorization flaws: human taxonomies suffer from ontological misalignment, and Euclidean clustering fails to…

Machine Learning · Computer Science 2026-05-27 Yue Min , Ziyun Qiao , Ruining Chen , Yujun Li