English
Related papers

Related papers: A Semi-Definite Programming approach to low dimens…

200 papers

The goal of clustering is to group similar objects into meaningful partitions. This process is well understood when an explicit similarity measure between the objects is given. However, far less is known when this information is not readily…

Machine Learning · Computer Science 2020-10-12 Michaël Perrot , Pascal Mattia Esser , Debarghya Ghoshdastidar

We introduce a dimension reduction method for visualizing the clustering structure obtained from a finite mixture of Gaussian densities. Information on the dimension reduction subspace is obtained from the variation on group means and,…

Methodology · Statistics 2015-08-10 Luca Scrucca

We describe and analyze a broad class of mixture models for real-valued multivariate data in which the probability density of observations within each component of the model is represented as an arbitrary combination of basis functions.…

Methodology · Statistics 2025-02-28 M. E. J. Newman

We propose a clustering-based generalized low rank approximation method, which takes advantage of appealing features from both the generalized low rank approximation of matrices (GLRAM) and cluster analysis. It exploits a more general form…

Optimization and Control · Mathematics 2025-02-21 Yujun Zhu , Jie Zhu , Hizba Arshad , Zhongming Wang , Ju Ming

In the framework of Bayesian model-based clustering based on a finite mixture of Gaussian distributions, we present a joint approach to estimate the number of mixture components and identify cluster-relevant variables simultaneously as well…

Methodology · Statistics 2016-06-23 Gertraud Malsiner-Walli , Sylvia Frühwirth-Schnatter , Bettina Grün

Clustering is widely used in unsupervised learning method that deals with unlabeled data. Deep clustering has become a popular study area that relates clustering with Deep Neural Network (DNN) architecture. Deep clustering method…

Machine Learning · Computer Science 2020-07-14 Abu Quwsar Ohi , M. F. Mridha , Farisa Benta Safir , Md. Abdul Hamid , Muhammad Mostafa Monowar

In this paper, we consider the problem of partitioning a small data sample of size $n$ drawn from a mixture of $2$ sub-gaussian distributions. Our work is motivated by the application of clustering individuals according to their population…

Statistics Theory · Mathematics 2023-01-05 Shuheng Zhou

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for network analysis as it…

Machine Learning · Computer Science 2021-08-10 Rayyan Ahmad Khan , Martin Kleinsteuber

In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Antoine Aspeel , Jean-Charles Delvenne , Johan A. K. Suykens

When approaching a clustering problem, choosing the right clustering algorithm and parameters is essential, as each clustering algorithm is proficient at finding clusters of a particular nature. Due to the unsupervised nature of clustering…

Machine Learning · Computer Science 2021-08-26 Elizabeth Ditton , Anne Swinbourne , Trina Myers , Mitchell Scovell

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

Machine Learning · Computer Science 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

Semidefinite programming (SDP) is a powerful framework from convex optimization that has striking potential for data science applications. This paper develops a provably correct randomized algorithm for solving large, weakly constrained SDP…

Optimization and Control · Mathematics 2021-03-26 Alp Yurtsever , Joel A. Tropp , Olivier Fercoq , Madeleine Udell , Volkan Cevher

We present a new technique for visualizing high-dimensional data called cluster MDS (cl-MDS), which addresses a common difficulty of dimensionality reduction methods: preserving both local and global structures of the original sample in a…

Graphics · Computer Science 2024-05-27 Patricia Hernández-León , Miguel A. Caro

We present a Bayesian approach to identify optimal transformations that map model input points to low dimensional latent variables. The "projection" mapping consists of an orthonormal matrix that is considered a priori unknown and needs to…

Machine Learning · Statistics 2021-09-22 Panagiotis Tsilifis , Piyush Pandita , Sayan Ghosh , Valeria Andreoli , Thomas Vandeputte , Liping Wang

Metric embeddings are a widely used method in algorithm design, where generally a ``complex'' metric is embedded into a simpler, lower-dimensional one. Historically, the theoretical computer science community has focused on bi-Lipschitz…

Data Structures and Algorithms · Computer Science 2025-05-19 Ainesh Bakshi , Vincent Cohen-Addad , Samuel B. Hopkins , Rajesh Jayaram , Silvio Lattanzi

Clustering procedures suitable for the analysis of very high-dimensional data are needed for many modern data sets. In model-based clustering, a method called high-dimensional data clustering (HDDC) uses a family of Gaussian mixture models…

Methodology · Statistics 2017-06-28 Angelina Pesevski , Brian C. Franczak , Paul D. McNicholas

We investigate a Gaussian mixture model (GMM) with component means constrained in a pre-selected subspace. Applications to classification and clustering are explored. An EM-type estimation algorithm is derived. We prove that the subspace…

Machine Learning · Statistics 2015-08-27 Mu Qiao , Jia Li

Embeddings are a basic initial feature extraction step in many machine learning models, particularly in natural language processing. An embedding attempts to map data tokens to a low-dimensional space where similar tokens are mapped to…

Machine Learning · Computer Science 2025-04-10 Golara Ahmadi Azar , Melika Emami , Alyson Fletcher , Sundeep Rangan

Most of existing embedding based recommendation models use embeddings (vectors) corresponding to a single fixed point in low-dimensional space, to represent users and items. Such embeddings fail to precisely represent the users/items with…

Information Retrieval · Computer Science 2020-06-22 Junyang Jiang , Deqing Yang , Yanghua Xiao , Chenlu Shen

We introduce a novel approach to improve unsupervised hashing. Specifically, we propose a very efficient embedding method: Gaussian Mixture Model embedding (Gemb). The proposed method, using Gaussian Mixture Model, embeds feature vector…

Computer Vision and Pattern Recognition · Computer Science 2017-07-05 Tuan Hoang , Thanh-Toan Do , Dang-Khoa Le Tan , Ngai-Man Cheung