English
Related papers

Related papers: Semi-supervised cross-entropy clustering with info…

200 papers

In this paper, we focus on finding clusters in partially categorized data sets. We propose a semi-supervised version of Gaussian mixture model, called C3L, which retrieves natural subgroups of given categories. In contrast to other…

Machine Learning · Computer Science 2017-05-05 Marek Śmieja , Łukasz Struski , Jacek Tabor

The information bottleneck (IB) approach to clustering takes a joint distribution $P\!\left(X,Y\right)$ and maps the data $X$ to cluster labels $T$ which retain maximal information about $Y$ (Tishby et al., 1999). This objective results in…

Machine Learning · Statistics 2020-06-02 DJ Strouse , David J Schwab

Semi-supervised clustering techniques have emerged as valuable tools for leveraging prior information in the form of constraints to improve the quality of clustering outcomes. Despite the proliferation of such methods, the ability to…

Machine Learning · Computer Science 2023-12-19 Guangjie Zeng , Hao Peng , Angsheng Li , Zhiwei Liu , Runze Yang , Chunyang Liu , Lifang He

We construct a cross-entropy clustering (CEC) theory which finds the optimal number of clusters by automatically removing groups which carry no information. Moreover, our theory gives simple and efficient criterion to verify cluster…

Information Theory · Computer Science 2014-05-19 Przemysław Spurek , Jacek Tabor

Semi-supervised clustering aims to introduce prior knowledge in the decision process of a clustering algorithm. In this paper, we propose a novel semi-supervised clustering algorithm based on the information-maximization principle. The…

Machine Learning · Computer Science 2013-05-02 Daniele Calandriello , Gang Niu , Masashi Sugiyama

We consider an extension of model-based clustering to the semi-supervised case, where some of the data are pre-labeled. We provide a derivation of the Bayesian Information Criterion (BIC) approximation to the Bayes factor in this setting.…

Methodology · Statistics 2016-04-28 Jordan Yoder , Carey E. Priebe

Subspace clustering refers to the problem of segmenting high dimensional data drawn from a union of subspaces into the respective subspaces. In some applications, partial side-information to indicate "must-link" or "cannot-link" in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Chun-Guang Li , Junjian Zhang , Jun Guo

In many modern applications, there is interest in analyzing enormous data sets that cannot be easily moved across computers or loaded into memory on a single computer. In such settings, it is very common to be interested in clustering.…

Computation · Statistics 2020-05-15 Hanyu Song , Yingjian Wang , David B. Dunson

The R Package CEC performs clustering based on the cross-entropy clustering (CEC) method, which was recently developed with the use of information theory. The main advantage of CEC is that it combines the speed and simplicity of $k$-means…

Machine Learning · Computer Science 2015-08-20 Jacek Tabor , Przemysław Spurek , Konrad Kamieniecki , Marek Śmieja , Krzysztof Misztal

Cluster analysis methods seek to partition a data set into homogeneous subgroups. It is useful in a wide variety of applications, including document processing and modern genetics. Conventional clustering methods are unsupervised, meaning…

Methodology · Statistics 2014-07-11 Eric Bair

The performance of supervised classification techniques often deteriorates when the data has noisy labels. Even the semi-supervised classification approaches have largely focused only on the problem of handling missing labels. Most of the…

Machine Learning · Computer Science 2022-05-05 Ashit Gupta , Anirudh Deodhar , Tathagata Mukherjee , Venkataramana Runkana

Crowdsourcing has emerged as a powerful paradigm for efficiently labeling large datasets and performing various learning tasks, by leveraging crowds of human annotators. When additional information is available about the data,…

Machine Learning · Computer Science 2021-07-19 Panagiotis A. Traganitis , Georgios B. Giannakis

Many studies in data mining have proposed a new learning called semi-Supervised. Such type of learning combines unlabeled and labeled data which are hard to obtain. However, in unsupervised methods, the only unlabeled data are used. The…

Machine Learning · Computer Science 2013-04-16 Badreddine Meftahi , Ourida Ben Boubaker Saidi

We propose to bridge the gap between semi-supervised and unsupervised image recognition with a flexible method that performs well for both generalized category discovery (GCD) and image clustering. Despite the overlap in motivation between…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Gihan Jayatilaka , Abhinav Shrivastava , Matthew Gwilliam

We consider the problem of data clustering with unidentified feature quality and when a small amount of labelled data is provided. An unsupervised sparse clustering method can be employed in order to detect the subgroup of features…

Machine Learning · Computer Science 2020-10-20 Avgoustinos Vouros , Eleni Vasilaki

There has been an increasing interest in semi-supervised learning in the recent years because of the great number of datasets with a large number of unlabeled data but only a few labeled samples. Semi-supervised learning algorithms can work…

Machine Learning · Computer Science 2020-03-26 Pedro H. M. Braga , Hansenclever F. Bassani

In this paper, we explore the problem of deep multi-view subspace clustering framework from an information-theoretic point of view. We extend the traditional information bottleneck principle to learn common information among different views…

Machine Learning · Computer Science 2023-03-22 Shiye Wang , Changsheng Li , Yanming Li , Ye Yuan , Guoren Wang

The use of a finite mixture of normal distributions in model-based clustering allows to capture non-Gaussian data clusters. However, identifying the clusters from the normal components is challenging and in general either achieved by…

Methodology · Statistics 2016-06-21 Gertraud Malsiner-Walli , Sylvia Frühwirth-Schnatter , Bettina Grün

Local clustering aims to identify specific substructures within a large graph without any additional structural information of the graph. These substructures are typically small compared to the overall graph, enabling the problem to be…

Machine Learning · Computer Science 2025-10-31 Zhaiming Shen , Sung Ha Kang

Multi-view learning is widely applied to real-life datasets, such as multiple omics biological data, but it often suffers from both missing views and missing labels. Prior probabilistic approaches addressed the missing view problem by using…

Machine Learning · Computer Science 2025-08-18 Yiyang Shen , Weiran Wang
‹ Prev 1 2 3 10 Next ›