English
Related papers

Related papers: Semi-supervised cross-entropy clustering with info…

200 papers

Semi-supervised clustering is an very important topic in machine learning and computer vision. The key challenge of this problem is how to learn a metric, such that the instances sharing the same label are more likely close to each other on…

Machine Learning · Computer Science 2015-01-27 Gang Chen

Maximum likelihood estimates (MLEs) are asymptotically normally distributed, and this property is used in meta-analyses to test the heterogeneity of estimates, either for a single cluster or for several sub-groups. More recently, MLEs for…

Statistics Theory · Mathematics 2022-02-28 Anthony J. Webster

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

Machine Learning · Computer Science 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

Semi-Supervised Semantic Segmentation reduces reliance on extensive annotations by using unlabeled data and state-of-the-art models to improve overall performance. Despite the success of deep co-training methods, their underlying mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Thuan Than , Nhat-Anh Nguyen-Dang , Dung Nguyen , Salwa K. Al Khatib , Ahmed Elhagry , Hai Phan , Yihui He , Zhiqiang Shen , Marios Savvides , Dang Huynh

Consider a semi-supervised setting with a labeled dataset of binary responses and predictors and an unlabeled dataset with only the predictors. Logistic regression is equivalent to an exponential tilt model in the labeled population. For…

Machine Learning · Statistics 2023-11-16 Ye Tian , Xinwei Zhang , Zhiqiang Tan

Non-Gaussian mixture models are gaining increasing attention for mixture model-based clustering particularly when dealing with data that exhibit features such as skewness and heavy tails. Here, such a mixture distribution is presented,…

Computation · Statistics 2020-05-07 Yuan Fang , Dimitris Karlis , Sanjeena Subedi

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…

Machine Learning · Computer Science 2020-12-23 Ziqi Pan , Li Niu , Jianfu Zhang , Liqing Zhang

Deep learning systems have been reported to achieve state-of-the-art performances in many applications, and a key is the existence of well trained classifiers on benchmark datasets. As a main-stream loss function, the cross entropy can…

Machine Learning · Computer Science 2022-09-22 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao

Subspace clustering algorithms are used for understanding the cluster structure that explains the dataset well. These methods are extensively used for data-exploration tasks in various areas of Natural Sciences. However, most of these…

Machine Learning · Computer Science 2022-11-15 Ashutosh Singh , Ashish Singh , Aria Masoomi , Tales Imbiriba , Erik Learned-Miller , Deniz Erdogmus

We propose a novel method for multiple clustering that assumes a co-clustering structure (partitions in both rows and columns of the data matrix) in each view. The new method is applicable to high-dimensional data. It is based on a…

Cluster analysis relates to the task of assigning objects into groups which ideally present some desirable characteristics. When a cluster structure is confined to a subset of the feature space, traditional clustering techniques face…

Machine Learning · Statistics 2026-04-14 Efthymios Costa , Ioanna Papatsouma , Angelos Markos

The core of clustering is incorporating prior knowledge to construct supervision signals. From classic k-means based on data compactness to recent contrastive clustering guided by self-supervision, the evolution of clustering methods…

Machine Learning · Computer Science 2024-07-17 Yunfan Li , Peng Hu , Dezhong Peng , Jiancheng Lv , Jianping Fan , Xi Peng

In this paper, we study the semi-supervised semantic segmentation problem via exploring both labeled data and extra unlabeled data. We propose a novel consistency regularization approach, called cross pseudo supervision (CPS). Our approach…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Xiaokang Chen , Yuhui Yuan , Gang Zeng , Jingdong Wang

Multi-view clustering has attracted much attention thanks to the capacity of multi-source information integration. Although numerous advanced methods have been proposed in past decades, most of them generally overlook the significance of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Rui Chen , Yongqiang Tang , Wensheng Zhang , Wenlong Feng

Semi-supervised learning has been well developed to help reduce the cost of manual labelling by exploiting a large quantity of unlabelled data. Especially in the application of land cover classification, pixel-level manual labelling in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Wanli Ma , Oktay Karakus , Paul L. Rosin

Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization. However, its training procedure suffers from confirmation bias due to the noise contained in self-generated artificial labels. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Fan Yang , Kai Wu , Shuyi Zhang , Guannan Jiang , Yong Liu , Feng Zheng , Wei Zhang , Chengjie Wang , Long Zeng

The cross entropy (CE) method is a model based search method to solve optimization problems where the objective function has minimal structure. The Monte-Carlo version of the CE method employs the naive sample averaging technique which is…

Artificial Intelligence · Computer Science 2018-02-01 Ajin George Joseph , Shalabh Bhatnagar

We consider semi-supervised binary classification for applications in which data points are naturally grouped (e.g., survey responses grouped by state) and the labeled data is biased (e.g., survey respondents are not representative of the…

Machine Learning · Statistics 2022-12-08 Daniel Zeiberg , Shantanu Jain , Predrag Radivojac

Fusing data from multiple modalities provides more information to train machine learning systems. However, it is prohibitively expensive and time-consuming to label each modality with a large amount of data, which leads to a crucial problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Xinwei Sun , Yilun Xu , Peng Cao , Yuqing Kong , Lingjing Hu , Shanghang Zhang , Yizhou Wang

Incomplete Multi-View Clustering aims to enhance clustering performance by using data from multiple modalities. Despite the fact that several approaches for studying this issue have been proposed, the following drawbacks still persist: 1)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jiatai Wang , Zhiwei Xu , Xuewen Yang , Dongjin Guo , Limin Liu