中文
相关论文

相关论文: Assessing the impact of dimensionality reduction o…

200 篇论文

Clustering in high-dimensional spaces is a difficult problem which is recurrent in many domains, for example in image analysis. The difficulty is due to the fact that high-dimensional data usually live in different low-dimensional subspaces…

统计理论 · 数学 2016-08-16 Charles Bouveyron , Stéphane Girard , Cordelia Schmid

Deep clustering, a method for partitioning complex, high-dimensional data using deep neural networks, presents unique evaluation challenges. Traditional clustering validation measures, designed for low-dimensional spaces, are problematic…

机器学习 · 统计学 2024-03-25 Zeya Wang , Chenglong Ye

We design new parallel algorithms for clustering in high-dimensional Euclidean spaces. These algorithms run in the Massively Parallel Computation (MPC) model, and are fully scalable, meaning that the local memory in each machine may be…

数据结构与算法 · 计算机科学 2024-07-09 Artur Czumaj , Guichen Gao , Shaofeng H. -C. Jiang , Robert Krauthgamer , Pavel Veselý

In this contribution, the clustering procedure based on K-Means algorithm is studied as an inverse problem, which is a special case of the illposed problems. The attempts to improve the quality of the clustering inverse problem drive to…

数值分析 · 数学 2022-11-16 Alberto Arturo Vergani

The capability of classifying and clustering a desired set of data is an essential part of building knowledge from data. However, as the size and dimensionality of input data increases, the run-time for such clustering algorithms is…

分布式、并行与集群计算 · 计算机科学 2018-07-25 Hadi Mardani Kamali

This paper presents a comparative analysis of different optimization techniques for the K-means algorithm in the context of big data. K-means is a widely used clustering algorithm, but it can suffer from scalability issues when dealing with…

机器学习 · 计算机科学 2024-05-21 Ravil Mussabayev , Rustam Mussabayev

For very large datasets, random projections (RP) have become the tool of choice for dimensionality reduction. This is due to the computational complexity of principal component analysis. However, the recent development of randomized…

机器学习 · 统计学 2019-01-04 Michael Wojnowicz , Di Zhang , Glenn Chisholm , Xuan Zhao , Matt Wolff

A new clustering accuracy measure is proposed to determine the unknown number of clusters and to assess the quality of clustering of a data set given in any dimensional space. Our validity index applies the classical nonparametric…

统计方法学 · 统计学 2022-02-15 Soumita Modak

This paper develops a method to detect model structural changes by applying a Corrected Kernel Principal Component Analysis (CKPCA) to construct the so-called central distribution deviation subspaces. This approach can efficiently identify…

统计方法学 · 统计学 2023-07-18 Luoyao Yu , Lixing Zhu , Ruoqing Zhu , Xuehu Zhu

Principal component analysis (PCA) has well-documented merits for data extraction and dimensionality reduction. PCA deals with a single dataset at a time, and it is challenged when it comes to analyzing multiple datasets. Yet in certain…

机器学习 · 计算机科学 2017-10-27 Gang Wang , Jia Chen , Georgios B. Giannakis

Dimensionality reduction is an important operation in information visualization, feature extraction, clustering, regression, and classification, especially for processing noisy high dimensional data. However, most existing approaches…

机器学习 · 计算机科学 2020-03-26 Zhenhua Shi , Dongrui Wu , Jian Huang , Yu-Kai Wang , Chin-Teng Lin

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

机器学习 · 统计学 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input…

机器学习 · 统计学 2021-09-10 Shaojie Xu , Joel Vaughan , Jie Chen , Agus Sudjianto , Vijayan Nair

Clustering is a common task in machine learning, but clusters of unlabelled data can be hard to quantify. The application of clustering algorithms in chemistry is often dependant on material representation. Ascertaining the effects of…

Dimensionality Reduction (DR) is widely used for visualizing high-dimensional data, often with the goal of revealing expected cluster structure. However, such a structure may not always appear in the projections. Existing DR quality metrics…

机器学习 · 计算机科学 2025-09-05 Diede P. M. van der Hoorn , Alessio Arleo , Fernando V. Paulovich

Distributed Computation has been a recent trend in engineering research. Parallel Computation is widely used in different areas of Data Mining, Image Processing, Simulating Models, Aerodynamics and so forth. One of the major usage of…

分布式、并行与集群计算 · 计算机科学 2017-03-28 C Rashmi

In this paper, we present novel variations of an earlier approach called homogeneous clustering algorithm for reducing dataset size. The intuition behind the approaches proposed in this paper is to partition the dataset into homogeneous…

机器学习 · 计算机科学 2022-08-30 Shril Mody , Janvi Thakkar , Devvrat Joshi , Siddharth Soni , Rohan Patil , Nipun Batra

Big data is transforming our world, revolutionizing operations and analytics everywhere, from financial engineering to biomedical sciences. The complexity of big data often makes dimension reduction techniques necessary before conducting…

统计方法学 · 统计学 2018-01-08 Jianqing Fan , Qiang Sun , Wen-Xin Zhou , Ziwei Zhu

We propose a clustering-based generalized low rank approximation method, which takes advantage of appealing features from both the generalized low rank approximation of matrices (GLRAM) and cluster analysis. It exploits a more general form…

最优化与控制 · 数学 2025-02-21 Yujun Zhu , Jie Zhu , Hizba Arshad , Zhongming Wang , Ju Ming

We present memory-efficient and scalable algorithms for kernel methods used in machine learning. Using hierarchical matrix approximations for the kernel matrix the memory requirements, the number of floating point operations, and the…

机器学习 · 计算机科学 2018-03-29 Elizaveta Rebrova , Gustavo Chavez , Yang Liu , Pieter Ghysels , Xiaoye Sherry Li