中文
相关论文

相关论文: Sketch and Scale: Geo-distributed tSNE and UMAP

200 篇论文

The blooming availability of traces for social, biological, and communication networks opens up unprecedented opportunities in analyzing diffusion processes in networks. However, the sheer sizes of the nowadays networks raise serious…

数据结构与算法 · 计算机科学 2017-09-13 Hung T. Nguyen , Tri P. Nguyen , NhatHai Phan , Thang N. Dinh

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

机器学习 · 计算机科学 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

In this paper, we introduce a Fast and Scalable Semi-supervised Multi-view Subspace Clustering (FSSMSC) method, a novel solution to the high computational complexity commonly found in existing approaches. FSSMSC features linear…

机器学习 · 计算机科学 2024-08-13 Huaming Ling , Chenglong Bao , Jiebo Song , Zuoqiang Shi

Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts…

数据结构与算法 · 计算机科学 2024-02-14 Homin K. Lee , Charles Masson

Hyperspectral Imagery (and Remote Sensing in general) captured from UAVs or satellites are highly voluminous in nature due to the large spatial extent and wavelengths captured by them. Since analyzing these images requires a huge amount of…

图像与视频处理 · 电气工程与系统科学 2020-05-12 Megh Shukla , Biplab Banerjee , Krishna Mohan Buddhiraju

We present a new technique called "DSNE" which learns the velocity embeddings of low dimensional map points when given the high-dimensional data points with its velocities. The technique is a variation of Stochastic Neighbor Embedding,…

机器学习 · 计算机科学 2021-03-16 Songting Shi

Distributed training is an effective way to accelerate the training process of large-scale deep learning models. However, the parameter exchange and synchronization of distributed stochastic gradient descent introduce a large amount of…

分布式、并行与集群计算 · 计算机科学 2021-08-16 LingFei Dai , Boyu Diao , Chao Li , Yongjun Xu

Dimensionality reduction is crucial both for visualization and preprocessing high dimensional data for machine learning. We introduce a novel method based on a hierarchy built on 1-nearest neighbor graphs in the original space which is used…

计算机视觉与模式识别 · 计算机科学 2022-05-31 M. Saquib Sarfraz , Marios Koulakis , Constantin Seibold , Rainer Stiefelhagen

Matrix sketching is a powerful tool for reducing the size of large data matrices. Yet there are fundamental limitations to this size reduction when we want to recover an accurate estimator for a task such as least square regression. We show…

数据结构与算法 · 计算机科学 2024-05-10 Sachin Garg , Kevin Tan , Michał Dereziński

T-SNE is a well-known approach to embedding high-dimensional data and has been widely used in data visualization. The basic assumption of t-SNE is that the data are non-constrained in the Euclidean space and the local proximity can be…

机器学习 · 计算机科学 2015-08-06 Mian Wang , Dong Wang

In this work, the use of t-SNE is proposed to embed 3D point clouds of plants into 2D space for plant characterization. It is demonstrated that t-SNE operates as a practical tool to flatten and visualize a complete 3D plant model in 2D…

计算机视觉与模式识别 · 计算机科学 2023-02-08 Helin Dutagaci

Approximate Nearest Neighbor (ANN) search and Approximate Kernel Density Estimation (A-KDE) are fundamental problems at the core of modern machine learning, with broad applications in data analysis, information systems, and large-scale…

机器学习 · 计算机科学 2025-10-28 Ved Danait , Srijan Das , Sujoy Bhore

Dimensionality reduction techniques aim at representing high-dimensional data in low-dimensional spaces to extract hidden and useful information or facilitate visual understanding and interpretation of the data. However, few of them take…

机器学习 · 计算机科学 2022-10-25 Yan Sun , Yi Han , Jicong Fan

Coverage problems are central in optimization and have a wide range of applications in data mining and machine learning. While several distributed algorithms have been developed for coverage problems, the existing methods suffer from…

数据结构与算法 · 计算机科学 2017-03-13 MohammadHossein Bateni , Hossein Esfandiari , Vahab Mirrokni

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

数据库 · 计算机科学 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Neighbor embedding methods $t$-SNE and UMAP are the de facto standard for visualizing high-dimensional datasets. Motivated from entirely different viewpoints, their loss functions appear to be unrelated. In practice, they yield strongly…

机器学习 · 计算机科学 2024-06-06 Sebastian Damrich , Jan Niklas Böhm , Fred A. Hamprecht , Dmitry Kobak

Random column sampling is not guaranteed to yield data sketches that preserve the underlying structures of the data and may not sample sufficiently from less-populated data clusters. Also, adaptive sampling can often provide accurate low…

机器学习 · 计算机科学 2017-10-11 Mostafa Rahmani , George Atia

This article explores and analyzes the unsupervised clustering of large partially observed graphs. We propose a scalable and provable randomized framework for clustering graphs generated from the stochastic block model. The clustering is…

社会与信息网络 · 计算机科学 2022-12-06 Mostafa Rahmani , Andre Beckus , Adel Karimian , George Atia

Traditional sketch segmentation methods mainly rely on handcrafted features and complicate models, and their performance is far from satisfactory due to the abstract representation of sketches. Recent success of Deep Neural Networks (DNNs)…

图像与视频处理 · 电气工程与系统科学 2018-12-31 Fei Wang , Shujin Lin , Hanhui Li , Hefeng Wu , Junkun Jiang , Ruomei Wang , Xiaonan Luo

We introduce Density sketches (DS): a succinct online summary of the data distribution. DS can accurately estimate point wise probability density. Interestingly, DS also provides a capability to sample unseen novel data from the underlying…

数据结构与算法 · 计算机科学 2021-02-25 Aditya Desai , Benjamin Coleman , Anshumali Shrivastava