中文
相关论文

相关论文: Solving $k$-means on High-dimensional Big Data

200 篇论文

Given the vast reservoirs of data stored worldwide, efficient mining of data from a large information store has emerged as a great challenge. Many databases like that of intrusion detection systems, web-click records, player statistics,…

数据库 · 计算机科学 2010-03-09 Sourav Dutta , Arnab Bhattacharya

This paper describes a new asynchronous algorithm and implementation for the problem of k-mer counting (KC), which concerns quantifying the frequency of length k substrings in a DNA sequence. This operation is common to many computational…

分布式、并行与集群计算 · 计算机科学 2025-05-08 Souvadra Hati , Akihiro Hayashi , Richard Vuduc

In stream processing, stream join is one of the critical sources of performance bottlenecks. The sliding-window-based stream join provides a precise result but consumes considerable computational resources. The current solutions lack…

数据库 · 计算机科学 2018-11-14 Fei Pan , Hans-Arno Jacobsen

Stream mining poses unique challenges to machine learning: predictive models are required to be scalable, incrementally trainable, must remain bounded in size (even when the data stream is arbitrarily long), and be nonparametric in order to…

机器学习 · 统计学 2015-08-21 Rocco De Rosa , Francesco Orabona , Nicolò Cesa-Bianchi

Principal component analysis (PCA) is a fundamental dimension reduction tool in statistics and machine learning. For large and high-dimensional data, computing the PCA (i.e., the singular vectors corresponding to a number of dominant…

数据结构与算法 · 计算机科学 2017-04-26 Wenjian Yu , Yu Gu , Jian Li , Shenghua Liu , Yaohang Li

One of the hardest challenges of the current Big Data landscape is the lack of ability to process huge volumes of information in an acceptable time. The goal of this work, is to ascertain if it is useful to use typical Big Data tools to…

分布式、并行与集群计算 · 计算机科学 2018-05-08 Adrian Bazaga , Michal Pitonak

An existing approach for dealing with massive data sets is to stream over the input in few passes and perform computations with sublinear resources. This method does not work for truly massive data where even making a single pass over the…

计算复杂性 · 计算机科学 2007-05-23 Jon Feldman , S. Muthukrishnan , Anastasios Sidiropoulos , Cliff Stein , Zoya Svitkina

The Incremental K-means (IKM), an improved version of K-means (KM), was introduced to improve the clustering quality of KM significantly. However, the speed of IKM is slower than KM. My thesis proposes two algorithms to speed up IKM while…

机器学习 · 计算机科学 2020-05-12 Tien-Dung Nguyen

The problem of finding a maximum size matching in a graph (known as the maximum matching problem) is one of the most classical problems in computer science. Despite a significant body of work dedicated to the study of this problem in the…

数据结构与算法 · 计算机科学 2021-09-14 Moran Feldman , Ariel Szarf

We present the first feasible method for sampling a dynamic data stream with deletions, where the sample consists of pairs $(k,C_k)$ of a value $k$ and its exact total count $C_k$. Our algorithms are for both Strict Turnstile data streams…

数据结构与算法 · 计算机科学 2012-09-26 Neta Barkay , Ely Porat , Bar Shalem

Finding the k-medianin a network involves identifying a subset of k vertices that minimize the total distance to all other vertices in a graph. This problem has been extensively studied in computer science, graph theory, operations…

数据结构与算法 · 计算机科学 2023-12-14 Roldan Pozo

We present K-Means Batch Bayesian Optimization (KMBBO), a novel batch sampling algorithm for Bayesian Optimization (BO). KMBBO uses unsupervised learning to efficiently estimate peaks of the model acquisition function. We show in empirical…

机器学习 · 统计学 2018-09-20 Matthew Groves , Edward O. Pyzer-Knapp

In a metric space, a set of point sets of roughly the same size and an integer $k\geq 1$ are given as the input and the goal of data-distributed $k$-center is to find a subset of size $k$ of the input points as the set of centers to…

计算几何 · 计算机科学 2023-09-11 Sepideh Aghamolaei , Mohammad Ghodsi

We study high-dimensional robust statistics tasks in the streaming model. A recent line of work obtained computationally efficient algorithms for a range of high-dimensional robust estimation tasks. Unfortunately, all previous algorithms…

数据结构与算法 · 计算机科学 2023-05-04 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Processing-in-cache (PiC) and Processing-in-memory (PiM) architectures, especially those utilizing bit-line computing, offer promising solutions to mitigate data movement bottlenecks within the memory hierarchy. While previous studies have…

计算机与社会 · 计算机科学 2024-07-30 Dhruv Gajaria , Tosiron Adegbija , Kevin Gomez

Big Data streams are being generated in a faster, bigger, and more commonplace. In this scenario, Hoeffding Trees are an established method for classification. Several extensions exist, including high-performing ensemble setups such as…

机器学习 · 计算机科学 2015-11-04 Diego Marrón , Jesse Read , Albert Bifet , Nacho Navarro

The domains of data mining and knowledge discovery make use of large amounts of textual data, which need to be handled efficiently. Specific problems, like finding the maximum weight ordered common subset of a set of ordered sets or…

数据结构与算法 · 计算机科学 2009-12-07 Mugurel Ionut Andreica , Nicolae Tapus

We present a dynamic programming algorithm for selecting a representative subset of size $k$ from a given set with $n$ points such that the Riesz $s$-energy is near minimized. While NP-hard in general dimensions, the one-dimensional case…

数据结构与算法 · 计算机科学 2025-02-11 Michael Emmerich

In the time-decay model for data streams, elements of an underlying data set arrive sequentially with the recently arrived elements being more important. A common approach for handling large data sets is to maintain a \emph{coreset}, a…

数据结构与算法 · 计算机科学 2019-07-18 Vladimir Braverman , Harry Lang , Enayat Ullah , Samson Zhou

The $k$-Means algorithm is one of the most popular choices for clustering data but is well-known to be sensitive to the initialization process. There is a substantial number of methods that aim at finding optimal initial seeds for…

应用统计 · 统计学 2021-06-03 Javier Albert-Smet , Aurora Torrente , Juan Romo