中文
相关论文

相关论文: A Minimal Variance Estimator for the Cardinality o…

200 篇论文

Network traffic data is huge, varying and imbalanced because various classes are not equally distributed. Machine learning (ML) algorithms for traffic analysis uses the samples from this data to recommend the actions to be taken by the…

网络与互联网体系结构 · 计算机科学 2013-11-13 Raman Singh , Harish Kumar , R. K. Singla

We discuss the problem of counting distinct elements in a stream. A stream is usually considered as a sequence of elements that come one at a time. An exact solution to the problem requires memory space of the size of the stream. For many…

数据结构与算法 · 计算机科学 2021-06-18 Tal Ohayon

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

数据结构与算法 · 计算机科学 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

This paper investigates parallel random sampling from a potentially-unending data stream whose elements are revealed in a series of element sequences (minibatches). While sampling from a stream was extensively studied sequentially, not much…

数据结构与算法 · 计算机科学 2019-06-11 Kanat Tangwongsan , Srikanta Tirthapura

In this paper, we develop the first one-pass streaming algorithm for submodular maximization that does not evaluate the entire stream even once. By carefully subsampling each element of data stream, our algorithm enjoys the tightest…

机器学习 · 计算机科学 2018-02-21 Moran Feldman , Amin Karbasi , Ehsan Kazemi

Given a pair of graphs with the same number of vertices, the inexact graph matching problem consists in finding a correspondence between the vertices of these graphs that minimizes the total number of induced edge disagreements. We study…

机器学习 · 统计学 2020-07-06 Jesús Arroyo , Daniel L. Sussman , Carey E. Priebe , Vince Lyzinski

Common clustering algorithms require multiple scans of all the data to achieve convergence, and this is prohibitive when large databases, with data arriving in streams, must be processed. Some algorithms to extend the popular K-means method…

应用统计 · 统计学 2017-12-22 Giacomo Aletti , Alessandra Micheletti

Simulation-free methods for training continuous-time generative models construct probability paths that go between noise distributions and individual data samples. Recent works, such as Flow Matching, derived paths that are optimal for each…

Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of…

机器学习 · 计算机科学 2025-02-13 Florian Kalinke , Marco Heyden , Georg Gntuni , Edouard Fouché , Klemens Böhm

Subgraph counting is a fundamental problem in understanding and analyzing graph structured data, yet computationally challenging. This calls for an accurate and efficient algorithm for Subgraph Cardinality Estimation, which is to estimate…

数据库 · 计算机科学 2024-04-16 Wonseok Shin , Siwoo Song , Kunsoo Park , Wook-Shin Han

We introduce a new computational model for data streams: asymptotically exact streaming algorithms. These algorithms have an approximation ratio that tends to one as the length of the stream goes to infinity while the memory used by the…

数据结构与算法 · 计算机科学 2014-08-11 Marc Heinrich , Alexander Munteanu , Christian Sohler

Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the…

统计方法学 · 统计学 2023-11-16 Haohui Han , Liya Fu

Multi-stream sequential change detection involves simultaneously monitoring many streams of data and trying to detect when their distributions change, if at all. Here, we theoretically study multiple testing issues that arise from detecting…

统计理论 · 数学 2025-02-04 Sanjit Dandapanthula , Aaditya Ramdas

We propose a streaming algorithm for the binary classification of data based on crowdsourcing. The algorithm learns the competence of each labeller by comparing her labels to those of other labellers on the same tasks and uses this…

机器学习 · 统计学 2016-02-24 Thomas Bonald , Richard Combes

In this paper, we design the first streaming algorithms for the problem of multitasking scheduling on parallel machines with shared processing. In one pass, our streaming approximation schemes can provide an approximate value of the optimal…

数据结构与算法 · 计算机科学 2022-04-06 Bin Fu , Yumei Huo , Hairong Zhao

Running machine learning algorithms on large and rapidly growing volumes of data is often computationally expensive, one common trick to reduce the size of a data set, and thus reduce the computational cost of machine learning algorithms,…

机器学习 · 计算机科学 2022-01-25 Shaojie Tang , Jing Yuan

The maximum clique problem is a well known NP-Hard problem with applications in data mining, network analysis, information retrieval and many other areas related to the World Wide Web. There exist several algorithms for the problem with…

数据结构与算法 · 计算机科学 2014-12-01 Bharath Pattabiraman , Md. Mostofa Ali Patwary , Assefaw H. Gebremedhin , Wei-keng Liao , Alok Choudhary

Given a dataset of points in a metric space and an integer $k$, a diversity maximization problem requires determining a subset of $k$ points maximizing some diversity objective measure, e.g., the minimum or the average distance between two…

分布式、并行与集群计算 · 计算机科学 2017-01-24 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci , Eli Upfal

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

数值分析 · 数学 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

Modern information systems generate large volumes of data with anomalies that occur at unknown points in time and have to be detected quickly and reliably with low false alarm rates. The paper develops a general theory of quickest…

统计理论 · 数学 2023-05-16 Alexander G Tartakovsky , Valentin Spivak