English
Related papers

Related papers: Efficient Subspace Search in Data Streams

200 papers

Real-world data is often assumed to lie within a low-dimensional structure embedded in high-dimensional space. In practical settings, we observe only a finite set of samples, forming what we refer to as the sample data subspace. It serves…

Machine Learning · Computer Science 2024-11-01 Weiguo Gao , Ming Li

In many applications, it is often of practical and scientific interest to detect anomaly events in a streaming sequence of high-dimensional or non-Euclidean observations. We study a non-parametric framework that utilizes nearest neighbor…

Methodology · Statistics 2022-10-25 Lynna Chu , Hao Chen

In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements…

Optimization and Control · Mathematics 2022-04-12 Shamak Dutta , Nils Wilde , Stephen L. Smith

This paper considers the detection of change points in parallel data streams, a problem widely encountered when analyzing large-scale real-time streaming data. Each stream may have its own change point, at which its data has a…

Methodology · Statistics 2023-01-18 Zexian Lu , Yunxiao Chen , Xiaoou Li

The detection of anomalies in real time is paramount to maintain performance and efficiency across a wide range of applications including web services and smart manufacturing. This paper presents a novel algorithm to detect anomalies in…

Signal Processing · Electrical Eng. & Systems 2020-07-22 Caitríona M. Ryan , Andrew Parnell , Catherine Mahoney

This work develops a parallelized algorithm to compute the dynamic mode decomposition (DMD) on a graphics processing unit using the streaming method of snapshots singular value decomposition. This allows the algorithm to operate efficiently…

Numerical Analysis · Mathematics 2016-12-26 Seth D. Pendergrass , J. Nathan Kutz , Steven L. Brunton

Analyzing high-dimensional data presents challenges due to the "curse of dimensionality'', making computations intensive. Dimension reduction techniques, categorized as linear or non-linear, simplify such data. Non-linear methods are…

Machine Learning · Statistics 2025-04-15 Praveen T. W. Hettige , Benjamin W. Ong

In this paper, we propose and study the problem of top-m rank aggregation of spatial objects in streaming queries, where, given a set of objects O, a stream of spatial queries (kNN or range), the goal is to report m objects with the highest…

Databases · Computer Science 2016-10-24 Farhana M. Choudhury , Zhifeng Bao , J. Shane Culpepper , Timos Sellis

Many existing algorithms for streaming geometric data analysis have been plagued by exponential dependencies in the space complexity, which are undesirable for processing high-dimensional data sets. In particular, once $d\geq\log n$, there…

Data Structures and Algorithms · Computer Science 2022-09-28 David P. Woodruff , Taisuke Yasuda

We show that both clustering and subspace embeddings can be performed in the streaming model with the same asymptotic efficiency as in the central/offline setting. For $(k, z)$-clustering in the streaming model, we achieve a number of words…

Data Structures and Algorithms · Computer Science 2025-04-24 Vincent Cohen-Addad , Liudeng Wang , David P. Woodruff , Samson Zhou

We introduce and develop a novel approach to outlier detection based on adaptation of random subspace learning. Our proposed method handles both high-dimension low-sample size and traditional low-dimensional high-sample size datasets.…

Machine Learning · Statistics 2015-05-05 Bohan Liu , Ernest Fokoue

Nowadays with a growing number of online controlling systems in the organization and also a high demand of monitoring and stats facilities that uses data streams to log and control their subsystems, data stream mining becomes more and more…

Machine Learning · Computer Science 2019-02-12 Radin Hamidi Rad , Maryam Amir Haeri

Uncertain data streams have been widely generated in many Web applications. The uncertainty in data streams makes anomaly detection from sensor data streams far more challenging. In this paper, we present a novel framework that supports…

Artificial Intelligence · Computer Science 2016-07-21 Jiangang Ma , Le Sun , Hua Wang , Yanchun Zhang , Uwe Aickelin

In large-scale applications including medical imaging, collocation differential equation solvers, and estimation with differential privacy, the underlying linear inverse problem can be reformulated as a streaming problem. In theory, the…

Numerical Analysis · Mathematics 2024-01-31 Nathaniel Pritchard , Vivak Patel

Online augmentation of an oblique aerial image sequence with structural information is an essential aspect in the process of 3D scene interpretation and analysis. One key aspect in this is the efficient dense image matching and depth…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Boitumelo Ruf , Thomas Pollok , Martin Weinmann

Frequency estimation in data streams is one of the classical problems in streaming algorithms. Following much research, there are now almost matching upper and lower bounds for the trade-off needed between the number of samples and the…

Computational Complexity · Computer Science 2023-01-16 Shachar Lovett , Jiapeng Zhang

This paper addresses stochastic optimization in a streaming setting with time-dependent and biased gradient estimates. We analyze several first-order methods, including Stochastic Gradient Descent (SGD), mini-batch SGD, and time-varying…

Machine Learning · Computer Science 2023-07-20 Antoine Godichon-Baggioni , Nicklas Werge , Olivier Wintenberger

Densest subgraph discovery (DSD) is a fundamental problem in graph mining. It has been studied for decades, and is widely used in various areas, including network science, biological analysis, and graph databases. Given a graph G, DSD aims…

Databases · Computer Science 2019-08-08 Yixiang Fang , Kaiqiang Yu , Reynold Cheng , Laks V. S. Lakshmanan , Xuemin Lin

We propose subsampling as a unified algorithmic technique for submodular maximization in centralized and online settings. The idea is simple: independently sample elements from the ground set, and use simple combinatorial techniques (such…

Data Structures and Algorithms · Computer Science 2021-04-08 Christopher Harshaw , Ehsan Kazemi , Moran Feldman , Amin Karbasi

Streaming computation plays an important role in large-scale data analysis. The sliding window model is a model of streaming computation which also captures the recency of the data. In this model, data arrives one item at a time, but only…

Data Structures and Algorithms · Computer Science 2021-11-01 Alessandro Epasto , Mohammad Mahdian , Vahab Mirrokni , Peilin Zhong