English
Related papers

Related papers: Near Optimal Linear Algebra in the Online and Slid…

200 papers

Analyzing massive data sets has been one of the key motivations for studying streaming algorithms. In recent years, there has been significant progress in analysing distributions in a streaming setting, but the progress on graph problems…

Data Structures and Algorithms · Computer Science 2009-05-05 Kook Jin Ahn , Sudipto Guha

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

Graph Representation Learning (GRL) has become a key paradigm in network analysis, with a plethora of interdisciplinary applications. As the scale of networks increases, most of the widely used learning-based graph representation models…

Machine Learning · Computer Science 2022-10-12 Abdulkadir Çelikkanat , Fragkiskos D. Malliaros , Apostolos N. Papadopoulos

We study distributionally robust online learning, where a risk-averse learner updates decisions sequentially to guard against worst-case distributions drawn from a Wasserstein ambiguity set centered at past observations. While this paradigm…

Machine Learning · Computer Science 2026-02-25 Guixian Chen , Salar Fattahi , Soroosh Shafiee

Online Resource Allocation problem is a central problem in many areas of Computer Science, Operations Research, and Economics. In this problem, we sequentially receive $n$ stochastic requests for $m$ kinds of shared resources, where each…

Data Structures and Algorithms · Computer Science 2025-05-07 Rohan Ghuge , Sahil Singla , Yifan Wang

Online learning updates models incrementally with new data, avoiding large storage requirements and costly model recalculations. In this paper, we introduce "OLR-WA; OnLine Regression with Weighted Average", a novel and versatile…

Machine Learning · Computer Science 2025-12-18 Mohammad Abu-Shaira , Alejandro Rodriguez , Greg Speegle , Victor Sheng , Ishfaq Ahmad

We consider a natural semi-online model for weighted paging, where at any time the algorithm is given predictions, possibly with errors, about the next arrival of each page. The model is inspired by Belady's classic optimal offline…

Data Structures and Algorithms · Computer Science 2021-11-10 Nikhil Bansal , Christian Coester , Ravi Kumar , Manish Purohit , Erik Vee

Typical LiDAR SLAM architectures feature a front-end for odometry estimation and a back-end for refining and optimizing the trajectory and map, commonly through loop closures. However, loop closure detection in large-scale missions presents…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Nikolaos Stathoulopoulos , Christoforos Kanellakis , George Nikolakopoulos

Large data applications rely on storing data in massive, sparse graphs with millions to trillions of nodes. Graph-based methods, such as node prediction, aim for computational efficiency regardless of graph size. Techniques like localized…

Data Structures and Algorithms · Computer Science 2025-07-08 Yushen Huang , Ertai Luo , Reza Babenezhad , Yifan Sun

Recent work in the matrix completion literature has shown that prior knowledge of a matrix's row and column spaces can be successfully incorporated into reconstruction programs to substantially benefit matrix recovery. This paper proposes a…

Information Theory · Computer Science 2025-09-10 Oscar López

We propose an online debiased lasso (ODL) method for statistical inference in high-dimensional linear models with streaming data. The proposed ODL consists of an efficient computational algorithm for streaming data and approximately normal…

Statistics Theory · Mathematics 2021-08-20 Ruijian Han , Lan Luo , Yuanyuan Lin , Jian Huang

Neural networks are predominantly trained using gradient-based methods, yet in many applications their final predictions remain far from the accuracy attainable within the model's expressive capacity. We introduce Linearized Subspace…

Machine Learning · Computer Science 2026-01-21 Wenbo Cao , Weiwei Zhang

We generalize the leverage score sampling sketch for $\ell_2$-subspace embeddings, to accommodate sampling subsets of the transformed data, so that the sketching approach is appropriate for distributed settings. This is then used to derive…

Information Theory · Computer Science 2024-06-27 Neophytos Charalambides , Mert Pilanci , Alfred Hero

This paper presents a novel projection-based adaptive algorithm for sparse signal and system identification. The sequentially observed data are used to generate an equivalent sequence of closed convex sets, namely hyperslabs. Each hyperslab…

Information Theory · Computer Science 2015-10-28 Yannis Kopsinis , Konstantinos Slavakis , Sergios Theodoridis

Approximate Nearest Neighbor (ANN) search and Approximate Kernel Density Estimation (A-KDE) are fundamental problems at the core of modern machine learning, with broad applications in data analysis, information systems, and large-scale…

Machine Learning · Computer Science 2025-10-28 Ved Danait , Srijan Das , Sujoy Bhore

In the Sparse Linear Regression (SLR) problem, given a $d \times n$ matrix $M$ and a $d$-dimensional query $q$, the goal is to compute a $k$-sparse $n$-dimensional vector $\tau$ such that the error $||M \tau-q||$ is minimized. This problem…

Computational Geometry · Computer Science 2018-05-01 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi

This survey highlights the recent advances in algorithms for numerical linear algebra that have come from the technique of linear sketching, whereby given a matrix, one first compresses it to a much smaller matrix by multiplying it by a…

Data Structures and Algorithms · Computer Science 2015-02-11 David P. Woodruff

This paper addresses the problem of online network topology inference for expanding graphs from a stream of spatiotemporal signals. Online algorithms for dynamic graph learning are crucial in delay-sensitive applications or when changes in…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Bishwadeep Das , Elvin Isufi

Deep learning models, especially convolutional neural networks, have achieved impressive results in medical image classification. However, these models often produce overconfident predictions, which can undermine their reliability in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Kushan Choudhury , Shubhrodeep Roy , Ankur Chanda , Shubhajit Biswas , Somenath Kuiry

We give the first single-pass streaming algorithm for Column Subset Selection with respect to the entrywise $\ell_p$-norm with $1 \leq p < 2$. We study the $\ell_p$ norm loss since it is often considered more robust to noise than the…

Data Structures and Algorithms · Computer Science 2021-07-19 Shuli Jiang , Dongyu Li , Irene Mengze Li , Arvind V. Mahankali , David P. Woodruff