English
Related papers

Related papers: Streaming, Memory Limited Matrix Completion with N…

200 papers

Many tasks in machine learning and data mining, such as data diversification, non-parametric learning, kernel machines, clustering etc., require extracting a small but representative summary from a massive dataset. Often, such problems can…

Machine Learning · Computer Science 2018-09-17 Ashkan Norouzi-Fard , Jakub Tarnawski , Slobodan Mitrović , Amir Zandieh , Aida Mousavifar , Ola Svensson

We study the classical problem of maximizing a monotone submodular function subject to a cardinality constraint k, with two additional twists: (i) elements arrive in a streaming fashion, and (ii) m items from the algorithm's memory are…

Data Structures and Algorithms · Computer Science 2017-11-27 Slobodan Mitrović , Ilija Bogunovic , Ashkan Norouzi-Fard , Jakub Tarnawski , Volkan Cevher

Matrix completion is a classical problem that has received recurring interest across a wide range of fields. In this paper, we revisit this problem in an ultra-sparse sampling regime, where each entry of an unknown, $n\times d$ matrix $M$…

Machine Learning · Computer Science 2026-01-21 Hongyang R. Zhang , Zhenshuo Zhang , Huy L. Nguyen , Guanghui Lan

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

Despite rapid advancements in lifelong learning (LLL) research, a large body of research mainly focuses on improving the performance in the existing \textit{static} continual learning (CL) setups. These methods lack the ability to succeed…

Machine Learning · Computer Science 2023-01-30 Soumya Banerjee , Vinay Kumar Verma , Vinay P. Namboodiri

Monitoring the performance of large shared computing systems such as the cloud computing infrastructure raises many challenging algorithmic problems. One common problem is to track users with the largest deviation from the norm (outliers),…

Databases · Computer Science 2009-07-20 Chiranjeeb Buragohain , Luca Foschini , Subhash Suri

Streaming tensor factorization is a powerful tool for processing high-volume and multi-way temporal data in Internet networks, recommender systems and image/video data analysis. In many applications the full tensor is not known, but instead…

Signal Processing · Electrical Eng. & Systems 2018-09-06 Cole Hawkins , Zheng Zhang

The problem of finding the missing values of a matrix given a few of its entries, called matrix completion, has gathered a lot of attention in the recent years. Although the problem under the standard low rank assumption is NP-hard,…

Machine Learning · Computer Science 2014-12-01 Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

The matrix profile (MP) is a data structure computed from a time series which encodes the data required to locate motifs and discords, corresponding to recurring patterns and outliers respectively. When the time series contains noisy data…

Machine Learning · Computer Science 2023-06-21 Colin Hehir , Alan F. Smeaton

In this work, we consider the matrix completion problem, where the objective is to reconstruct a low-rank matrix from a few observed entries. A commonly employed approach involves nuclear norm minimization. For this method to succeed, the…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Hamideh. Sadat Fazael Ardakani , Sajad Daei , Arash Amini , Mikael Skoglund , Gabor Fodor

We consider the problem of computing distance between a pattern of length $n$ and all $n$-length subwords of a text in the streaming model. In the streaming setting, only the Hamming distance ($L_0$) has been studied. It is known that…

Data Structures and Algorithms · Computer Science 2020-11-10 Tatiana Starikovskaya , Michal Svagerka , Przemysław Uznański

MIMO (multiple input, multiple output) approaches are a recent trend in neural network architectures for video restoration problems, where each network evaluation produces multiple output frames. The video is split into non-overlapping…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Valéry Dewil , Zhe Zheng , Arnaud Barral , Lara Raad , Nao Nicolas , Ioannis Cassagne , Jean-michel Morel , Gabriele Facciolo , Bruno Galerne , Pablo Arias

This paper introduces Memory-limited Online Subspace Estimation Scheme (MOSES) for both estimating the principal components of streaming data and reducing its dimension. More specifically, in various applications such as sensor networks,…

Information Theory · Computer Science 2021-02-12 Armin Eftekhari , Raphael A. Hauser , Andreas Grammenos

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

Statistics Theory · Mathematics 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang

With the rising penetration of distributed energy resources, distribution system control and enabling techniques such as state estimation have become essential to distribution system operation. However, traditional state estimation…

Optimization and Control · Mathematics 2019-04-11 Priya L. Donti , Yajing Liu , Andreas J. Schmitt , Andrey Bernstein , Rui Yang , Yingchen Zhang

Inductive Matrix Completion (IMC) is an important class of matrix completion problems that allows direct inclusion of available features to enhance estimation capabilities. These models have found applications in personalized recommendation…

Machine Learning · Statistics 2016-09-14 Akshay Soni , Troy Chevalier , Swayambhoo Jain

Unlike offline processing, streaming video vision-language models face two fundamental constraints: causality and accumulation. Causality prevents access to future frames that offline methods exploit, while accumulation causes tokens to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xueyi Chen , Keda Tao , Kele Shao , Huan Wang

Traffic matrix measurement is fundamental for datacenter operations, but obtaining complete traffic matrices at scale remains challenging due to the prohibitive cost of global fine-grained measurement and partial observations resulting from…

Networking and Internet Architecture · Computer Science 2026-05-05 Xiyuan Liu , Zihao Wang , Guanzuo Liu , Xiucheng Tian , Wenting Wei

Consider the following abstract coin tossing problem: Given a set of $n$ coins with unknown biases, find the most biased coin using a minimal number of coin tosses. This is a common abstraction of various exploration problems in theoretical…

Data Structures and Algorithms · Computer Science 2022-12-29 Sepehr Assadi , Chen Wang

The biggest cost of computing with large matrices in any modern computer is related to memory latency and bandwidth. The average latency of modern RAM reads is 150 times greater than a clock step of the processor. Throughput is a little…

Data Structures and Algorithms · Computer Science 2013-03-04 Crysttian Arantes Paixão , Flávio Codeço Coelho