English
Related papers

Related papers: Matrix Norms in Data Streams: Faster, Multi-Pass a…

200 papers

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

Big Data streams are being generated in a faster, bigger, and more commonplace. In this scenario, Hoeffding Trees are an established method for classification. Several extensions exist, including high-performing ensemble setups such as…

Machine Learning · Computer Science 2015-11-04 Diego Marrón , Jesse Read , Albert Bifet , Nacho Navarro

We focus on the critical challenge of handling non-stationary data streams in online continual learning environments, where constrained storage capacity prevents complete retention of historical data, leading to catastrophic forgetting…

Methodology · Statistics 2025-08-12 Xinjia Lu , Chuhan Wang , Qian Zhao , Lixing Zhu , Xuehu Zhu

An existing approach for dealing with massive data sets is to stream over the input in few passes and perform computations with sublinear resources. This method does not work for truly massive data where even making a single pass over the…

Computational Complexity · Computer Science 2007-05-23 Jon Feldman , S. Muthukrishnan , Anastasios Sidiropoulos , Cliff Stein , Zoya Svitkina

Modern navigation services often provide multiple paths connecting the same source and destination for users to select. Hence, ranking such paths becomes increasingly important, which directly affects the service quality. We present…

Machine Learning · Computer Science 2019-07-10 Sean Bin Yang , Bin Yang

Due to the large data volume and number of distinct elements, space is often the bottleneck of many stream processing systems. The data structures used by these systems often consist of counters whose optimization yields significant memory…

Networking and Internet Architecture · Computer Science 2025-02-21 Ran Ben Basat , Gil Einziger , Bilal Tyah , Shay Vargaftik

Mathematically characterizing the implicit regularization induced by gradient-based optimization is a longstanding pursuit in the theory of deep learning. A widespread hope is that a characterization based on minimization of norms may…

Machine Learning · Computer Science 2020-10-20 Noam Razin , Nadav Cohen

This paper introduces a scheme for data stream processing which is robust to batch duration. Streaming frameworks process streams in batches retrieved at fixed time intervals. In a common setting a pattern recognition algorithm is applied…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-20 David Tolpin

In recent years, stream data have become an immensely growing area of research for the database, computer science and data mining communities. Stream data is an ordered sequence of instances. In many applications of data stream mining data…

Databases · Computer Science 2014-02-10 Nishant Vadnere , R. G. Mehta , D. P. Rana , N. J. Mistry , M. M. Raghuwanshi

Sorting is a fundamental and well studied problem that has been studied extensively. Sorting plays an important role in the area of databases, as many queries can be served much faster if the relations are first sorted. One of the most…

Databases · Computer Science 2021-03-29 Yamit Barshatz-Schneor , Roy Friedman

In this work, we present the first efficient and practical algorithm for estimating the number of triangles in a graph stream using predictions. Our algorithm combines waiting room sampling and reservoir sampling with a predictor for the…

Data Structures and Algorithms · Computer Science 2024-09-24 Cristian Boldrin , Fabio Vandin

We consider a class of learning problems that involve a structured sparsity-inducing norm defined as the sum of $\ell_\infty$-norms over groups of variables. Whereas a lot of effort has been put in developing fast optimization methods when…

Machine Learning · Computer Science 2010-09-02 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

We give improved multi-pass streaming algorithms for the problem of maximizing a monotone or arbitrary non-negative submodular function subject to a general $p$-matchoid constraint in the model in which elements of the ground set arrive one…

Data Structures and Algorithms · Computer Science 2021-02-22 Chien-Chung Huang , Theophile Thiery , Justin Ward

Prior knowledge on properties of a target model often come as discrete or combinatorial descriptions. This work provides a unified computational framework for defining norms that promote such structures. More specifically, we develop…

Machine Learning · Statistics 2019-04-11 Amin Jalali , Adel Javanmard , Maryam Fazel

The amount of collected information on data repositories has vastly increased with the advent of the internet. It has become increasingly complex to deal with these massive data streams due to their sheer volume and the throughput of…

Information Retrieval · Computer Science 2021-05-13 Oshan Mudannayake , Nalin Ranasinghe

This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery…

Machine Learning · Statistics 2016-09-27 Ethan X. Fang , Han Liu , Kim-Chuan Toh , Wen-Xin Zhou

Graphs are ubiquitous and ever-present data structures that have a wide range of applications involving social networks, knowledge bases and biological interactions. The evolution of a graph in such scenarios can yield important insights…

Data Structures and Algorithms · Computer Science 2019-02-15 Lefteris Zervakis , Vinay Setty , Christos Tryfonopoulos , Katja Hose

In the graph stream model of computation, an algorithm processes the edges of an input graph in one or more sequential passes while using a memory sublinear in the input size. This model poses significant challenges for constructing long…

Data Structures and Algorithms · Computer Science 2025-08-25 Christian Konrad , Chhaya Trehan

We describe a model that enables us to analyze the running time of an algorithm in a computer with a memory hierarchy with limited associativity, in terms of various cache parameters. Our model, an extension of Aggarwal and Vitter's I/O…

Hardware Architecture · Computer Science 2007-05-23 Sandeep Sen , Siddhartha Chatterjee , Neeraj Dumir