English
Related papers

Related papers: Nearly Optimal Bounds for Computing Decision Tree …

200 papers

We give lower bounds on the amount of memory required by one-pass streaming algorithms for solving several natural learning problems. In a setting where examples lie in $\{0,1\}^d$ and the optimal classifier can be encoded using $\kappa$…

Machine Learning · Computer Science 2022-06-13 Gavin Brown , Mark Bun , Adam Smith

In the semi-streaming model, an algorithm must process any $n$-vertex graph by making one or few passes over a stream of its edges, use $O(n \cdot \text{polylog }n)$ words of space, and at the end of the last pass, output a solution to the…

Data Structures and Algorithms · Computer Science 2025-10-23 Sepehr Assadi , Gary Hoppenworth , Janani Sundaresan

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

In this paper, we study the problem of finding a maximum matching in the semi-streaming model when edges arrive in a random order. In the semi-streaming model, an algorithm receives a stream of edges and it is allowed to have a memory of…

Data Structures and Algorithms · Computer Science 2019-12-24 Alireza Farhadi , MohammadTaghi Hajiaghayi , Tung Mai , Anup Rao , Ryan A. Rossi

In the semi-streaming model for processing massive graphs, an algorithm makes multiple passes over the edges of a given $n$-vertex graph and is tasked with computing the solution to a problem using $O(n \cdot \text{polylog}(n))$ space.…

Data Structures and Algorithms · Computer Science 2023-12-21 Sepehr Assadi , Christian Konrad , Kheeran K. Naidu , Janani Sundaresan

Recently [Bhattacharya et al., STOC 2015] provide the first non-trivial algorithm for the densest subgraph problem in the streaming model with additions and deletions to its edges, i.e., for dynamic graph streams. They present a…

Data Structures and Algorithms · Computer Science 2015-07-30 Hossein Esfandiari , MohammadTaghi Hajiaghayi , David P. Woodruff

We give a near-optimal sample-pass trade-off for pure exploration in multi-armed bandits (MABs) via multi-pass streaming algorithms: any streaming algorithm with sublinear memory that uses the optimal sample complexity of…

Machine Learning · Computer Science 2024-06-26 Sepehr Assadi , Chen Wang

Fitting distances to tree metrics and ultrametrics are two widely used methods in hierarchical clustering, primarily explored within the context of numerical taxonomy. Given a positive distance function…

Data Structures and Algorithms · Computer Science 2025-04-25 Amir Carmel , Debarati Das , Evangelos Kipouridis , Evangelos Pipis

Decision trees and randomized forests are widely used in computer vision and machine learning. Standard algorithms for decision tree induction optimize the split functions one node at a time according to some splitting criteria. This greedy…

Machine Learning · Computer Science 2015-11-13 Mohammad Norouzi , Maxwell D. Collins , Matthew Johnson , David J. Fleet , Pushmeet Kohli

Counting the number of triangles in a graph has many important applications in network analysis. Several frequently computed metrics like the clustering coefficient and the transitivity ratio need to count the number of triangles in the…

Data Structures and Algorithms · Computer Science 2013-04-24 Mostafa Haghir Chehreghani

We present a data stream algorithm for estimating the size of the maximum matching of a low arboricity graph. Recall that a graph has arboricity $\alpha$ if its edges can be partitioned into at most $\alpha$ forests and that a planar graph…

Data Structures and Algorithms · Computer Science 2017-08-15 Andrew McGregor , Sofya Vorotnikova

We design a deterministic algorithm for the $(1+\epsilon)$-approximate maximum matching problem. Our primary result demonstrates that this problem can be solved in $O(\epsilon^{-6})$ semi-streaming passes, improving upon the…

Data Structures and Algorithms · Computer Science 2025-04-23 Slobodan Mitrović , Anish Mukherjee , Piotr Sankowski , Wen-Horng Sheu

We develop the first fully dynamic algorithm that maintains a decision tree over an arbitrary sequence of insertions and deletions of labeled examples. Given $\epsilon > 0$ our algorithm guarantees that, at every point in time, every node…

Machine Learning · Computer Science 2022-12-02 Marco Bressan , Gabriel Damay , Mauro Sozio

We show optimal lower bounds for spanning forest computation in two different models: * One wants a data structure for fully dynamic spanning forest in which updates can insert or delete edges amongst a base set of $n$ vertices. The sole…

Data Structures and Algorithms · Computer Science 2019-11-27 Jelani Nelson , Huacheng Yu

We study streaming algorithms for the maximum directed cut problem. The edges of an $n$-vertex directed graph arrive one by one in an arbitrary order, and the goal is to estimate the value of the maximum directed cut using a single pass and…

Data Structures and Algorithms · Computer Science 2026-04-01 Amir Azarmehr , Soheil Behnezhad , Shane Ferrante , Mohammad Saneian

In this paper we present improved bounds for approximating maximum matchings in bipartite graphs in the streaming model. First, we consider the question of how well maximum matching can be approximated in a single pass over the input using…

Data Structures and Algorithms · Computer Science 2021-03-18 Michael Kapralov

The seminal work of Ahn, Guha, and McGregor in 2012 introduced the graph sketching technique and used it to present the first streaming algorithms for various graph problems over dynamic streams with both insertions and deletions of edges.…

Data Structures and Algorithms · Computer Science 2023-12-11 Sepehr Assadi , Gillat Kol , Zhijun Zhang

In a recent breakthrough, Paz and Schwartzman (SODA'17) presented a single-pass ($2+\epsilon$)-approximation algorithm for the maximum weight matching problem in the semi-streaming model. Their algorithm uses $O(n\log^2 n)$ bits of space,…

Data Structures and Algorithms · Computer Science 2019-01-01 Mohsen Ghaffari , David Wajc

Given a source of iid samples of edges of an input graph $G$ with $n$ vertices and $m$ edges, how many samples does one need to compute a constant factor approximation to the maximum matching size in $G$? Moreover, is it possible to obtain…

Data Structures and Algorithms · Computer Science 2019-07-15 Michael Kapralov , Slobodan Mitrović , Ashkan Norouzi-Fard , Jakab Tardos

We study the computational complexity of approximately computing the partition function of a spin system. Techniques based on standard counting-to-sampling reductions yield $\tilde{O}(n^2)$-time algorithms, where $n$ is the size of the…

Data Structures and Algorithms · Computer Science 2026-04-03 Xiaoyu Chen , Zongchen Chen , Kuikui Liu , Xinyuan Zhang