English
Related papers

Related papers: Nearly Optimal Bounds for Computing Decision Tree …

200 papers

In this paper, we consider the problem of approximating the densest subgraph in the dynamic graph stream model. In this model of computation, the input graph is defined by an arbitrary sequence of edge insertions and deletions and the goal…

Data Structures and Algorithms · Computer Science 2015-06-16 Andrew McGregor , David Tench , Sofya Vorotnikova , Hoa T. Vu

In this paper we present a simple but powerful subgraph sampling primitive that is applicable in a variety of computational models including dynamic graph streams (where the input graph is defined by a sequence of edge/hyperedge insertions…

Data Structures and Algorithms · Computer Science 2015-05-08 Rajesh Chitnis , Graham Cormode , Hossein Esfandiari , MohammadTaghi Hajiaghayi , Andrew McGregor , Morteza Monemizadeh , Sofya Vorotnikova

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

Machine Learning · Computer Science 2023-01-24 Nikolaj Tatti

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

By revisiting the end-cut preference (ECP) phenomenon associated with a single CART (Breiman et al. (1984)), we introduce MinimaxSplit decision trees, a robust alternative to CART that selects splits by minimizing the worst-case child risk…

Statistics Theory · Mathematics 2026-04-16 Zhenyuan Zhang , Hengrui Luo

We develop new $(1+\epsilon)$-approximation algorithms for finding the global minimum edge-cut in a directed edge-weighted graph, and for finding the global minimum vertex-cut in a directed vertex-weighted graph. Our algorithms are…

Data Structures and Algorithms · Computer Science 2025-12-17 Ron Mosenzon

We propose two one-pass streaming algorithms for the $\mathcal{NP}$-hard hypergraph matching problem. The first algorithm stores a small subset of potential matching edges in a stack using dual variables to select edges. It has an…

Data Structures and Algorithms · Computer Science 2025-07-09 Henrik Reinstädtler , S M Ferdous , Alex Pothen , Bora Uçar , Christian Schulz

Decision trees with binary splits are popularly constructed using Classification and Regression Trees (CART) methodology. For binary classification and regression models, this approach recursively divides the data into two near-homogenous…

Machine Learning · Statistics 2020-08-17 Jason M. Klusowski

We give a randomized online algorithm that guarantees near-optimal $\widetilde O(\sqrt T)$ expected swap regret against any sequence of $T$ adaptively chosen Lipschitz convex losses on the unit interval. This improves the previous best…

Machine Learning · Computer Science 2026-02-10 Lunjia Hu , Jon Schneider , Yifan Wu

We present a new approach for finding matchings in dense graphs by building on Szemer\'edi's celebrated Regularity Lemma. This allows us to obtain non-trivial albeit slight improvements over longstanding bounds for matchings in streaming…

Data Structures and Algorithms · Computer Science 2022-07-20 Sepehr Assadi , Soheil Behnezhad , Sanjeev Khanna , Huan Li

Given a rooted tree and a ranking of its leaves, what is the minimum number of inversions of the leaves that can be attained by ordering the tree? This variation of the problem of counting inversions in arrays originated in mathematical…

Data Structures and Algorithms · Computer Science 2024-07-02 Ivan Hu , Dieter van Melkebeek , Andrew Morgan

Finding dense subgraphs is a fundamental algorithmic tool in data mining, community detection, and clustering. In this problem, one aims to find an induced subgraph whose edge-to-vertex ratio is maximized. We study the directed case of this…

Data Structures and Algorithms · Computer Science 2023-11-21 Slobodan Mitrović , Theodore Pan

We present a near-optimal distributed algorithm for $(1+o(1))$-approximation of single-commodity maximum flow in undirected weighted networks that runs in $(D+ \sqrt{n})\cdot n^{o(1)}$ communication rounds in the \Congest model. Here, $n$…

Data Structures and Algorithms · Computer Science 2015-08-20 Mohsen Ghaffari , Andreas Karrenbauer , Fabian Kuhn , Christoph Lenzen , Boaz Patt-Shamir

We consider the problem of detecting change-points in univariate time series by fitting a continuous piecewise linear signal using the residual sum of squares. Values of the inferred signal at slope breaks are restricted to a finite set of…

Computation · Statistics 2022-04-08 Vincent Runge , Marco Pascucci , Nicolas Deschamps de Boishebert

We propose a novel algorithm for optimizing multivariate linear threshold functions as split functions of decision trees to create improved Random Forest classifiers. Standard tree induction methods resort to sampling and exhaustive search…

Machine Learning · Computer Science 2015-06-26 Mohammad Norouzi , Maxwell D. Collins , David J. Fleet , Pushmeet Kohli

We present $O(\log\log n)$ round scalable Massively Parallel Computation algorithms for maximal independent set and maximal matching, in trees and more generally graphs of bounded arboricity, as well as for constant coloring trees.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-11 Mohsen Ghaffari , Christoph Grunau , Ce Jin

We present a general method for obtaining strong bounds for discrete optimization problems that is based on a concept of branching duality. It can be applied when no useful integer programming model is available, and we illustrate this with…

Data Structures and Algorithms · Computer Science 2019-08-22 J. G. Benade , J. N. Hooker

We present four novel approximation algorithms for finding triangulation of minimum treewidth. Two of the algorithms improve on the running times of algorithms by Robertson and Seymour, and Becker and Geiger that approximate the optimum by…

Data Structures and Algorithms · Computer Science 2013-01-14 Eyal Amir

We identify a sharp separation in the streaming space complexity of Maximum Cut when the algorithm must output an approximate cut (rather than only the approximate value). For dense graphs, we show that $O(n/\varepsilon^2)$ space is…

Data Structures and Algorithms · Computer Science 2026-05-12 Yang P. Liu , Hoai-An Nguyen , Noah G. Singer , David P. Woodruff

Optimization seeks extremal points in a function. When there are superextensively many optima, optimization algorithms are liable to get stuck. Under these conditions, generic algorithms tend to find marginal optima, which have many nearly…

Disordered Systems and Neural Networks · Physics 2024-07-25 Jaron Kent-Dobias