English
Related papers

Related papers: Bamboo Trimming Revisited: Simple Algorithms Can D…

200 papers

It is notoriously difficult to build a bad Random Forest (RF). Concurrently, RF blatantly overfits in-sample without any apparent consequence out-of-sample. Standard arguments, like the classic bias-variance trade-off or double descent,…

Machine Learning · Statistics 2024-10-01 Philippe Goulet Coulombe

In this paper, we present a novel massively parallel algorithm for accelerating the decision tree building procedure on GPUs (Graphics Processing Units), which is a crucial step in Gradient Boosted Decision Tree (GBDT) and random forests…

Machine Learning · Statistics 2017-06-27 Huan Zhang , Si Si , Cho-Jui Hsieh

We present a new approximation algorithm for the treewidth problem which finds an upper bound on the treewidth and constructs a corresponding tree decomposition as well. Our algorithm is a faster variation of Reed's classical algorithm. For…

Data Structures and Algorithms · Computer Science 2022-06-24 Mahdi Belbasi , Martin Fürer

The "0-1 knapsack problem" stands as a classical combinatorial optimization conundrum, necessitating the selection of a subset of items from a given set. Each item possesses inherent values and weights, and the primary objective is to…

Neural and Evolutionary Computing · Computer Science 2024-02-20 Mohammad Saleh Vahdatpour

Finding schedules for pairwise meetings between the members of a complex social group without creating interpersonal conflict is challenging, especially when different relationships have different needs. We formally define and study the…

Data Structures and Algorithms · Computer Science 2024-03-28 Leszek Gąsieniec , Benjamin Smith , Sebastian Wild

The main goal of this paper is to describe a new pruning method for solving decision trees and game trees. The pruning method for decision trees suggests a slight variant of decision trees that we call scenario trees. In scenario trees, we…

Artificial Intelligence · Computer Science 2013-02-21 Prakash P. Shenoy

Most neural network pruning methods, such as filter-level and layer-level prunings, prune the network model along one dimension (depth, width, or resolution) solely to meet a computational budget. However, such a pruning policy often leads…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Wenxiao Wang , Minghao Chen , Shuai Zhao , Long Chen , Jinming Hu , Haifeng Liu , Deng Cai , Xiaofei He , Wei Liu

We consider a Bar Charts Packing Problem (BCPP), in which it is necessary to pack bar charts (BCs) in a strip of minimum length. The problem is, on the one hand, a generalization of the Bin Packing Problem (BPP), and, on the other hand, a…

Data Structures and Algorithms · Computer Science 2021-01-05 Adil Erzin , Gregory Melidi , Stepan Nazarenko , Roman Plotnikov

We study computational aspects of the nonparametric maximum likelihood estimator (NPMLE) for the distribution function of bivariate interval censored data. The computation of the NPMLE consists of two steps: a parameter reduction step and…

Computation · Statistics 2012-01-12 Marloes H. Maathuis

We present a tree structure algorithm for optimal control problems with state constraints. We prove a convergence result for a discrete time approximation of the value function based on a novel formulation of the constrained problem. Then…

Numerical Analysis · Mathematics 2020-09-29 Alessandro Alla , Maurizio Falcone , Luca Saluzzi

We consider the problems of computing maximal palindromes and distinct palindromes in a trie. A trie is a natural generalization of a string, which can be seen as a single-path tree. There is a linear-time offline algorithm to compute…

Data Structures and Algorithms · Computer Science 2026-01-26 Hiroki Shibata , Mitsuru Funakoshi , Takuya Mieno , Masakazu Ishihata , Yuto Nakashima , Shunsuke Inenaga , Hideo Bannai , Masayuki Takeda

We give an algorithm for finding the arboricity of a weighted, undirected graph, defined as the minimum number of spanning forests that cover all edges of the graph, in $\sqrt{n} m^{1+o(1)}$ time. This improves on the previous best bound of…

Data Structures and Algorithms · Computer Science 2025-07-22 Ruoxu Cen , Henry Fleischmann , George Z. Li , Jason Li , Debmalya Panigrahi

Imagine we want to split a group of agents into teams in the most \emph{efficient} way, considering that each agent has their own preferences about their teammates. This scenario is modeled by the extensively studied \textsc{Coalition…

Data Structures and Algorithms · Computer Science 2025-05-29 Foivos Fioravantes , Harmender Gahlawat , Nikolaos Melissinos

Computing the rotation distance between two binary trees with $n$ internal nodes efficiently (in $poly(n)$ time) is a long standing open question in the study of height balancing in tree data structures. In this paper, we initiate the study…

Data Structures and Algorithms · Computer Science 2026-04-08 Anoop S. K. M. , Jayalal Sarma

The cost-distance Steiner tree problem seeks a Steiner tree that minimizes the total congestion cost plus the weighted sum of source-sink delays. This problem arises as a subroutine in timing-constrained global routing with a linear delay…

Data Structures and Algorithms · Computer Science 2025-03-07 Stephan Held , Edgar Perner

We propose to prune a random forest (RF) for resource-constrained prediction. We first construct a RF and then prune it to optimize expected feature cost & accuracy. We pose pruning RFs as a novel 0-1 integer program with linear constraints…

Machine Learning · Statistics 2016-06-17 Feng Nan , Joseph Wang , Venkatesh Saligrama

In this paper, we present a Branch and Bound algorithm called QuickBB for computing the treewidth of an undirected graph. This algorithm performs a search in the space of perfect elimination ordering of vertices of the graph. The algorithm…

Data Structures and Algorithms · Computer Science 2012-07-19 Vibhav Gogate , Rina Dechter

We propose a reinforcement-learning algorithm to tackle the challenge of reconstructing phylogenetic trees. The search for the tree that best describes the data is algorithmically challenging, thus all current algorithms for phylogeny…

Populations and Evolution · Quantitative Biology 2023-03-14 Dana Azouri , Oz Granit , Michael Alburquerque , Yishay Mansour , Tal Pupko , Itay Mayrose

In this paper, we consider lasso problems with zero-sum constraint, commonly required for the analysis of compositional data in high-dimensional spaces. A novel algorithm is proposed to solve these problems, combining a tailored active-set…

Optimization and Control · Mathematics 2022-09-26 Andrea Cristofari

We analyze a tree search problem with an underlying Markov decision process, in which the goal is to identify the best action at the root that achieves the highest cumulative reward. We present a new tree policy that optimally allocates a…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Yunchuan Li , Michael C. Fu , Jie Xu