English
Related papers

Related papers: Hierarchical Shrinkage: improving the accuracy and…

200 papers

We study the problem of constructing Steiner Minimal Trees (SMTs) in hyperbolic space. Exact SMT computation is NP-hard, and existing hyperbolic heuristics such as HyperSteiner are deterministic and often get trapped in locally suboptimal…

In this paper we present novel algorithmic techniques with a O(H(N)+N/H(N)) time complexity for performing several types of queries and updates on general rooted trees, binary search trees and lists of size N. For rooted trees we introduce…

Data Structures and Algorithms · Computer Science 2013-03-25 Mugurel Ionut Andreica

Hash codes are efficient data representations for coping with the ever growing amounts of data. In this paper, we introduce a random forest semantic hashing scheme that embeds tiny convolutional neural networks (CNN) into shallow random…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Qiang Qiu , Jose Lezama , Alex Bronstein , Guillermo Sapiro

Hierarchical forecasting methods have been widely used to support aligned decision-making by providing coherent forecasts at different aggregation levels. Traditional hierarchical forecasting approaches, such as the bottom-up and top-down…

Machine Learning · Computer Science 2020-06-04 Evangelos Spiliotis , Mahdi Abolghasemi , Rob J Hyndman , Fotios Petropoulos , Vassilios Assimakopoulos

We present a tree structure algorithm for optimal control problems with state constraints. We prove a convergence result for a discrete time approximation of the value function based on a novel formulation of the constrained problem. Then…

Numerical Analysis · Mathematics 2020-09-29 Alessandro Alla , Maurizio Falcone , Luca Saluzzi

The successor representation (SR) provides a powerful framework for decoupling predictive dynamics from rewards, enabling rapid generalisation across reward configurations. However, the classical SR is limited by its inherent policy…

Machine Learning · Computer Science 2026-02-16 Changmin Yu , Máté Lengyel

Decision tree learning is increasingly being used for pointwise inference. Important applications include causal heterogenous treatment effects and dynamic policy decisions, as well as conditional quantile regression and design of…

Machine Learning · Statistics 2024-02-08 Matias D. Cattaneo , Jason M. Klusowski , Peter M. Tian

Many sectors nowadays require accurate and coherent predictions across their organization to effectively operate. Otherwise, decision-makers would be planning using disparate views of the future, resulting in inconsistent decisions across…

Machine Learning · Computer Science 2023-02-09 Julien Leprince , Waqas Khan , Henrik Madsen , Jan Kloppenborg Møller , Wim Zeiler

Tree-based methods are powerful nonparametric techniques in statistics and machine learning. However, their effectiveness, particularly in finite-sample settings, is not fully understood. Recent applications have revealed their surprising…

Statistics Theory · Mathematics 2024-10-04 Hengrui Luo , Meng Li

This paper presents an efficient method to perform Structured Matrix Approximation by Separation and Hierarchy (SMASH), when the original dense matrix is associated with a kernel function. Given points in a domain, a tree structure is first…

Numerical Analysis · Mathematics 2017-05-17 Difeng Cai , Edmond Chow , Yousef Saad , Yuanzhe Xi

Random forest regression is a powerful non-parametric method that adapts to local data characteristics through data-driven partitioning, making it effective across diverse application domains. However, the piecewise constant nature of…

Machine Learning · Computer Science 2026-05-19 Ziyi Liu , Phuc Luong , Mario Boley , Daniel F. Schmidt

Decision trees are popular machine learning models that are simple to build and easy to interpret. Even though algorithms to learn decision trees date back to almost 50 years, key properties affecting their generalization error are still…

Machine Learning · Computer Science 2020-10-16 Jean-Samuel Leboeuf , Frédéric LeBlanc , Mario Marchand

Deep learning has become increasingly important in remote sensing image classification due to its ability to extract semantic information from complex data. Classification tasks often include predefined label hierarchies that represent the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Giulio Weikmann , Gianmarco Perantoni , Lorenzo Bruzzone

Decision trees are ubiquitous in machine learning for their ease of use and interpretability. Yet, these models are not typically employed in reinforcement learning as they cannot be updated online via stochastic gradient descent. We…

Machine Learning · Computer Science 2020-06-29 Andrew Silva , Taylor Killian , Ivan Dario Jimenez Rodriguez , Sung-Hyun Son , Matthew Gombolay

We introduce in this paper a runtime-efficient tree hashing algorithm for the identification of isomorphic subtrees, with two important applications in genetic programming for symbolic regression: fast, online calculation of population…

Machine Learning · Computer Science 2021-07-23 Bogdan Burlacu , Lukas Kammerer , Michael Affenzeller , Gabriel Kronberger

Tree ensembles are powerful models that achieve excellent predictive performances, but can grow to unwieldy sizes. These ensembles are often post-processed (pruned) to reduce memory footprint and improve interpretability. We present…

Machine Learning · Statistics 2023-05-26 Brian Liu , Rahul Mazumder

We study changes in metrics that are defined on a cartesian product of trees. Such metrics occur naturally in many practical applications, where a global metric (such as revenue) can be broken down along several hierarchical dimensions…

Databases · Computer Science 2017-03-24 Matthias Ruhl , Mukund Sundararajan , Qiqi Yan

Sparse residual tree (SRT) is an adaptive exploration method for multivariate scattered data approximation. It leads to sparse and stable approximations in areas where the data is sufficient or redundant, and points out the possible local…

Numerical Analysis · Mathematics 2019-05-15 Xin Xu , Xiaopeng Luo

While the depth of modern Convolutional Neural Networks (CNNs) surpasses that of the pioneering networks with a significant margin, the traditional way of appending supervision only over the final classifier and progressively propagating…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Duo Li , Qifeng Chen

In this paper, we mainly focus on the problem of how to learn additional feature representations for few-shot image classification through pretext tasks (e.g., rotation or color permutation and so on). This additional knowledge generated by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Min Zhang , Siteng Huang , Wenbin Li , Donglin Wang