English
Related papers

Related papers: Hazard-free Decision Trees

200 papers

We prove that, to compute a Boolean function $f$ on $N$ variables with error probability $\epsilon$, any quantum black-box algorithm has to query at least $\frac{1 - 2\sqrt{\epsilon}}{2} \rho_f N = \frac{1 - 2\sqrt{\epsilon}}{2} \bar{S}_f$…

Quantum Physics · Physics 2007-05-23 Yaoyun Shi

For a Boolean function $\Phi\colon\{0,1\}^d\to\{0,1\}$ and an assignment to its variables $\mathbf{x}=(x_1, x_2, \dots, x_d)$ we consider the problem of finding the subsets of the variables that are sufficient to determine the function…

Computational Complexity · Computer Science 2019-06-19 Stephan Wäldchen , Jan Macdonald , Sascha Hauch , Gitta Kutyniok

Recent works explore deep learning's success by examining functions or data with hierarchical structure. To study the learning complexity of functions with hierarchical structure, we study the noise stability of functions with tree…

Probability · Mathematics 2025-09-30 Rupert Li , Elchanan Mossel

Items in a test are often used as a basis for making decisions and such tests are therefore required to have good psychometric properties, like unidimensionality. In many cases the sum score is used in combination with a threshold to decide…

Methodology · Statistics 2020-07-14 Lourens Waldorp , Maarten Marsman , Denny Borsboom

The potential lack of fairness in the outputs of machine learning algorithms has recently gained attention both within the research community as well as in society more broadly. Surprisingly, there is no prior work developing tree-induction…

Machine Learning · Statistics 2017-12-25 Edward Raff , Jared Sylvester , Steven Mills

Sensitivity \cite{CD82,CDR86} and block sensitivity \cite{Nisan91} are two important complexity measures of Boolean functions. A longstanding open problem in decision tree complexity, the "Sensitivity versus Block Sensitivity" question,…

Computational Complexity · Computer Science 2013-06-25 Andris Ambainis , Yihan Gao , Jieming Mao , Xiaoming Sun , Song Zuo

Top-down induction of decision trees has been observed to suffer from the inadequate functioning of the pruning phase. In particular, it is known that the size of the resulting tree grows linearly with the sample size, even though the…

Artificial Intelligence · Computer Science 2011-06-06 T. Elomaa , M. Kaariainen

Recursive decision trees are widely used to estimate heterogeneous causal treatment effects in experimental and observational studies. These methods are typically implemented using CART-type recursive partitioning and are often viewed as…

Statistics Theory · Mathematics 2026-03-19 Matias D. Cattaneo , Jason M. Klusowski , Ruiqi Rae Yu

Besides serving as prediction models, classification trees are useful for finding important predictor variables and identifying interesting subgroups in the data. These functions can be compromised by weak split selection algorithms that…

Applications · Statistics 2010-11-03 Wei-Yin Loh

We study how to utilize (possibly machine-learned) predictions in a model for computing under uncertainty in which an algorithm can query unknown data. The goal is to minimize the number of queries needed to solve the problem. We consider…

Data Structures and Algorithms · Computer Science 2021-11-09 Thomas Erlebach , Murilo S. de Lima , Nicole Megow , Jens Schlöter

Conventionally, random forests are built from "greedy" decision trees which each consider only one split at a time during their construction. The sub-optimality of greedy implementation has been well-known, yet mainstream adoption of more…

Machine Learning · Computer Science 2021-04-01 Delilah Donick , Sandro Claudio Lera

We study the problem of formally verifying individual fairness of decision tree ensembles, as well as training tree models which maximize both accuracy and individual fairness. In our approach, fairness verification and fairness-aware…

Machine Learning · Computer Science 2021-01-05 Francesco Ranzato , Caterina Urban , Marco Zanella

Decision tree classifiers are a widely used tool in data stream mining. The use of confidence intervals to estimate the gain associated with each split leads to very effective methods, like the popular Hoeffding tree algorithm. From a…

Machine Learning · Statistics 2016-04-13 Rocco De Rosa

Decision trees are machine learning models commonly used in various application scenarios. In the era of big data, traditional decision tree induction algorithms are not suitable for learning large-scale datasets due to their stringent data…

Machine Learning · Computer Science 2020-09-04 Zhe Lin , Sharad Sinha , Wei Zhang

Stochastic Boolean Function Evaluation is the problem of determining the value of a given Boolean function f on an unknown input x, when each bit of x_i of x can only be determined by paying an associated cost c_i. The assumption is that x…

Data Structures and Algorithms · Computer Science 2013-08-12 Amol Deshpande , Lisa Hellerstein , Devorah Kletenik

We study the complexity of approximate representation and learning of submodular functions over the uniform distribution on the Boolean hypercube $\{0,1\}^n$. Our main result is the following structural theorem: any submodular function is…

Machine Learning · Computer Science 2013-04-03 Vitaly Feldman , Pravesh Kothari , Jan Vondrak

Fault tree (FT) analysis is a prominent risk assessment method in industrial systems. Unreliability is one of the key safety metrics in quantitative FT analysis. Existing algorithms for unreliability analysis are based on binary decision…

Data Structures and Algorithms · Computer Science 2023-12-12 Milan Lopuhaä-Zwakenberg

The problem of deciding the validity (QSAT) of quantified Boolean formulas (QBF) is a vivid research area in both theory and practice. In the field of parameterized algorithmics, the well-studied graph measure treewidth turned out to be a…

Computational Complexity · Computer Science 2020-07-06 Johannes Klaus Fichte , Markus Hecher , Andreas Pfandler

Various modifications of decision trees have been extensively used during the past years due to their high efficiency and interpretability. Tree node splitting based on relevant feature selection is a key step of decision tree learning, at…

Machine Learning · Computer Science 2017-09-05 Dmitry Ignatov , Andrey Ignatov

A fundamental notion of decision-theoretic rough sets is the concept of loss functions, which provides a powerful tool of calculating a pair of thresholds for making a decision with a minimum cost. In this paper, time-dependent loss…

Information Theory · Computer Science 2015-03-18 Guangming Lang