English
Related papers

Related papers: On Explaining Random Forests with SAT

200 papers

Regression trees are a popular machine learning algorithm that fit piecewise constant models by recursively partitioning the predictor space. This paper focuses on statistical inference for a data-dependent model obtained from a fitted…

Methodology · Statistics 2025-12-17 Soham Bakshi , Yiling Huang , Snigdha Panigrahi , Walter Dempsey

Recent years have witnessed a fast-growing interest in computing explanations for Machine Learning (ML) models predictions. For non-interpretable ML models, the most commonly used approaches for computing explanations are heuristic in…

Machine Learning · Computer Science 2019-07-05 Alexey Ignatiev , Nina Narodytska , Joao Marques-Silva

Automata for unordered unranked trees are relevant for defining schemas and queries for data trees in Json or Xml format. While the existing notions are well-investigated concerning expressiveness, they all lack a proper notion of…

Formal Languages and Automata Theory · Computer Science 2014-08-27 Adrien Boiret , Vincent Hugot , Joachim Niehren , Ralf Treinen

We propose an algorithm named best-scored random forest for binary classification problems. The terminology "best-scored" means to select the one with the best empirical performance out of a certain number of purely random tree candidates…

Machine Learning · Statistics 2019-05-28 Hanyuan Hang , Xiaoyu Liu , Ingo Steinwart

Random forests are an ensemble method relevant for many problems, such as regression or classification. They are popular due to their good predictive performance (compared to, e.g., decision trees) requiring only minimal tuning of…

Methodology · Statistics 2022-10-20 Nikolaus Umlauf , Nadja Klein

The random forest algorithm, proposed by L. Breiman in 2001, has been extremely successful as a general-purpose classification and regression method. The approach, which combines several randomized decision trees and aggregates their…

Statistics Theory · Mathematics 2015-11-19 Gérard Biau , Erwan Scornet

We study probability distributions over free algebras of trees. Probability distributions can be seen as particular (formal power) tree series [Berstel et al 82, Esik et al 03], i.e. mappings from trees to a semiring K . A widely studied…

Machine Learning · Computer Science 2008-07-21 François Denis , Amaury Habrard , Rémi Gilleron , Marc Tommasi , Édouard Gilbert

In this work, we present a random forest framework that learns the weights, shapes, and sparsities of feature representations for real-time semantic segmentation. Typical filters (kernels) have predetermined shapes and sparsities and learn…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Byeongkeun Kang , Truong Q. Nguyen

This paper reviews the recent literature on solving the Boolean satisfiability problem (SAT), an archetypal NP-complete problem, with the help of machine learning techniques. Despite the great success of modern SAT solvers to solve large…

Artificial Intelligence · Computer Science 2023-10-25 Wenxuan Guo , Junchi Yan , Hui-Ling Zhen , Xijun Li , Mingxuan Yuan , Yaohui Jin

We propose generalized random forests, a method for non-parametric statistical estimation based on random forests (Breiman, 2001) that can be used to fit any quantity of interest identified as the solution to a set of local moment…

Methodology · Statistics 2018-04-06 Susan Athey , Julie Tibshirani , Stefan Wager

We present a probabilistic logic programming framework to reinforcement learning, by integrating reinforce-ment learning, in POMDP environments, with normal hybrid probabilistic logic programs with probabilistic answer set seman-tics, that…

Artificial Intelligence · Computer Science 2010-11-30 Emad Saad

Random Forests (RFs) are strong machine learning tools for classification and regression. However, they remain supervised algorithms, and no extension of RFs to the one-class setting has been proposed, except for techniques based on…

Machine Learning · Statistics 2016-11-22 Nicolas Goix , Nicolas Drougard , Romain Brault , Maël Chiapino

Random Forests (RF) are among the state-of-the-art in many machine learning applications. With the ongoing integration of ML models into everyday life, the deployment and continuous application of models becomes more and more an important…

Machine Learning · Computer Science 2021-10-20 Sebastian Buschjäger , Katharina Morik

With the increasing power of machine learning-based reasoning, the use of meta-information (e.g., digital signal modulation parameters, channel conditions, etc.) to predict the performance of various signal processing techniques has become…

Signal Processing · Electrical Eng. & Systems 2020-07-13 Jianyuan Yu , Yue Xu , Hussein Metwaly Saad , R. Michael Buehrer

The random forest (RF) algorithm has become a very popular prediction method for its great flexibility and promising accuracy. In RF, it is conventional to put equal weights on all the base learners (trees) to aggregate their predictions.…

Machine Learning · Statistics 2023-05-18 Xinyu Chen , Dalei Yu , Xinyu Zhang

In critical situations involving discrimination, gender inequality, economic damage, and even the possibility of casualties, machine learning models must be able to provide clear interpretations for their decisions. Otherwise, their obscure…

Machine Learning · Computer Science 2021-04-14 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

We introduce a modification of Random Forests to estimate functions when unobserved confounding variables are present. The technique is tailored for high-dimensional settings with many observed covariates. We use spectral deconfounding…

Computation · Statistics 2025-09-25 Markus Ulmer , Cyrill Scheidegger , Peter Bühlmann

Random forests is a state-of-the-art supervised machine learning method which behaves well in high-dimensional settings although some limitations may happen when $p$, the number of predictors, is much larger than the number of observations…

Methodology · Statistics 2019-02-01 Louis Capitaine , Robin Genuer , Rodolphe Thiébaut

Symbolic indefinite integration in Computer Algebra Systems such as Maple involves selecting the most effective algorithm from multiple available methods. Not all methods will succeed for a given problem, and when several do, the results,…

Symbolic Computation · Computer Science 2025-08-11 Rashid Barket , Matthew England , Jürgen Gerhard

Multi-label classification is a challenging task, particularly in domains where the number of labels to be predicted is large. Deep neural networks are often effective at multi-label classification of images and textual data. When dealing…

Machine Learning · Computer Science 2023-03-30 Nikolaos Mylonas , Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas