English
Related papers

Related papers: Inference Trees: Adaptive Inference with Explorati…

200 papers

Networks are ubiquitous in biology and computational approaches have been largely investigated for their inference. In particular, supervised machine learning methods can be used to complete a partially known network by integrating various…

Machine Learning · Computer Science 2014-04-25 Marie Schrynemackers , Louis Wehenkel , M. Madan Babu , Pierre Geurts

We seek to provide an interpretable framework for segmenting users in a population for personalized decision-making. We propose a general methodology, Market Segmentation Trees (MSTs), for learning market segmentations explicitly driven by…

Applications · Statistics 2023-01-16 Ali Aouad , Adam N. Elmachtoub , Kris J. Ferreira , Ryan McNellis

Several tasks in information retrieval (IR) rely on assumptions regarding the distribution of some property (such as term frequency) in the data being processed. This thesis argues that such distributional assumptions can lead to incorrect…

Information Retrieval · Computer Science 2019-04-02 Casper Petersen

Importance sampling (IS) is commonly used for cross validation (CV) in Bayesian models, because it only involves reweighting existing posterior draws without needing to re-estimate the model by re-running Markov chain Monte Carlo (MCMC).…

Computation · Statistics 2025-08-12 Geonhee Han , Andrew Gelman

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

We consider adaptive estimation and statistical inference for high-dimensional graph-based linear models. In our model, the coordinates of regression coefficients correspond to an underlying undirected graph. Furthermore, the given graph…

Statistics Theory · Mathematics 2020-01-30 Duzhe Wang , Po-Ling Loh

A number of algorithms have been developed to solve probabilistic inference problems on belief networks. These algorithms can be divided into two main groups: exact techniques which exploit the conditional independence revealed when the…

Artificial Intelligence · Computer Science 2013-04-08 Ross D. Shachter , Mark Alan Peot

Neural Networks and Decision Trees: two popular techniques for supervised learning that are seemingly disconnected in their formulation and optimization method, have recently been combined in a single construct. The connection pivots on…

Machine Learning · Statistics 2020-02-27 Giuseppe Nuti , Lluís Antoni Jiménez Rugama , Kaspar Thommen

Accurate uncertainty estimation is crucial for deploying neural networks in risk-sensitive applications such as medical diagnosis. Monte Carlo Dropout is a widely used technique for approximating predictive uncertainty by performing…

Machine Learning · Computer Science 2025-06-05 Tal Zeevi , Ravid Shwartz-Ziv , Yann LeCun , Lawrence H. Staib , John A. Onofrey

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Probability · Mathematics 2009-12-30 Marcus Hutter

Symbolic regression aims to discover concise, interpretable mathematical expressions that satisfy desired objectives, such as fitting data, posing a highly combinatorial optimization problem. While genetic programming has been the dominant…

Machine Learning · Computer Science 2025-09-25 Zhengyao Huang , Daniel Zhengyu Huang , Tiannan Xiao , Dina Ma , Zhenyu Ming , Hao Shi , Yuanhui Wen

Among Monte Carlo techniques, the importance sampling requires fine tuning of a proposal distribution, which is now fluently resolved through iterative schemes. The Adaptive Multiple Importance Sampling (AMIS) of Cornuet et al. (2012)…

Computation · Statistics 2014-05-27 Jean-Michel Marin , Pierre Pudlo , Mohammed Sedki

Exploratory data analysis is crucial for developing and understanding classification models from high-dimensional datasets. We explore the utility of a new unsupervised tree ensemble called uncharted forest for visualizing class…

Machine Learning · Statistics 2018-07-03 Casey Kneale , Steven D. Brown

We introduce an innovative method for incremental nonparametric probabilistic inference in high-dimensional state spaces. Our approach leverages \slices from high-dimensional surfaces to efficiently approximate posterior distributions of…

Artificial Intelligence · Computer Science 2024-05-28 Moshe Shienman , Ohad Levy-Or , Michael Kaess , Vadim Indelman

Active Inference, grounded in the Free Energy Principle, provides a powerful lens for understanding how agents balance exploration and goal-directed behavior in uncertain environments. Here, we propose a new planning framework, that…

Artificial Intelligence · Computer Science 2025-01-27 Mawaba Pascal Dao , Adrian M. Peter

The problem of inferring an inductive invariant for verifying program safety can be formulated in terms of binary classification. This is a standard problem in machine learning: given a sample of good and bad points, one is asked to find a…

Programming Languages · Computer Science 2015-01-21 Siddharth Krishna , Christian Puhrsch , Thomas Wies

Decision trees are commonly used predictive models due to their flexibility and interpretability. This paper is directed at quantifying the uncertainty of decision tree predictions by employing a Bayesian inference approach. This is…

Machine Learning · Computer Science 2024-03-28 Jodie A. Cochrane , Adrian Wills , Sarah J. Johnson

In this paper, we aim to compute numerical approximation integral by using an adaptive Monte Carlo algorithm. We propose a stratified sampling algorithm based on an iterative method which splits the strata following some quantities called…

Numerical Analysis · Mathematics 2015-07-22 Toni Sayah

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

Computational Engineering, Finance, and Science · Computer Science 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines