English
Related papers

Related papers: On Random Tree Structures, Their Entropy, and Comp…

200 papers

Decision trees are a popular family of models due to their attractive properties such as interpretability and ability to handle heterogeneous data. Concurrently, missing data is a prevalent occurrence that hinders performance of machine…

Machine Learning · Computer Science 2020-07-01 Pasha Khosravi , Antonio Vergari , YooJung Choi , Yitao Liang , Guy Van den Broeck

We prime-encode the natural numbers via recursive factorisation, iterated to the exponents, generating a corpus of planar rooted trees equivalently represented as Dyck words. This forms a deterministic text endowed with internal rules.…

Mathematical Physics · Physics 2025-12-02 Pierluigi Contucci , Claudio Giberti , Godwin Osabutey , Cecilia Vernia

Compression is a standard procedure for making convolutional neural networks (CNNs) adhere to some specific computing resource constraints. However, searching for a compressed architecture typically involves a series of time-consuming…

Image and Video Processing · Electrical Eng. & Systems 2021-07-08 Suraj Mishra , Danny Z. Chen , X. Sharon Hu

We consider uniform random permutations drawn from a family enumerated through generating trees. We develop a new general technique to establish a central limit theorem for the number of consecutive occurrences of a fixed pattern in such…

Probability · Mathematics 2021-12-22 Jacopo Borga

We consider a probability distribution on the set of Boolean functions in n variables which is induced by random Boolean expressions. Such an expression is a random rooted plane tree where the internal vertices are labelled with connectives…

Combinatorics · Mathematics 2015-09-28 Antoine Genitrini , Bernhard Gittenberger , Veronika Kraus , Cécile Mailler

Data analysis and machine learning have become an integrative part of the modern scientific methodology, offering automated procedures for the prediction of a phenomenon based on past observations, unraveling underlying patterns in data and…

Machine Learning · Statistics 2015-06-04 Gilles Louppe

Extremal graphical models are sparse statistical models for multivariate extreme events. The underlying graph encodes conditional independencies and enables a visual interpretation of the complex extremal dependence structure. For the…

Methodology · Statistics 2022-08-18 Sebastian Engelke , Stanislav Volgushev

We study effective randomness-preserving transformations of path-incompressible trees. Some path-incompressible trees with infinitely many paths do not compute perfect path-random trees with computable oracle-use. Sparse perfect…

Combinatorics · Mathematics 2024-01-11 George Barmpalias , Xiaoyan Zhang

Sample selection improves the efficiency and effectiveness of machine learning models by providing informative and representative samples. Typically, samples can be modeled as a sample graph, where nodes are samples and edges represent…

Machine Learning · Computer Science 2025-03-04 Tianchi Xie , Jiangning Zhu , Guozu Ma , Minzhi Lin , Wei Chen , Weikai Yang , Shixia Liu

We generate new mathematical tools with which to quantify the macroscopic topological structure of large directed networks. This is achieved via a statistical mechanical analysis of constrained maximum entropy ensembles of directed random…

Quantitative Methods · Quantitative Biology 2015-05-27 E. S. Roberts , A. C. C. Coolen , T. Schlitt

We study graph estimation and density estimation in high dimensions, using a family of density estimators based on forest structured undirected graphical models. For density estimation, we do not assume the true distribution corresponds to…

Machine Learning · Statistics 2010-10-21 Han Liu , Min Xu , Haijie Gu , Anupam Gupta , John Lafferty , Larry Wasserman

Complexity science offers a wide range of measures for quantifying unpredictability, structure, and information. Yet, a systematic conceptual organization of these measures is still missing. We present a unified framework that locates…

Machine Learning · Computer Science 2025-05-13 Nima Dehghani

Intrinsic computation refers to how dynamical systems store, structure, and transform historical and spatial information. By graphing a measure of structural complexity against a measure of randomness, complexity-entropy diagrams display…

Chaotic Dynamics · Physics 2009-11-13 David P. Feldman , Carl S. McTague , James P. Crutchfield

Trees can accelerate queries that search or aggregate values over large collections. They achieve this by storing metadata that enables quick pruning (or inclusion) of subtrees when predicates on that metadata can prove that none (or all)…

We prove a lower bound on the number of spanning two-forests in a graph, in terms of the number of vertices, edges, and spanning trees. This implies an upper bound on the average cut size of a random two-forest. The main tool is an identity…

Combinatorics · Mathematics 2023-08-09 Harry Richman , Farbod Shokrieh , Chenxi Wu

Due to their long-standing reputation as excellent off-the-shelf predictors, random forests continue remain a go-to model of choice for applied statisticians and data scientists. Despite their widespread use, however, until recently, little…

Machine Learning · Statistics 2021-04-01 Siyu Zhou , Lucas Mentch

We consider the distributed compression of Soft Random Geometric Graphs (SRGGs) above the connectivity threshold. We establish the Slepian-Wolf rate region for the SRGG in the setting where there are a finite number of encoders compressing…

Information Theory · Computer Science 2026-05-07 Oliver Baker , Carl P. Dettmann

So far, a very large amount of work in Natural Language Processing (NLP) rely on trees as the core mathematical structure to represent linguistic informations (e.g. in Chomsky's work). However, some linguistic phenomena do not cope properly…

Computation and Language · Computer Science 2013-02-27 Guillaume Bonfante , Bruno Guillaume

For random matrices with tree-like structure there exists a recursive relation for the local Green functions whose solution permits to find directly many important quantities in the limit of infinite matrix dimensions. The purpose of this…

Disordered Systems and Neural Networks · Physics 2015-06-17 E. Bogomolny , O. Giraud

Traditional studies of memory for meaningful narratives focus on specific stories and their semantic structures but do not address common quantitative features of recall across different narratives. We introduce a statistical ensemble of…

Statistical Mechanics · Physics 2025-02-25 Weishun Zhong , Tankut Can , Antonis Georgiou , Ilya Shnayderman , Mikhail Katkov , Misha Tsodyks