English
Related papers

Related papers: Decision trees and influences of variables over pr…

200 papers

Extending Mart\'in Escard\'o's effectful forcing technique, we give a new proof of a well-known result: Brouwer's monotone bar theorem holds for any bar that can be realized by a functional of type $(\mathbb{N} \to \mathbb{N}) \to…

Logic · Mathematics 2022-02-23 Jonathan Sterling

One means of fitting functions to high-dimensional data is by providing smoothness constraints. Recently, the following smooth function approximation problem was proposed: given a finite set $E \subset \mathbb{R}^d$ and a function $f: E…

Machine Learning · Statistics 2018-04-02 Adam Gustafson , Matthew Hirn , Kitty Mohammed , Hariharan Narayanan , Jason Xu

In this paper we study functions with low influences on product probability spaces. The analysis of boolean functions with low influences has become a central problem in discrete Fourier analysis. It is motivated by fundamental questions…

Probability · Mathematics 2007-05-23 Elchanan Mossel , Ryan O'Donnell , Krzysztof Oleszkiewicz

We introduce a new notion of influence for symmetric convex sets over Gaussian space, which we term "convex influence". We show that this new notion of influence shares many of the familiar properties of influences of variables for monotone…

Computational Complexity · Computer Science 2021-09-08 Anindya De , Shivam Nadimpalli , Rocco A. Servedio

We consider a probability distribution on the set of Boolean functions in n variables which is induced by random Boolean expressions. Such an expression is a random rooted plane tree where the internal vertices are labelled with connectives…

Combinatorics · Mathematics 2015-09-28 Antoine Genitrini , Bernhard Gittenberger , Veronika Kraus , Cécile Mailler

This paper extends the proof of density of neural networks in the space of continuous (or even measurable) functions on Euclidean spaces to functions on compact sets of probability measures. By doing so the work parallels a more then a…

Machine Learning · Computer Science 2019-06-04 Tomas Pevny , Vojtech Kovarik

Decision trees are one of the most fundamental computational models for computing Boolean functions $f : \{0, 1\}^n \mapsto \{0, 1\}$. It is well-known that the depth and size of decision trees are closely related to time and number of…

Computational Complexity · Computer Science 2025-01-03 Deepu Benson , Balagopal Komarath , Jayalal Sarma , Nalli Sai Soumya

Inferring a decision tree from a given dataset is one of the classic problems in machine learning. This problem consists of buildings, from a labelled dataset, a tree such that each node corresponds to a class and a path between the tree…

Machine Learning · Computer Science 2019-04-15 Florent Avellaneda

We study the Fourier spectrum of functions $f\colon \{0,1\}^{mk} \to \{-1,0,1\}$ which can be written as a product of $k$ Boolean functions $f_i$ on disjoint $m$-bit inputs. We prove that for every positive integer $d$, \[ \sum_{S \subseteq…

Computational Complexity · Computer Science 2019-02-08 Chin Ho Lee

In this paper, we focus on the prediction phase of a random forest and study the problem of representing a bag of decision trees using a smaller bag of decision trees, where we only consider binary decision problems on the binary domain and…

Machine Learning · Computer Science 2024-02-06 Tatsuya Akutsu , Avraham A. Melkman , Atsuhiro Takasu

Every Boolean function can be uniquely represented as a multilinear polynomial. The entropy and the total influence are two ways to measure the concentration of its Fourier coefficients, namely the monomial coefficients in this…

Computational Complexity · Computer Science 2017-11-03 Rani Hod

We completely characterise the complexity in the decision tree model of computing composite relations of the form h = g(f^1,...,f^n), where each relation f^i is boolean-valued. Immediate corollaries include a direct sum theorem for decision…

Computational Complexity · Computer Science 2013-02-19 Ashley Montanaro

The Fourier-Entropy Influence (FEI) Conjecture states that for any Boolean function $f:\{+1,-1\}^n \to \{+1,-1\}$, the Fourier entropy of $f$ is at most its influence up to a universal constant factor. While the FEI conjecture has been…

Computational Complexity · Computer Science 2019-03-29 Sourav Chakraborty , Sushrut Karmalkar , Srijita Kundu , Satyanarayana V. Lokam , Nitin Saurabh

In this note we consider Boolean functions defined on the discrete cube equipped with a biased product probability measure. We prove that if the spectrum of such a function is concentrated on the first two Fourier levels, then the function…

Combinatorics · Mathematics 2013-11-14 Piotr Nayar

We prove a analogous of Stein theorem for rational functions in several variables: we bound the number of reducible fibers by a formula depending on the degree of the fraction.

Number Theory · Mathematics 2007-05-23 Arnaud Bodin

Generalizing a recent result of Mann, we show that there is an explicit function $f:\left(0,1\right]\rightarrow\left(0,1\right]$ such that for every reduced word $w$, say in $d$ variables, there is an explicit reduced word $v$ in at most…

Group Theory · Mathematics 2017-08-03 Alexander Bors

We consider dynamic random trees constructed using an attachment function $f : \mathbb{N} \to \mathbb{R}_+$ where, at each step of the evolution, a new vertex attaches to an existing vertex $v$ in the current tree with probability…

Probability · Mathematics 2022-08-17 Sayan Banerjee , Shankar Bhamidi , Iain Carmichael

We study the problem of evaluating a discrete function by adaptively querying the values of its variables until the values read uniquely determine the value of the function. Reading the value of a variable is done at the expense of some…

Data Structures and Algorithms · Computer Science 2014-06-17 Aline Saettler , Eduardo Laber , Ferdinando Cicalese

An important tool to quantify the likeness of two probability measures are f-divergences, which have seen widespread application in statistics and information theory. An example is the total variation, which plays an exceptional role among…

Probability · Mathematics 2009-03-11 Jochen Bröcker

The theory of influences in product measures has profound applications in theoretical computer science, combinatorics, and discrete probability. This deep theory is intimately connected to functional inequalities and to the Fourier analysis…

Probability · Mathematics 2023-07-18 Frederic Koehler , Noam Lifshitz , Dor Minzer , Elchanan Mossel