English
Related papers

Related papers: Superpolynomial Lower Bounds for Decision Tree Lea…

200 papers

In recent years much effort has been concentrated towards achieving polynomial time lower bounds on algorithms for solving various well-known problems. A useful technique for showing such lower bounds is to prove them conditionally based on…

Data Structures and Algorithms · Computer Science 2017-07-26 Isaac Goldstein , Tsvi Kopelowitz , Moshe Lewenstein , Ely Porat

In this paper we study the adaptive learnability of decision trees of depth at most $d$ from membership queries. This has many applications in automated scientific discovery such as drugs development and software update problem. Feldman…

Machine Learning · Computer Science 2019-01-24 Nader H. Bshouty , Catherine A. Haddad-Zaknoon

We give the first {\sl reconstruction algorithm} for decision trees: given queries to a function $f$ that is $\mathrm{opt}$-close to a size-$s$ decision tree, our algorithm provides query access to a decision tree $T$ where: $\circ$ $T$ has…

Data Structures and Algorithms · Computer Science 2022-05-24 Guy Blanc , Jane Lange , Li-Yang Tan

A large number of NP-hard graph problems can be solved in $f(w)n^{O(1)}$ time and space when the input graph is provided together with a tree decomposition of width $w$, in many cases with a modest exponential dependence $f(w)$ on $w$.…

Data Structures and Algorithms · Computer Science 2026-03-26 Stefan Kratsch

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

Machine Learning · Computer Science 2021-10-06 Jie Shen

Proving super-polynomial size lower bounds for $\textsf{TC}^0$, the class of constant-depth, polynomial-size circuits of Majority gates, is a notorious open problem in complexity theory. A major frontier is to prove that $\textsf{NEXP}$…

Computational Complexity · Computer Science 2018-05-29 Lijie Chen

Recently, there has been significant progress in understanding reinforcement learning in discounted infinite-horizon Markov decision processes (MDPs) by deriving tight sample complexity bounds. However, in many real-world applications, an…

Machine Learning · Statistics 2016-05-12 Christoph Dann , Emma Brunskill

Despite the latest prevailing success of deep neural networks (DNNs), several concerns have been raised against their usage, including the lack of intepretability the gap between DNNs and other well-established machine learning models, and…

Machine Learning · Computer Science 2021-01-01 Jianghao Shen , Sicheng Wang , Zhangyang Wang

Bounds on the log partition function are important in a variety of contexts, including approximate inference, model fitting, decision theory, and large deviations analysis. We introduce a new class of upper bounds on the log partition…

Machine Learning · Computer Science 2013-01-07 Martin Wainwright , Tommi S. Jaakkola , Alan Willsky

Over the past 30 years numerous algorithms have been designed for symmetry breaking problems in the LOCAL model, such as maximal matching, MIS, vertex coloring, and edge-coloring. For most problems the best randomized algorithm is at least…

Computational Complexity · Computer Science 2016-04-07 Yi-Jun Chang , Tsvi Kopelowitz , Seth Pettie

We prove several new tight distributed lower bounds for classic symmetry breaking graph problems. As a basic tool, we first provide a new insightful proof that any deterministic distributed algorithm that computes a $\Delta$-coloring on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-03 Alkida Balliu , Sebastian Brandt , Fabian Kuhn , Dennis Olivetti

We prove hardness-of-learning results under a well-studied assumption on the existence of local pseudorandom generators. As we show, this assumption allows us to surpass the current state of the art, and prove hardness of various basic…

Machine Learning · Computer Science 2021-06-09 Amit Daniely , Gal Vardi

This paper studies lower bounds for fundamental optimization problems in the CONGEST model. We show that solving problems exactly in this model can be a hard task, by providing $\tilde{\Omega}(n^2)$ lower bounds for cornerstone problems,…

Data Structures and Algorithms · Computer Science 2019-05-27 Nir Bachrach , Keren Censor-Hillel , Michal Dory , Yuval Efron , Dean Leitersdorf , Ami Paz

Decision trees are one of the most fundamental computational models for computing Boolean functions $f : \{0, 1\}^n \mapsto \{0, 1\}$. It is well-known that the depth and size of decision trees are closely related to time and number of…

Computational Complexity · Computer Science 2025-01-03 Deepu Benson , Balagopal Komarath , Jayalal Sarma , Nalli Sai Soumya

We consider principled alternatives to unsupervised learning in data mining by situating the learning task in the context of the subsequent analysis task. Specifically, we consider a query-answering (hypothesis-testing) task: In the…

Data Structures and Algorithms · Computer Science 2013-04-18 Brendan Juba

We study parity decision trees for Boolean functions. The motivation of our study is the log-rank conjecture for XOR functions and its connection to Fourier analysis and parity decision tree complexity. Let f be a Boolean function with…

Computational Complexity · Computer Science 2020-08-04 Nikhil S. Mande , Swagato Sanyal

This paper concerns proving almost tight (super-polynomial) running times, for achieving desired approximation ratios for various problems. To illustrate, the question we study, let us consider the Set-Cover problem with n elements and m…

Data Structures and Algorithms · Computer Science 2018-11-05 Marek Cygan , Guy Kortsarz , Bundit Laekhanukit

In the Set Cover problem, the input is a ground set of $n$ elements and a collection of $m$ sets, and the goal is to find the smallest sub-collection of sets whose union is the entire ground set. The fastest algorithm known runs in time…

Data Structures and Algorithms · Computer Science 2019-01-18 Robert Krauthgamer , Ohad Trabelsi

We introduce and initiate the study of a new model of reductions called the random noise model. In this model, the truth table $T_f$ of the function $f$ is corrupted on a randomly chosen $\delta$-fraction of instances. A randomized…

Computational Complexity · Computer Science 2025-09-09 Tejas Nareddy , Abhishek Mishra

Hardness results for maximum agreement problems have close connections to hardness results for proper learning in computational learning theory. In this paper we prove two hardness results for the problem of finding a low degree polynomial…

Machine Learning · Computer Science 2010-10-19 Ilias Diakonikolas , Ryan O'Donnell , Rocco A. Servedio , Yi Wu