English
Related papers

Related papers: Inapproximability of VC Dimension and Littlestone'…

200 papers

We study the complexity of computing (and approximating) VC Dimension and Littlestone's Dimension when we are given the concept class explicitly. We give a simple reduction from Maximum (Unbalanced) Biclique problem to approximating VC…

Computational Complexity · Computer Science 2022-11-04 Pasin Manurangsi

The VC-dimension is a well-studied and fundamental complexity measure of a set system (or hypergraph) that is central to many areas of machine learning. We establish several new results on the complexity of computing the VC-dimension. In…

Computational Complexity · Computer Science 2025-10-24 Florent Foucaud , Harmender Gahlawat , Fionn Mc Inerney , Prafullkumar Tale

We introduce the problem Partial VC Dimension that asks, given a hypergraph $H=(X,E)$ and integers $k$ and $\ell$, whether one can select a set $C\subseteq X$ of $k$ vertices of $H$ such that the set $\{e\cap C, e\in E\}$ of distinct…

Data Structures and Algorithms · Computer Science 2019-05-29 Cristina Bazgan , Florent Foucaud , Florian Sikora

Given a domain $X$ and a collection $\mathcal{H}$ of functions $h:X\to \{0,1\}$, the Vapnik-Chervonenkis (VC) dimension of $\mathcal{H}$ measures its complexity in an appropriate sense. In particular, the fundamental theorem of statistical…

We investigate the VC-dimension of the perceptron and simple two-layer networks like the committee- and the parity-machine with weights restricted to values $\pm1$. For binary inputs, the VC-dimension is determined by atypical pattern sets,…

Condensed Matter · Physics 2009-10-28 S. Mertens , A. Engel

We study the complexity of the Hitting Set problem in set systems (hypergraphs) that avoid certain sub-structures. In particular, we characterize the classical and parameterized complexity of the problem when the Vapnik-Chervonenkis…

Data Structures and Algorithms · Computer Science 2016-06-22 Karl Bringmann , László Kozma , Shay Moran , N. S. Narayanaswamy

Vapnik-Chervonenkis (VC) dimension is a fundamental measure of the generalization capacity of learning algorithms. However, apart from a few special cases, it is hard or impossible to calculate analytically. Vapnik et al. [10] proposed a…

Machine Learning · Statistics 2011-11-16 Daniel J. McDonald , Cosma Rohilla Shalizi , Mark Schervish

We present the first nearly optimal differentially private PAC learner for any concept class with VC dimension 1 and Littlestone dimension $d$. Our algorithm achieves the sample complexity of…

Machine Learning · Computer Science 2025-07-30 Chao Yan

Detecting and counting copies of permutation patterns are fundamental algorithmic problems, with applications in the analysis of rankings, nonparametric statistics, and property testing tasks such as independence and quasirandomness…

Data Structures and Algorithms · Computer Science 2026-05-07 Michal Opler

In this work we study the quantitative relation between VC-dimension and two other basic parameters related to learning and teaching. Namely, the quality of sample compression schemes and of teaching sets for classes of low VC-dimension.…

Machine Learning · Computer Science 2016-11-28 Shay Moran , Amir Shpilka , Avi Wigderson , Amir Yehudayoff

We present and study approximate notions of dimensional and margin complexity, which correspond to the minimal dimension or norm of an embedding required to approximate, rather then exactly represent, a given hypothesis class. We show that…

Machine Learning · Computer Science 2020-03-10 Pritish Kamath , Omar Montasser , Nathan Srebro

We study closure properties for the Littlestone and threshold dimensions of binary hypothesis classes. Given classes $\mathcal{H}_1, \ldots, \mathcal{H}_k$ of Boolean functions with bounded Littlestone (respectively, threshold) dimension,…

Machine Learning · Computer Science 2020-07-08 Badih Ghazi , Noah Golowich , Ravi Kumar , Pasin Manurangsi

In this short note, we show that the problem of computing the recursive teaching dimension (RTD) for a concept class (given explicitly as input) requires $n^{\Omega(\log n)}$-time, assuming the exponential time hypothesis (ETH). This…

Computational Complexity · Computer Science 2023-07-20 Pasin Manurangsi

The Closest Vector Problem (CVP) is a computational problem in lattices that is central to modern cryptography. The study of its fine-grained complexity has gained momentum in the last few years, partly due to the upcoming deployment of…

Data Structures and Algorithms · Computer Science 2025-01-08 Amir Abboud , Rajendra Kumar

The Strong Exponential Time Hypothesis and the OV-conjecture are two popular hardness assumptions used to prove a plethora of lower bounds, especially in the realm of polynomial-time algorithms. The OV-conjecture in moderate dimension…

Computational Complexity · Computer Science 2018-05-23 Amir Abboud , Karl Bringmann , Holger Dell , Jesper Nederlof

Delle Rose et al.~(COLT'23) introduced an effective version of the Vapnik-Chervonenkis dimension, and showed that it characterizes improper PAC learning with total computable learners. In this paper, we introduce and study a similar…

Machine Learning · Computer Science 2024-11-25 Valentino Delle Rose , Alexander Kozachinskiy , Tomasz Steifer

We consider the problem of enumerating all minimal transversals (also called minimal hitting sets) of a hypergraph $\mathcal{H}$. An equivalent formulation of this problem known as the \emph{transversal hypergraph} problem (or…

Combinatorics · Mathematics 2026-02-02 Arnaud Mary

In Statistical Learning, the Vapnik-Chervonenkis (VC) dimension is an important combinatorial property of classifiers. To our knowledge, no theoretical results yet exist for the VC dimension of edited nearest-neighbour (1NN) classifiers…

Machine Learning · Computer Science 2019-02-08 Iain A. D. Gunn , Ludmila I. Kuncheva

We study the Eigenstate Thermalization Hypothesis (ETH) in chaotic conformal field theories (CFTs) of arbitrary dimensions. Assuming local ETH, we compute the reduced density matrix of a ball-shaped subsystem of finite size in the infinite…

High Energy Physics - Theory · Physics 2018-06-14 Nima Lashkari , Anatoly Dymarsky , Hong Liu

We study the 2-ary constraint satisfaction problems (2-CSPs), which can be stated as follows: given a constraint graph $G=(V,E)$, an alphabet set $\Sigma$ and, for each $\{u, v\}\in E$, a constraint $C_{uv} \subseteq \Sigma\times\Sigma$,…

Computational Complexity · Computer Science 2018-05-11 Irit Dinur , Pasin Manurangsi
‹ Prev 1 2 3 10 Next ›