English
Related papers

Related papers: Average-case Complexity of Teaching Convex Polytop…

200 papers

The goal of subspace learning is to find a $k$-dimensional subspace of $\mathbb{R}^d$, such that the expected squared distance between instance vectors and the subspace is as small as possible. In this paper we study subspace learning in a…

Machine Learning · Computer Science 2016-05-27 Alon Gonen , Dan Rosenbaum , Yonina Eldar , Shai Shalev-Shwartz

Consider the following generalization of the classic binary search problem: A searcher is required to find a hidden target vertex $x$ in a graph $G$. To do so, they iteratively perform queries to an oracle, each about a chosen vertex $v$.…

Data Structures and Algorithms · Computer Science 2026-03-17 Michał Szyfelbein

We study the problem of PAC learning $\gamma$-margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is known to be $\widetilde{\Theta}(1/(\gamma^2…

Machine Learning · Computer Science 2025-01-17 Ilias Diakonikolas , Nikos Zarifis

Many popular learning algorithms (E.g. Regression, Fourier-Transform based algorithms, Kernel SVM and Kernel ridge regression) operate by reducing the problem to a convex optimization problem over a vector space of functions. These methods…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

We present an improved algorithm for {\em quasi-properly} learning convex polyhedra in the realizable PAC setting from data with a margin. Our learning algorithm constructs a consistent polyhedron as an intersection of about $t \log t$…

Machine Learning · Computer Science 2021-11-03 Lee-Ad Gottlieb , Eran Kaufman , Aryeh Kontorovich , Gabriel Nivasch

We study the problems of testing and learning high-dimensional discrete convex sets. The simplest high-dimensional discrete domain where convexity is a non-trivial property is the ternary hypercube, $\{-1,0,1\}^n$. The goal of this work is…

Data Structures and Algorithms · Computer Science 2023-11-21 Hadley Black , Eric Blais , Nathaniel Harms

We study the problem of {\em properly} learning large margin halfspaces in the agnostic PAC model. In more detail, we study the complexity of properly learning $d$-dimensional halfspaces on the unit ball within misclassification error…

Machine Learning · Computer Science 2019-08-30 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi

We study the problem of estimating multivariate log-concave probability density functions. We prove the first sample complexity upper bound for learning log-concave densities on $\mathbb{R}^d$, for all $d \geq 1$. Prior to our work, no…

Machine Learning · Computer Science 2017-06-07 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We revisit the problem of designing sublinear algorithms for estimating the average degree of an $n$-vertex graph. The standard access model for graphs allows for the following queries: sampling a uniform random vertex, the degree of a…

Data Structures and Algorithms · Computer Science 2025-10-24 Lorenzo Beretta , Deeparnab Chakrabarty , C. Seshadhri

Existing work on understanding deep learning often employs measures that compress all data-dependent information into a few numbers. In this work, we adopt a perspective based on the role of individual examples. We introduce a measure of…

Machine Learning · Computer Science 2021-06-21 Robert J. N. Baldock , Hartmut Maennel , Behnam Neyshabur

We consider an active learning setting where a learner is presented with a pool S of n unlabeled examples belonging to a domain X and asks queries to find the underlying labeling that agrees with a target concept h^* \in H. In contrast to…

Machine Learning · Computer Science 2024-06-11 Vasilis Kontonis , Mingchen Ma , Christos Tzamos

Contrastive learning is a highly successful technique for learning representations of data from labeled tuples, specifying the distance relations within the tuple. We study the sample complexity of contrastive learning, i.e. the minimum…

Machine Learning · Computer Science 2023-12-04 Noga Alon , Dmitrii Avdiukhin , Dor Elboim , Orr Fischer , Grigory Yaroslavtsev

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

Machine Learning · Computer Science 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

There are (at least) two reasons to study random polytopes. The first is to understand the combinatorics and geometry of random polytopes especially as compared to other classes of polytopes, and the second is to analyze average-case…

Probability · Mathematics 2019-05-02 Andrew Newman

In the discrete Tempotron learning problem a neuron receives time varying inputs and for a set of such input sequences ($\mathcal S_-$ set) the neuron must be sub-threshold for all times while for some other sequences ($\mathcal S_+$ set)…

Neurons and Cognition · Quantitative Biology 2015-11-03 Konrad Paul Kording

Abstract notions of convexity over the vertices of a graph, and corresponding notions of halfspaces, have recently gained attention from the machine learning community. In this work we study monophonic halfspaces, a notion of graph…

Machine Learning · Computer Science 2025-07-01 Marco Bressan , Victor Chepoi , Emmanuel Esposito , Maximilian Thiessen

In the Traveling Salesperson Problem with Neighborhoods (TSPN), we are given a collection of geometric regions in some space. The goal is to output a tour of minimum length that visits at least one point in each region. Even in the…

Data Structures and Algorithms · Computer Science 2019-06-14 Antonios Antoniadis , Krzysztof Fleszar , Ruben Hoeksma , Kevin Schewior

We focus on the average-case analysis: A function w : V -> Z+ is given which defines the likelihood for a node to be the one marked, and we want the strategy that minimizes the expected number of queries. Prior to this paper, very little…

Data Structures and Algorithms · Computer Science 2009-08-10 Ferdinando Cicalese , Tobias Jacobs , Eduardo Laber , Marco Molinaro

There are many high dimensional function classes that have fast agnostic learning algorithms when assumptions on the distribution of examples can be made, such as Gaussianity or uniformity over the domain. But how can one be confident that…

Machine Learning · Computer Science 2022-11-22 Ronitt Rubinfeld , Arsen Vasilyan

We study the problem of PAC learning halfspaces on $\mathbb{R}^d$ with Massart noise under the Gaussian distribution. In the Massart model, an adversary is allowed to flip the label of each point $\mathbf{x}$ with unknown probability…

Machine Learning · Computer Science 2021-11-09 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis