English
Related papers

Related papers: Learning convex bodies is hard

200 papers

One popular trend in meta-learning is to learn from many training tasks a common initialization for a gradient-based method that can be used to solve a new task with few samples. The theory of meta-learning is still in its early stages,…

Machine Learning · Computer Science 2020-02-27 Nikunj Saunshi , Yi Zhang , Mikhail Khodak , Sanjeev Arora

Oberman gave a stochastic control formulation of the problem of estimating the convex envelope of a non-convex function. Based on this, we develop a reinforcement learning scheme to approximate the convex envelope, using a variant of…

Systems and Control · Electrical Eng. & Systems 2023-11-27 Vivek S. Borkar , Adit Akarsh

We study the problem of estimating multivariate log-concave probability density functions. We prove the first sample complexity upper bound for learning log-concave densities on $\mathbb{R}^d$, for all $d \geq 1$. Prior to our work, no…

Machine Learning · Computer Science 2017-06-07 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Star-shaped bodies are an important nonconvex generalization of convex bodies (e.g., linear programming with violations). Here we present an efficient algorithm for sampling a given star-shaped body. The complexity of the algorithm grows…

Data Structures and Algorithms · Computer Science 2009-04-06 Karthekeyan Chandrasekaran , Daniel Dadush , Santosh Vempala

Contrastive learning is a highly successful technique for learning representations of data from labeled tuples, specifying the distance relations within the tuple. We study the sample complexity of contrastive learning, i.e. the minimum…

Machine Learning · Computer Science 2023-12-04 Noga Alon , Dmitrii Avdiukhin , Dor Elboim , Orr Fischer , Grigory Yaroslavtsev

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

Machine Learning · Computer Science 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

We study the sample complexity of the best-case Empirical Risk Minimizer in the setting of stochastic convex optimization. We show that there exists an instance in which the sample size is linear in the dimension, learning is possible, but…

Machine Learning · Computer Science 2026-02-10 Tal Burla , Roi Livni

We investigate how much information about a convex body can be retrieved from a finite number of its geometric moments. We give a sufficient condition for a convex body to be uniquely determined by a finite number of its geometric moments,…

Metric Geometry · Mathematics 2020-06-26 Astrid Kousholt , Julia Schulte

This paper presents several novel generalization bounds for the problem of learning kernels based on the analysis of the Rademacher complexity of the corresponding hypothesis sets. Our bound for learning kernels with a convex combination of…

Artificial Intelligence · Computer Science 2009-12-18 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

A translation body of a convex body is the convex hull of two of its translates intersecting each other. In the 1950s, Rogers and Shephard found the extremal values, over the family of $n$-dimensional convex bodies, of the maximal volume of…

Metric Geometry · Mathematics 2014-11-21 Zsolt Lángi

Denote by ${\mathcal K}^d$ the family of convex bodies in $E^d$ and by $w(C)$ the minimal width of $C \in {\mathcal K}^d$. We ask for the greatest number $\Lambda_n ({\mathcal K}^d)$ such that every $C \in {\mathcal K}^d$ contains a…

Metric Geometry · Mathematics 2017-03-30 Marek Lassak

Starting with a finite point set $X \subset \mathbf{R}^d$, the peeling process repeatedly removes the set of the vertices of the convex hull of the current set. The number of peeling steps required to completely remove $X$ is called the…

Metric Geometry · Mathematics 2021-04-22 Gergely Ambrus , Peter Nielsen , Caledonia Wilson

We provide a general framework for computing lower-bounds on the sample complexity of recovering the underlying graphs of Ising models, given i.i.d samples. While there have been recent results for specific graph classes, these involve…

Machine Learning · Computer Science 2014-12-09 Karthikeyan Shanmugam , Rashish Tandon , Alexandros G. Dimakis , Pradeep Ravikumar

We consider the problem of lower bounding a generalized Minkowski measure of subsets of a convex body with a log-concave probability measure, conditioned on the set size. A bound is given in terms of diameter and set size, which is sharp…

Functional Analysis · Mathematics 2007-05-23 Ravi Montenegro

We show that for any $t>1$, the set of unconditional convex bodies in $\mathbb{R}^n$ contains a $t$-separated subset of cardinality at least $\exp \exp (C(t) n)$. This implies that there exists an unconditional convex body in $\mathbb{R}^n$…

Metric Geometry · Mathematics 2015-08-21 Mark Rudelson

A polyhedral approximation of a convex body can be calculated by solving approximately an associated multiobjective convex program (MOCP). An MOCP can be solved approximately by Benson type algorithms, which compute outer and inner…

Optimization and Control · Mathematics 2024-01-26 Andreas Löhne , Fangyuan Zhao , Lizhen Shao

We present a new approach to learning the structure and parameters of a Bayesian network based on regularized estimation in an exponential family representation. Here we show that, given a fixed variable order, the optimal structure and…

Machine Learning · Computer Science 2012-07-02 Yuhong Guo , Dale Schuurmans

It is well known that any measure in S^2 satisfying certain simple conditions is the surface measure of a bounded convex body in R^3. It is also known that a local perturbation of the surface measure may lead to a nonlocal perturbation of…

Metric Geometry · Mathematics 2018-06-14 Alexander Plakhov

We consider problems in model selection caused by the geometry of models close to their points of intersection. In some cases---including common classes of causal or graphical models, as well as time series models---distinct models may…

Statistics Theory · Mathematics 2022-12-20 Robin J. Evans

We estimate the support of a uniform density, when it is assumed to be a convex polytope or, more generally, a convex body in $\R^d$. In the polytopal case, we construct an estimator achieving a rate which does not depend on the dimension…

Statistics Theory · Mathematics 2013-09-26 Victor-Emmanuel Brunel