English
Related papers

Related papers: Indexability, concentration, and VC theory

200 papers

We study the complexity of the Hitting Set problem in set systems (hypergraphs) that avoid certain sub-structures. In particular, we characterize the classical and parameterized complexity of the problem when the Vapnik-Chervonenkis…

Data Structures and Algorithms · Computer Science 2016-06-22 Karl Bringmann , László Kozma , Shay Moran , N. S. Narayanaswamy

Recent indexing techniques inspired by source coding have been shown successful to index billions of high-dimensional vectors in memory. In this paper, we propose an approach that re-ranks the neighbor hypotheses obtained by these…

Information Retrieval · Computer Science 2011-02-21 Hervé Jégou , Romain Tavenard , Matthijs Douze , Laurent Amsaleg

Uniform laws of large numbers form a cornerstone of Vapnik--Chervonenkis theory, where they are characterized by the finiteness of the VC dimension. In this work, we study uniform convergence phenomena in cartesian product spaces, under…

Machine Learning · Computer Science 2026-03-26 Ron Holzman , Shay Moran , Alexander Shlimovich

The failure of the Euclidean norm to reliably distinguish between nearby and distant points in high dimensional space is well-known. This phenomenon of distance concentration manifests in a variety of data distributions, with iid or…

Machine Learning · Computer Science 2022-01-17 Brian A. Powell

In classical statistical learning theory, one of the most well studied problems is that of binary classification. The information-theoretic sample complexity of this task is tightly characterized by the Vapnik-Chervonenkis (VC) dimension. A…

Quantum Physics · Physics 2021-05-10 Matthias C. Caro

We investigate sample-based learning of conditional distributions on multi-dimensional unit boxes, allowing for different dimensions of the feature and target spaces. Our approach involves clustering data near varying query points in the…

Machine Learning · Statistics 2024-06-14 Cyril Bénézet , Ziteng Cheng , Sebastian Jaimungal

Acyclic digraphs arise in many natural and artificial processes. Among the broader set, dynamic citation networks represent a substantively important form of acyclic digraphs. For example, the study of such networks includes the spread of…

Physics and Society · Physics 2011-07-26 Michael J. Bommarito , Daniel Martin Katz , Jon Zelner , James H. Fowler

We establish a universal framework for concentration inequalities based on invariance under diffeomorphism groups. Given a probability measure $\mu$ on a space $E$ and a diffeomorphism $\psi: E \to F$, concentration properties transfer…

Statistics Theory · Mathematics 2025-12-12 Jocelyn Nembé

Clustering in high-dimensional spaces is a difficult problem which is recurrent in many domains, for example in image analysis. The difficulty is due to the fact that high-dimensional data usually live in different low-dimensional subspaces…

Statistics Theory · Mathematics 2016-08-16 Charles Bouveyron , Stéphane Girard , Cordelia Schmid

In this paper, matching of correlated high-dimensional databases is investigated. A stochastic database model is considered where the correlation among the database entries is governed by an arbitrary joint distribution. Concentration of…

Databases · Computer Science 2019-05-06 Farhad Shirani , Siddharth Garg , Elza Erkip

We study an indexing architecture to store and search in a database of high-dimensional vectors from the perspective of statistical signal processing and decision theory. This architecture is composed of several memory units, each of which…

Computer Vision and Pattern Recognition · Computer Science 2017-03-03 Ahmet Iscen , Teddy Furon , Vincent Gripon , Michael Rabbat , Hervé Jégou

Research on the generalization ability of deep neural networks (DNNs) has recently attracted a great deal of attention. However, due to their complex architectures and large numbers of parameters, measuring the generalization ability of…

Machine Learning · Computer Science 2022-03-18 Runqi Wang , Linlin Yang , Baochang Zhang , Wentao Zhu , David Doermann , Guodong Guo

We place ourselves in the setting of high-dimensional statistical inference, where the number of variables $p$ in a data set of interest is of the same order of magnitude as the number of observations $n$. More formally, we study the…

Probability · Mathematics 2009-12-11 Noureddine El Karoui

We use a formal correspondence between thermodynamics and inference, where the number of samples can be thought of as the inverse temperature, to study a quantity called ``learning capacity'' which is a measure of the effective…

Machine Learning · Computer Science 2024-10-22 Daiwei Chen , Wei-Kai Chang , Pratik Chaudhari

Graph-based multi-view clustering has achieved better performance than most non-graph approaches. However, in many real-world scenarios, the graph structure of data is not given or the quality of initial graph is poor. Additionally,…

Machine Learning · Computer Science 2022-09-23 Erlin Pan , Zhao Kang

Given a set $X$ and a function $h:X\longrightarrow\{0,1\}$ which labels each element of $X$ with either $0$ or $1$, we may define a function $h^{(s)}$ to measure the similarity of pairs of points in $X$ according to $h$. Specifically, for…

Machine Learning · Computer Science 2015-02-26 Mark Herbster , Paul Rubenstein , James Townsend

The concentration of measure phenomena were discovered as the mathematical background of statistical mechanics at the end of the XIX - beginning of the XX century and were then explored in mathematics of the XX-XXI centuries. At the…

Machine Learning · Computer Science 2018-03-20 A. N. Gorban , I. Y. Tyukin

One of the most studied problems in machine learning is finding reasonable constraints that guarantee the generalization of a learning algorithm. These constraints are usually expressed as some simplicity assumptions on the target. For…

Machine Learning · Computer Science 2020-01-03 Hassan Hafez-Kolahi , Shohreh Kasaei , Mahdiyeh Soleymani-Baghshah

In recent years, deep metric learning has achieved promising results in learning high dimensional semantic feature embeddings where the spatial relationships of the feature vectors match the visual similarities of the images. Similarity…

Machine Learning · Computer Science 2019-09-25 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Let $n>m$, and let $A$ be an $(m\times n)$-matrix of full rank. Then obviously the estimate $\|Ax\|\leq\|A\|\|x\|$ holds for the euclidean norm of $x$ and $Ax$ and the spectral norm as the assigned matrix norm. We study the sets of all $x$…

Rings and Algebras · Mathematics 2022-03-16 Harry Yserentant