English
Related papers

Related papers: Measurability Aspects of the Compactness Theorem f…

200 papers

We prove that $\tilde{\Theta}(k d^2 / \varepsilon^2)$ samples are necessary and sufficient for learning a mixture of $k$ Gaussians in $\mathbb{R}^d$, up to error $\varepsilon$ in total variation distance. This improves both the known upper…

Machine Learning · Computer Science 2020-07-23 Hassan Ashtiani , Shai Ben-David , Nick Harvey , Christopher Liaw , Abbas Mehrabian , Yaniv Plan

Local versions of measurability have been around for a long time. Roughly, one splits the notion of $\mu $-completeness into pieces, and asks for a uniform ultrafilter over $\mu $ satisfying just some piece of $\mu $-completeness. Analogue…

Logic · Mathematics 2014-04-08 Paolo Lipparini

Compressed sensing with subsampled unitary matrices benefits from \emph{optimized} sampling schemes, which feature improved theoretical guarantees and empirical performance relative to uniform subsampling. We provide, in a first of its kind…

Machine Learning · Statistics 2025-04-03 Yaniv Plan , Matthew S. Scott , Xia Sheng , Ozgur Yilmaz

Our interest lies in the recoverability properties of compressed tensors under the \textit{canonical polyadic decomposition} (CPD) model. The considered problem is well-motivated in many applications, e.g., hyperspectral image and video…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Shahana Ibrahim , Xiao Fu , Xingguo Li

We present a new similarity measure based on information theoretic measures which is superior than Normalized Compression Distance for clustering problems and inherits the useful properties of conditional Kolmogorov complexity. We show that…

Machine Learning · Statistics 2014-10-22 Andrey Bogomolov , Bruno Lepri , Fabio Pianesi

This paper proves a representation theorem regarding sequences of random elements that take values in a Borel space and are measurable with respect to the sigma algebra generated by an arbitrary union of sigma algebras. This, together with…

Probability · Mathematics 2022-07-07 Michael J. Neely

Collapsibility provides a principled approach for dimension reduction in contingency tables and graphical models. Madigan and Mosurski (1990) pioneered the study of minimal collapsible sets in decomposable models, but existing algorithms…

Methodology · Statistics 2025-10-21 Pei Heng , Yi Sun , Shiyuan He , Jianhua Guo

A finite relational structure A is called compact if for any infinite relational structure B of the same type, the existence of a homomorphism from B to A is equivalent to the existence of homomorphisms from all finite substructures of B to…

Logic · Mathematics 2026-03-09 Claude Tardif

In proving large deviation estimates, the lower bound for open sets and upper bound for compact sets are essentially local estimates. On the other hand, the upper bound for closed sets is global and compactness of space or an exponential…

Probability · Mathematics 2015-10-20 Chiranjib Mukherjee , S. R. S. Varadhan

We examine the Bayes-consistency of a recently proposed 1-nearest-neighbor-based multiclass learning algorithm. This algorithm is derived from sample compression bounds and enjoys the statistical advantages of tight, fully empirical…

Machine Learning · Computer Science 2019-06-27 Aryeh Kontorovich , Sivan Sabato , Roi Weiss

A sampling theorem on the sphere has been developed recently, requiring half as many samples as alternative equiangular sampling theorems on the sphere. A reduction by a factor of two in the number of samples required to represent a…

Information Theory · Computer Science 2011-10-31 J. D. McEwen , G. Puy , J. -Ph. Thiran , P. Vandergheynst , D. Van De Ville , Y. Wiaux

We prove a compactness theorem for embedded measured hyperbolic Riemann surface laminations in a compact almost complex manifold $(X, J)$. To prove compactness result, we show that there is a suitable topology on the space of measured…

Geometric Topology · Mathematics 2018-01-04 Divakaran Divakaran , Dheeraj Kulkarni

The Fundamental Theorem of Statistical Learning states that a hypothesis space is PAC learnable if and only if its VC dimension is finite. For the agnostic model of PAC learning, the literature so far presents proofs of this theorem that…

Machine Learning · Computer Science 2025-09-29 Lothar Sebastian Krapp , Laura Wirth

One of the earliest conjectures in computational learning theory-the Sample Compression conjecture-asserts that concept classes (equivalently set systems) admit compression schemes of size linear in their VC dimension. To-date this…

Machine Learning · Computer Science 2014-02-04 J. Hyam Rubinstein , Benjamin I. P. Rubinstein , Peter L. Bartlett

The main aim of the article is to show, in the absence of the Axiom of Choice, relationships between the following, independent of $\mathbf{ZF}$, statements: "Every countable product of compact metrizable spaces is separable (respectively,…

General Topology · Mathematics 2021-09-03 Kyriakos Keremedis , Eleftherios Tachtsis , Eliza Wajch

We prove Rellich-Kondrachov type theorems on the half-space $\mathbb{H}^{N+1}=\{(y, x) \in \left.\mathbb{R} \times \mathbb{R}^N: y>0\right\}$ endowed with the general weighted measure $\mu_w:=y^c \phi(|z|) d z$, where $c \in \mathbb{R}$ and…

Functional Analysis · Mathematics 2026-03-10 Yunfan Zhao , Xiaojing Chen

We prove that uniform metastability is equivalent to all closed subspaces being pseudocompact and use this to provide a topological proof of the metatheorem introduced by Caicedo, Duenez and Iovino on uniform metastability and countable…

Logic · Mathematics 2020-04-15 Clovis Hamel , Franklin D. Tall

An earlier introduced characterization of nonuniform learnability that allows the sample size to depend on the hypothesis to which the learner is compared has been redefined using the measure theoretic approach. Where nonuniform…

Machine Learning · Computer Science 2020-11-03 Ankit Bandyopadhyay

We give a new, very general, formulation of the compressed sensing problem in terms of coordinate projections of an analytic variety, and derive sufficient sampling rates for signal reconstruction. Our bounds are linear in the coherence of…

Machine Learning · Computer Science 2013-11-05 Franz J. Király , Louis Theran

We give an algorithmically efficient version of the learner-to-compression scheme conversion in Moran and Yehudayoff (2016). In extending this technique to real-valued hypotheses, we also obtain an efficient regression-to-bounded sample…

Machine Learning · Computer Science 2018-05-23 Steve Hanneke , Aryeh Kontorovich , Menachem Sadigurschi