English
Related papers

Related papers: A Variance-Based Analysis of Sample Complexity for…

200 papers

In this paper, we present a novel way to summarize the structure of large graphs, based on non-parametric estimation of edge density in directed multigraphs. Following coclustering approach, we use a clustering of the vertices, with a…

Social and Information Networks · Computer Science 2015-08-07 Marc Boullé

Statistical learning theory has largely focused on learning and generalization given independent and identically distributed (i.i.d.) samples. Motivated by applications involving time-series data, there has been a growing literature on…

Machine Learning · Computer Science 2019-06-24 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Siddhartha Jayanti

We give nearly optimal bounds on the sample complexity of $(\widetilde{\Omega}(\epsilon),\epsilon)$-tolerant testing the $\rho$-independent set property in the dense graph setting. In particular, we give an algorithm that inspects a random…

Data Structures and Algorithms · Computer Science 2025-03-28 Cameron Seth

We establish the sharpness of the percolation phase transition for a class of infinite-range weighted random connection models. The vertex set is given by a marked Poisson point process on $\mathbb{R}^d$ with intensity $\lambda>0$, where…

Probability · Mathematics 2025-12-29 Alejandro Caicedo , Leonid Kolesnikov

We establish the first tight lower bound of $\Omega(\log\log\kappa)$ on the query complexity of sampling from the class of strongly log-concave and log-smooth distributions with condition number $\kappa$ in one dimension. Whereas existing…

Statistics Theory · Mathematics 2021-06-11 Sinho Chewi , Patrik Gerber , Chen Lu , Thibaut Le Gouic , Philippe Rigollet

Existing Rademacher complexity bounds for neural networks rely only on norm control of the weight matrices and depend exponentially on depth via a product of the matrix norms. Lower bounds show that this exponential dependence on depth is…

Machine Learning · Computer Science 2020-04-13 Colin Wei , Tengyu Ma

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

Manifold regularization is a commonly used technique in semi-supervised learning. It enforces the classification rule to be smooth with respect to the data-manifold. Here, we derive sample complexity bounds based on pseudo-dimension for…

Machine Learning · Computer Science 2020-07-31 Alexander Mey , Tom Viering , Marco Loog

Several works have recently investigated the parameterized complexity of data completion problems, motivated by their applications in machine learning, and clustering in particular. Interestingly, these problems can be equivalently…

Data Structures and Algorithms · Computer Science 2024-07-16 Eduard Eiben , Robert Ganian , Iyad Kanj , Sebastian Ordyniak , Stefan Szeider

Grid entropy is a deterministic quantity inherent to lattice models which captures the entropy of empirical measures along paths that converge weakly to a given target measure. In this paper, we study the limiting behaviour of empirical…

Probability · Mathematics 2022-10-04 Alexandru Gatea

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

We study the sample complexity of learning neural networks, by providing new bounds on their Rademacher complexity assuming norm constraints on the parameter matrix of each layer. Compared to previous work, these complexity bounds have…

Machine Learning · Computer Science 2019-11-19 Noah Golowich , Alexander Rakhlin , Ohad Shamir

List learning is a variant of supervised classification where the learner outputs multiple plausible labels for each instance rather than just one. We investigate classical principles related to generalization within the context of list…

Machine Learning · Computer Science 2026-03-24 Steve Hanneke , Shay Moran , Tom Waknine

This paper deals with a class of neural SDEs and studies the limiting behavior of the associated sampled optimal control problems as the sample size grows to infinity. The neural SDEs with $N$ samples can be linked to the $N$-particle…

Optimization and Control · Mathematics 2025-06-19 Huafu Liao , Alpár R. Mészáros , Chenchen Mou , Chao Zhou

Classification of high dimensional data finds wide-ranging applications. In many of these applications equipping the resulting classification with a measure of uncertainty may be as important as the classification itself. In this paper we…

Machine Learning · Computer Science 2018-02-12 Andrea L. Bertozzi , Xiyang Luo , Andrew M. Stuart , Konstantinos C. Zygalakis

We present new sampling methods in finite population that allow to control the joint inclusion probabilities of units and especially the spreading of sampled units in the population. They are based on the use of renewal chains and…

Methodology · Statistics 2017-04-12 Yves Tillé , Lionel Qualité , Matthieu Wilhelm

We study the following question in the context of imitation learning for continuous control: how are the underlying stability properties of an expert policy reflected in the sample-complexity of an imitation learning task? We provide the…

Machine Learning · Computer Science 2023-01-18 Stephen Tu , Alexander Robey , Tingnan Zhang , Nikolai Matni

Conformal risk control (CRC) provides distribution-free guarantees for controlling the expected loss at a user-specified level. Existing theory typically assumes that the loss decreases monotonically with a tuning parameter that governs the…

Machine Learning · Statistics 2026-04-21 Tareq Aldirawi , Yun Li , Wenge Guo

Traditional statistical learning theory relies on the assumption that data are identically and independently distributed (i.i.d.). However, this assumption often does not hold in many real-life applications. In this survey, we explore…

Machine Learning · Computer Science 2024-04-09 Rui-Ray Zhang , Massih-Reza Amini

In the first paper of this series [S. Torquato, J. Chem. Phys. {\bf 136}, 054106 (2012)], analytical results concerning the continuum percolation of overlapping hyperparticles in $d$-dimensional Euclidean space $\mathbb{R}^d$ were obtained,…

Statistical Mechanics · Physics 2012-08-21 Salvatore Torquato , Yang Jiao