English
Related papers

Related papers: The Sample Complexity of Uniform Approximation for…

200 papers

We reconstruct the velocity field of incompressible flows given a finite set of measurements. For the spatial approximation, we introduce the Sparse Fourier divergence-free (SFdf) approximation based on a discrete $L^2$ projection. Within…

Fluid Dynamics · Physics 2021-10-13 Luis Espath , Dmitry Kabanov , Jonas Kiessling , Raúl Tempone

Within the machine learning community, the widely-used uniform convergence framework has been used to answer the question of how complex, over-parameterized models can generalize well to new data. This approach bounds the test error of the…

Machine Learning · Statistics 2021-03-05 Ryan Theisen , Jason M. Klusowski , Michael W. Mahoney

The statistical characterization of the sum of random variables (RVs) are useful for investigating the performance of wireless communication systems. We derive exact closed-form expressions for the probability density function (PDF) and…

Information Theory · Computer Science 2019-10-24 Hongyang Du , Jiayi Zhang , Julian Cheng , Bo Ai

Learning the cumulative distribution function (CDF) of an outcome variable conditional on a set of features remains challenging, especially in high-dimensional settings. Conditional transformation models provide a semi-parametric approach…

Machine Learning · Computer Science 2021-10-05 Philipp F. M. Baumann , Torsten Hothorn , David Rügamer

We theoretically explore the relationship between sample-efficiency and adaptivity in reinforcement learning. An algorithm is sample-efficient if it uses a number of queries $n$ to the environment that is polynomial in the dimension $d$ of…

Machine Learning · Computer Science 2024-05-29 Emmeran Johnson , Ciara Pike-Burke , Patrick Rebeschini

The $k$-Nearest Neighbour Cumulative Distribution Functions are measures of clustering for discrete datasets that are fast and efficient to compute. They are significantly more informative than the 2-point correlation function. Their…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-27 Kwanit Gangopadhyay , Arka Banerjee , Tom Abel

We study the approximation of non-negative multi-variate couplings in the uniform norm while matching given single-variable marginal constraints.

Probability · Mathematics 2021-08-25 Ugo Bindini , Tapio Rajala

We study norm-based uniform convergence bounds for neural networks, aiming at a tight understanding of how these are affected by the architecture and type of norm constraint, for the simple class of scalar-valued one-hidden-layer networks,…

Machine Learning · Computer Science 2022-09-23 Gal Vardi , Ohad Shamir , Nathan Srebro

This paper presents a novel approach to enhance communication efficiency in federated learning through clipped uniform quantization. By leveraging optimal clipping thresholds and client-specific adaptive quantization schemes, the proposed…

Machine Learning · Computer Science 2024-12-17 Zavareh Bozorgasl , Hao Chen

Machine learning models with inputs in a Euclidean space $\mathbb{R}^d$, when implemented on digital computers, generalize, and their generalization gap converges to $0$ at a rate of $c/N^{1/2}$ concerning the sample size $N$. However, the…

Machine Learning · Computer Science 2026-05-14 Anastasis Kratsios , A. Martina Neuman , Gudmund Pammer

Recent works have investigated the sample complexity necessary for fair machine learning. The most advanced of such sample complexity bounds are developed by analyzing multicalibration uniform convergence for a given predictor class. We…

Machine Learning · Computer Science 2022-02-10 Harrison Rosenberg , Robi Bhattacharjee , Kassem Fawaz , Somesh Jha

We provide a lowerbound on the sample complexity of distribution-free parity learning in the realizable case in the shuffle model of differential privacy. Namely, we show that the sample complexity of learning $d$-bit parity functions is…

Machine Learning · Computer Science 2021-03-30 Kobbi Nissim , Chao Yan

Uniformity plays an important role in evaluating learned representations, providing insights into self-supervised learning. In our quest for effective uniformity metrics, we pinpoint four principled properties that such metrics should…

Machine Learning · Computer Science 2024-04-29 Xianghong Fang , Jian Li , Qiang Sun , Benyou Wang

The estimation of cumulative distribution functions (CDF) is an important learning task with a great variety of downstream applications, such as risk assessments in predictions and decision making. In this paper, we study functional…

Machine Learning · Computer Science 2024-03-11 Qian Zhang , Anuran Makur , Kamyar Azizzadenesheli

Multi-index models - functions which only depend on the covariates through a non-linear transformation of their projection on a subspace - are a useful benchmark for investigating feature learning with neural nets. This paper examines the…

Machine Learning · Computer Science 2025-11-13 Emanuele Troiani , Yatin Dandi , Leonardo Defilippis , Lenka Zdeborová , Bruno Loureiro , Florent Krzakala

Diffusion Probabilistic Field (DPF) models the distribution of continuous functions defined over metric spaces. While DPF shows great potential for unifying data generation of various modalities including images, videos, and 3D geometry, it…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Kangfu Mei , Mo Zhou , Vishal M. Patel

We continue the study of the performance for fixed-price mechanisms in the bilateral trade problem, and improve approximation ratios of welfare-optimal mechanisms in several settings. Specifically, in the case where only the buyer…

Computer Science and Game Theory · Computer Science 2023-03-29 Zhengyang Liu , Zeyu Ren , Zihe Wang

This paper provides statistical guarantees on the accuracy of dynamical models learned from dependent data sequences. Specifically, we develop uniform error bounds that apply to quantized models and imperfect optimization algorithms…

Machine Learning · Computer Science 2026-02-18 Abdelkader Metakalard , Fabien Lauer , Kevin Colin , Marion Gilson

Contextual sequential decision-making problems play a crucial role in machine learning, encompassing a wide range of downstream applications such as bandits, sequential hypothesis testing and online risk control. These applications often…

Machine Learning · Statistics 2025-01-31 Haichen Hu , Rui Ai , Stephen Bates , David Simchi-Levi

In high-dimensional regression modelling, the number of candidate covariates to be included in the predictor is quite large, and variable selection is crucial. In this work, we propose a new penalty able to guarantee both sparse variable…

Methodology · Statistics 2022-12-19 Daniele Cuntrera , Luigi Augugliaro , Vito M. R. Muggeo