English
Related papers

Related papers: Tight Generalization Bound for Supervised Quantum …

200 papers

Quantum error mitigation has been proposed as a means to combat unwanted and unavoidable errors in near-term quantum computing without the heavy resource overheads required by fault tolerant schemes. Recently, error mitigation has been…

Quantum Physics · Physics 2024-10-15 Yihui Quek , Daniel Stilck França , Sumeet Khatri , Johannes Jakob Meyer , Jens Eisert

Quantum machine learning, which involves running machine learning algorithms on quantum devices, may be one of the most significant flagship applications for these devices. Unlike its classical counterparts, the role of data in quantum…

Quantum Physics · Physics 2024-08-20 Kaining Zhang , Junyu Liu , Liu Liu , Liang Jiang , Min-Hsiu Hsieh , Dacheng Tao

Our main focus is on the generalization bound, which serves as an upper limit for the generalization error. Our analysis delves into regression and classification tasks separately to ensure a thorough examination. We assume the target…

Machine Learning · Statistics 2024-07-30 Wen-Liang Hwang

The primary objective of learning methods is generalization. Classic uniform generalization bounds, which rely on VC-dimension or Rademacher complexity, fail to explain the significant attribute that over-parameterized models in deep…

Machine Learning · Computer Science 2025-03-07 Lijia Yu , Yibo Miao , Yifan Zhu , Xiao-Shan Gao , Lijun Zhang

This work advances the theoretical understanding of quantum learning by establishing a new family of upper bounds on the expected generalization error of quantum learning algorithms, leveraging the framework introduced by Caro et al. (2024)…

Quantum Physics · Physics 2026-04-20 Naqueeb Ahmad Warsi , Ayanava Dasgupta , Masahito Hayashi

We analyze new generalization bounds for deep learning models trained by transfer learning from a source to a target task. Our bounds utilize a quantity called the majority predictor accuracy, which can be computed efficiently from data. We…

Machine Learning · Computer Science 2022-09-14 Cuong N. Nguyen , Lam Si Tung Ho , Vu Dinh , Tal Hassner , Cuong V. Nguyen

Many algorithms have been recently proposed for causal machine learning. Yet, there is little to no theory on their quality, especially considering finite samples. In this work, we propose a theory based on generalization bounds that…

Machine Learning · Statistics 2024-05-16 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community now trains networks to achieve small training error also leads to small error on held-out data from the…

Leveraging algorithmic stability to derive sharp generalization bounds is a classic and powerful approach in learning theory. Since Vapnik and Chervonenkis [1974] first formalized the idea for analyzing SVMs, it has been utilized to study…

Machine Learning · Computer Science 2021-01-26 Qinghua Liu , Zhou Lu

We study over-parameterized classifiers where Empirical Risk Minimization (ERM) for learning leads to zero training error. In these over-parameterized settings there are many global minima with zero training error, some of which generalize…

Machine Learning · Computer Science 2023-12-05 Julius Martinetz , Thomas Martinetz

The use of low-bit quantization has emerged as an indispensable technique for enabling the efficient training of large-scale models. Despite its widespread empirical success, a rigorous theoretical understanding of its impact on learning…

Machine Learning · Statistics 2026-02-17 Dechen Zhang , Junwei Su , Difan Zou

Quantum classifiers are vulnerable to adversarial attacks that manipulate their input classical or quantum data. A promising countermeasure is adversarial training, where quantum classifiers are trained by using an attack-aware, adversarial…

Quantum Physics · Physics 2025-04-25 Petros Georgiou , Aaron Mark Thomas , Sharu Theresa Jose , Osvaldo Simeone

Inverse optimization (IO) seeks to infer the parameters of a decision-maker's objective from observed context--action data. We study noiseless IO, where demonstrations are generated by a ground-truth objective. We provide a high-probability…

Machine Learning · Statistics 2026-05-12 Pouria Fatemi , Hoomaan Maskan , Suvrit Sra , Peyman Mohajerin Esfahani

We present a general approach to deriving bounds on the generalization error of randomized learning algorithms. Our approach can be used to obtain bounds on the average generalization error as well as bounds on its tail probabilities, both…

Information Theory · Computer Science 2020-09-10 Fredrik Hellström , Giuseppe Durisi

Coherent control errors, for which ideal Hamiltonians are perturbed by unknown multiplicative noise terms, are a major obstacle for reliable quantum computing. In this paper, we present a framework for analyzing the robustness of quantum…

Quantum Physics · Physics 2024-12-04 Julian Berberich , Daniel Fink , Christian Holm

Quantum neural networks generalize classical artificial neural networks into the quantum domain. They are formulated as parameterized quantum circuits which are optimized by measuring and minimizing a suitably chosen loss function. The core…

Quantum Physics · Physics 2026-04-29 Mario Boneberg , Simon Kochsiek , Igor Lesanovsky

Existing generalization theories of supervised learning typically take a holistic approach and provide bounds for the expected generalization over the whole data distribution, which implicitly assumes that the model generalizes similarly…

Machine Learning · Computer Science 2024-01-08 Firas Laakom , Yuheng Bu , Moncef Gabbouj

The inevitable accumulation of errors in near-future quantum devices represents a key obstacle in delivering practical quantum advantages, motivating the development of various quantum error-mitigation methods. Here, we derive fundamental…

Quantum Physics · Physics 2022-09-23 Ryuji Takagi , Suguru Endo , Shintaro Minagawa , Mile Gu

In this paper, we study data-dependent generalization error bounds exhibiting a mild dependency on the number of classes, making them suitable for multi-class learning with a large number of label classes. The bounds generally hold for…

Machine Learning · Computer Science 2018-01-01 Yunwen Lei , Urun Dogan , Ding-Xuan Zhou , Marius Kloft

Generalization error (also known as the out-of-sample error) measures how well the hypothesis learned from training data generalizes to previously unseen data. Proving tight generalization error bounds is a central question in statistical…

Machine Learning · Computer Science 2020-03-03 Jian Li , Xuanyuan Luo , Mingda Qiao