English
Related papers

Related papers: Information-theoretic generalization bounds for le…

200 papers

Change of measure inequalities translate divergences between probability measures into explicit bounds on event probabilities, and play an important role in deriving probabilistic guarantees in learning theory, information theory, and…

Information Theory · Computer Science 2026-05-28 Yanxiao Liu , Yijun Fan , Deniz Gündüz

Control and learning are key to technological advancement, both in the classical and quantum domains, yet their interrelationship is insufficiently clear in the literature, especially between classical and quantum definitions of control and…

Quantum Physics · Physics 2024-03-13 Seyed Shakib Vedaie , Archismita Dalal , Eduardo J. Páez , Barry C. Sanders

Deep neural networks generalize well despite being heavily overparameterized, in apparent contradiction with classical learning theory based on uniform convergence over fixed hypothesis spaces. Uniform bounds over the entire parameter space…

Machine Learning · Statistics 2026-05-15 Hubert Leroux , Jean Marcus , Julien Roger

We apply the PAC-Bayes theory to the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-bounds) and explicit trade-off…

Machine Learning · Computer Science 2023-02-16 Michael Sucker , Peter Ochs

Information-theoretic generalization bounds based on the supersample construction are a central tool for algorithm-dependent generalization analysis in the batch i.i.d.~setting. However, existing supersample conditional mutual information…

Machine Learning · Statistics 2026-05-13 Futoshi Futami , Masahiro Fujisawa

We extend the theory of PAC learning in a way which allows to model a rich variety of learning tasks where the data satisfy special properties that ease the learning process. For example, tasks where the distance of the data from the…

Machine Learning · Computer Science 2021-07-22 Noga Alon , Steve Hanneke , Ron Holzman , Shay Moran

I will show how an objective definition of the concept of information and the consideration of recent results about information-processing in the human brain help clarify some fundamental and often counter-intuitive aspects of quantum…

Quantum Physics · Physics 2015-12-23 Juan G. Roederer

Recent developments in quantum computation have made it clear that there is a lot more to computation than the conventional Boolean algebra. Is quantum computation the most general framework for processing information? Having gathered the…

Quantum Physics · Physics 2007-05-23 Apoorva Patel

We consider quantum versions of two well-studied classical learning models: Angluin's model of exact learning from membership queries and Valiant's Probably Approximately Correct (PAC) model of learning from random examples. We give…

Quantum Physics · Physics 2007-05-23 Rocco A. Servedio , Steven J. Gortler

In most quantum technologies, measurements need to be performed on the parametrized quantum states to transform the quantum information to classical information. The measurements, however, inevitably distort the information. The…

Quantum Physics · Physics 2022-06-28 Hongzhen Chen , Yu Chen , Haidong Yuan

There is a long history in both general relativity and quantum mechanics of removing fixed background structures, thereby making observed objects and measurement processes dynamical. We continue this evolution by combining central insights…

General Relativity and Quantum Cosmology · Physics 2025-04-18 Per Berglund , Andrew Geraci , Tristan Hubsch , David Mattingly , Djordje Minic

Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where…

Studies addressing the question "Can a learner complete the learning securely?" have recently been spurred from the standpoints of fundamental theory and potential applications. In the relevant context of this question, we present a…

We introduce a new framework for studying meta-learning methods using PAC-Bayesian theory. Its main advantage over previous work is that it allows for more flexibility in how the transfer of knowledge between tasks is realized. For previous…

Machine Learning · Computer Science 2024-05-30 Hossein Zakerinia , Amin Behjati , Christoph H. Lampert

Traditional machine learning relies on explicit models and domain assumptions, limiting flexibility and interpretability. We introduce a model-free framework using surprisal (information theoretic uncertainty) to directly analyze and…

We attempt to contribute some novel points of view to the "foundations of quantum mechanics", using mathematical tools from "quantum probability theory" (such as the theory of operator algebras). We first introduce an abstract algebraic…

Quantum Physics · Physics 2013-10-08 J. Fröhlich , B. Schubnel

This paper explores the transformative potential of quantum computing in the realm of personalized learning. Traditional machine learning models and GPU-based approaches have long been utilized to tailor educational experiences to…

Quantum Physics · Physics 2024-08-29 Yifan Zhou , Chong Cheng Xu , Mingi Song , Yew Kee Wong

Over the past few years several quantum machine learning algorithms were proposed that promise quantum speed-ups over their classical counterparts. Most of these learning algorithms either assume quantum access to data -- making it unclear…

Quantum Physics · Physics 2021-07-14 Yunchao Liu , Srinivasan Arunachalam , Kristan Temme

The Quantum Internet is envisioned as the final stage of the quantum revolution, opening fundamentally new communications and computing capabilities, including the distributed quantum computing. But the Quantum Internet is governed by the…

We address the following criterion for quantifying the quantum information resources: classically simulable {\it vs.} classically non-simulable information processing. This approach gives rise to existence of a deeper level of quantum…

Quantum Physics · Physics 2007-05-23 M. Dugic