English
Related papers

Related papers: Information-theoretic generalization bounds for le…

200 papers

While the quantum mutual information is a fundamental measure of quantum information, it is only defined for spacelike-separated quantum systems. Such a limitation is not present in the theory of classical information, where the mutual…

Quantum Physics · Physics 2024-10-04 James Fullwood , Zhen Wu , Arthur J. Parzygnat , Vlatko Vedral

We define a new model of quantum learning that we call Predictive Quantum (PQ). This is a quantum analogue of PAC, where during the testing phase the student is only required to answer a polynomial number of testing queries. We demonstrate…

Quantum Physics · Physics 2022-03-29 Dmytro Gavinsky

In this thesis I present a short review of ideas in quantum information theory. The first chapter contains introductory material, sketching the central ideas of probability and information theory. Quantum mechanics is presented at the level…

Quantum Physics · Physics 2007-05-23 Robert H. Schumann

We present an information-theoretic framework for understanding overfitting and underfitting in machine learning and prove the formal undecidability of determining whether an arbitrary classification algorithm will overfit a dataset.…

Machine Learning · Computer Science 2020-11-10 Daniel Bashir , George D. Montanez , Sonia Sehra , Pedro Sandoval Segura , Julius Lauw

Probably Approximately Correct (i.e., PAC) learning is a core concept of sample complexity theory, and efficient PAC learnability is often seen as a natural counterpart to the class P in classical computational complexity. But while the…

Computational Complexity · Computer Science 2023-04-28 Cornelius Brand , Robert Ganian , Kirill Simonov

This paper studies quantum supervised learning for classical inference from quantum states. In this model, a learner has access to a set of labeled quantum samples as the training set. The objective is to find a quantum measurement that…

Quantum Physics · Physics 2024-08-26 Mohsen Heidari , Wojciech Szpankowski

Generalization error bounds from learning theory provide statistical guarantees on how well an algorithm will perform on previously unseen data. In this paper, we characterize the impacts of data non-IIDness due to censored feedback (a.k.a.…

Machine Learning · Computer Science 2025-04-14 Yifan Yang , Ali Payani , Parinaz Naghizadeh

When a mountaineer is ascending one of the great peaks of the Himalayas she knows that an entirely new vista awaits her at the top, whose ramifications will be known only after she gets there. Her immediate goal though, is to tackle the…

Popular Physics · Physics 2010-01-20 T. P. Singh

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

The purpose of this paper is to formalize the concept that best synthesizes our intuitive understanding of quantum mechanics -- that the information carried by a system is limited -- and, from this principle, to construct the foundations of…

Quantum Physics · Physics 2025-07-04 Paolo Ferro

Modern quantum information theory deals with an idealized situation when the spacetime dependence of quantum phenomena is neglected. However the transmission and processing of (quantum) information is a physical process in spacetime.…

Quantum Physics · Physics 2007-05-23 Igor V. Volovich

PAC-Bayesian bounds are known to be tight and informative when studying the generalization ability of randomized classifiers. However, they require a loose and costly derandomization step when applied to some families of deterministic…

Machine Learning · Statistics 2023-09-19 Paul Viallard , Pascal Germain , Amaury Habrard , Emilie Morvant

We revisit the problem of characterising the complexity of Quantum PAC learning, as introduced by Bshouty and Jackson [SIAM J. Comput. 1998, 28, 1136-1153]. Several quantum advantages have been demonstrated in this setting, however, none…

Quantum Physics · Physics 2023-09-21 Wilfred Salmon , Sergii Strelchuk , Tom Gur

After carrying out a protocol for quantum key agreement over a noisy quantum channel, the parties Alice and Bob must process the raw key in order to end up with identical keys about which the adversary has virtually no information. In…

Quantum Physics · Physics 2013-01-22 N. Gisin , S. Wolf

One of the key challenges in quantum machine learning is finding relevant machine learning tasks with a provable quantum advantage. A natural candidate for this is learning unknown Hamiltonian dynamics. Here, we tackle the supervised…

Quantum Physics · Physics 2025-06-23 Alice Barthe , Mahtab Yaghubi Rad , Michele Grossi , Vedran Dunjko

In this article we discuss the formal structure of a generalized information theory based on the extension of the probability calculus of Kolmogorov to a (possibly) non-commutative setting. By studying this framework, we argue that quantum…

Quantum Physics · Physics 2016-01-19 F. Holik , G. M. Bosyk , G. Bellomo

Quantum information theory represents a rich subject of discussion for those interested in the philosphical and foundational issues surrounding quantum mechanics for a simple reason: one can cast its central concerns in terms of a…

Quantum Physics · Physics 2007-05-23 Christopher G Timpson

In meta-learning an agent extracts knowledge from observed tasks, aiming to facilitate learning of novel future tasks. Under the assumption that future tasks are 'related' to previous tasks, the accumulated knowledge should be learned in a…

Machine Learning · Statistics 2019-05-21 Ron Amit , Ron Meir

The ability of machine learning (ML) algorithms to generalize well to unseen data has been studied through the lens of information theory, by bounding the generalization error with the input-output mutual information (MI), i.e., the MI…

Machine Learning · Statistics 2024-06-07 Kimia Nadjahi , Kristjan Greenewald , Rickard Brüel Gabrielsson , Justin Solomon

Machine learning is widely believed to be one of the most promising practical applications of quantum computing. Existing quantum machine learning schemes typically employ a quantum-classical hybrid approach that relies crucially on…

Quantum Physics · Physics 2025-02-11 Qi Ye , Shuangyue Geng , Zizhao Han , Weikang Li , L. -M. Duan , Dong-Ling Deng