English
Related papers

Related papers: Information-theoretic generalization bounds for le…

200 papers

This work discusses how to derive upper bounds for the expected generalisation error of supervised learning algorithms by means of the chaining technique. By developing a general theoretical framework, we establish a duality between…

Machine Learning · Statistics 2022-07-01 Eugenio Clerico , Amitis Shidani , George Deligiannidis , Arnaud Doucet

Quantum information theory studies the fundamental limits that physical laws impose on information processing tasks such as data compression and data transmission on noisy channels. This thesis presents general techniques that allow one to…

Quantum Physics · Physics 2010-04-13 Frédéric Dupuis

In modern quantum information theory one deals with an idealized situation when the spacetime dependence of quantum phenomena is neglected. However the transmission and processing of (quantum) information is a physical process in spacetime.…

Quantum Physics · Physics 2016-09-08 Igor V. Volovich

Meta-learning automatically infers an inductive bias by observing data from a number of related tasks. The inductive bias is encoded by hyperparameters that determine aspects of the model class or training algorithm, such as initialization…

Machine Learning · Computer Science 2020-11-10 Sharu Theresa Jose , Osvaldo Simeone , Giuseppe Durisi

We introduce a general statistical learning theory for processes that take as input a classical random variable and output a quantum state. Our setting is motivated by the practical situation in which one desires to learn a quantum process…

Quantum Physics · Physics 2025-02-27 Marco Fanizza , Yihui Quek , Matteo Rosati

Generalization is the ability of machine learning models to make accurate predictions on new data by learning from training data. However, understanding generalization of quantum machine learning models has been a major challenge. Here, we…

Quantum Physics · Physics 2024-08-07 Tobias Haug , M. S. Kim

Understanding the dynamics of large quantum systems is hindered by the curse of dimensionality. Statistical learning offers new possibilities in this regime by neural-network protocols and classical shadows, while both methods have…

Quantum Physics · Physics 2023-08-23 Yuxuan Du , Yibo Yang , Tongliang Liu , Zhouchen Lin , Bernard Ghanem , Dacheng Tao

We are motivated by the problem of providing strong generalization guarantees in the context of meta-learning. Existing generalization bounds are either challenging to evaluate or provide vacuous guarantees in even relatively simple…

Machine Learning · Computer Science 2021-10-27 Alec Farid , Anirudha Majumdar

In this paper we investigate the connection between quantum information theory and machine learning. In particular, we show how quantum state discrimination can represent a useful tool to address the standard classification problem in…

Quantum classifiers are vulnerable to adversarial attacks that manipulate their input classical or quantum data. A promising countermeasure is adversarial training, where quantum classifiers are trained by using an attack-aware, adversarial…

Quantum Physics · Physics 2025-04-25 Petros Georgiou , Aaron Mark Thomas , Sharu Theresa Jose , Osvaldo Simeone

This thesis establishes a number of connections between foundational issues in quantum theory, and some quantum information applications. It starts with a review of quantum contextuality and non-locality, multipartite entanglement…

Quantum Physics · Physics 2007-05-23 Ernesto F. Galvao

This paper surveys quantum learning theory: the theoretical aspects of machine learning using quantum computers. We describe the main results known for three models of learning: exact learning from membership queries, and Probably…

Quantum Physics · Physics 2017-07-31 Srinivasan Arunachalam , Ronald de Wolf

Machine learning algorithms operating on mobile networks can be characterized into three different categories. First is the classical situation in which the end-user devices send their data to a central server where this data is used to…

Machine Learning · Computer Science 2020-05-07 Semih Yagli , Alex Dytso , H. Vincent Poor

One of the key obstacles in traditional deep learning is the reduction in model transparency caused by increasingly intricate model functions, which can lead to problems such as overfitting and excessive confidence in predictions. With the…

Machine Learning · Computer Science 2025-07-22 Maximilian Wendlinger , Kilian Tscharke , Pascal Debus

Quantum mechanics and information theory are among the most important scientific discoveries of the last century. Although these two areas initially developed separately it has emerged that they are in fact intimately related. In this…

Quantum Physics · Physics 2009-11-07 V. Vedral

Deep learning has seen substantial achievements, with numerical and theoretical evidence suggesting that singularities of statistical models are considered a contributing factor to its performance. From this remarkable success of classical…

Quantum Physics · Physics 2024-11-26 Hiroshi Yano , Yota Maeda , Naoki Yamamoto

Quantum machine learning is often highlighted as one of the most promising practical applications for which quantum computers could provide a computational advantage. However, a major obstacle to the widespread use of quantum machine…

Quantum Physics · Physics 2024-07-09 Sofiene Jerbi , Casper Gyurik , Simon C. Marshall , Riccardo Molteni , Vedran Dunjko

Despite significant effort, the quantum machine learning community has only demonstrated quantum learning advantages for artificial cryptography-inspired datasets when dealing with classical data. In this paper we address the challenge of…

Quantum Physics · Physics 2024-11-14 Casper Gyurik , Vedran Dunjko

Generalization error bounds are critical to understanding the performance of machine learning models. In this work, we propose a new information-theoretic based generalization error upper bound applicable to supervised learning scenarios.…

Information Theory · Computer Science 2021-01-11 Gholamali Aminian , Laura Toni , Miguel R. D. Rodrigues

Network information theory is the study of communication problems involving multiple senders, multiple receivers and intermediate relay stations. The purpose of this thesis is to extend the main ideas of classical network information theory…

Quantum Physics · Physics 2012-08-22 Ivan Savov