English
Related papers

Related papers: The interplay of robustness and generalization in …

200 papers

Reinforcement learning research obtained significant success and attention with the utilization of deep neural networks to solve problems in high dimensional state or action spaces. While deep reinforcement learning policies are currently…

Machine Learning · Computer Science 2024-10-31 Ezgi Korkmaz

Most generalization bounds in learning theory are based on some measure of the complexity of the hypothesis class used, independently of any algorithm. In contrast, the notion of algorithmic stability can be used to derive tight…

Machine Learning · Computer Science 2008-11-12 Mehryar Mohri , Afshin Rostamizadeh

Generative adversarial networks (GANs) are so complex that the existing learning theories do not provide a satisfactory explanation for why GANs have great success in practice. The same situation also remains largely open for deep neural…

Machine Learning · Computer Science 2022-02-15 Khoat Than , Nghia Vu

Quantum machine learning, which involves running machine learning algorithms on quantum devices, may be one of the most significant flagship applications for these devices. Unlike its classical counterparts, the role of data in quantum…

Quantum Physics · Physics 2024-08-20 Kaining Zhang , Junyu Liu , Liu Liu , Liang Jiang , Min-Hsiu Hsieh , Dacheng Tao

Reducing the size of neural network models is a critical step in moving AI from a cloud-centric to an edge-centric (i.e. on-device) compute paradigm. This shift from cloud to edge is motivated by a number of factors including reduced…

Machine Learning · Computer Science 2022-01-24 Micah Gorsline , James Smith , Cory Merkel

Robustness measures are increasingly prominent resource quantifiers that have been introduced for quantum resource theories such as entanglement and coherence. Despite the generality of these measures, their usefulness is hindered by the…

Quantum Physics · Physics 2023-06-02 Jonathan Schluck , Gláucia Murta , Hermann Kampermann , Dagmar Bruß , Nikolai Wyderka

Policy regularization methods such as maximum entropy regularization are widely used in reinforcement learning to improve the robustness of a learned policy. In this paper, we show how this robustness arises from hedging against worst-case…

Machine Learning · Computer Science 2024-04-29 Rob Brekelmans , Tim Genewein , Jordi Grau-Moya , Grégoire Delétang , Markus Kunesch , Shane Legg , Pedro Ortega

A machine learning (ML) system must learn not only to match the output of a target function on a training set, but also to generalize to novel situations in order to yield accurate predictions at deployment. In most practical applications,…

Machine Learning · Computer Science 2022-12-13 Clare Lyle

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

Machine Learning · Computer Science 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

In this paper, we investigate the problem of overfitting in deep reinforcement learning. Among the most common benchmarks in RL, it is customary to use the same environments for both training and testing. This practice offers relatively…

Machine Learning · Computer Science 2019-07-16 Karl Cobbe , Oleg Klimov , Chris Hesse , Taehoon Kim , John Schulman

Powerful deep neural networks are vulnerable to adversarial attacks. To obtain adversarially robust models, researchers have separately developed adversarial training and Jacobian regularization techniques. There are abundant theoretical…

Machine Learning · Statistics 2024-12-18 Dongya Wu , Xin Li

Obtaining reliable state preparation protocols is a key step towards practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to…

Quantum Physics · Physics 2024-09-04 Manuel Guatto , Gian Antonio Susto , Francesco Ticozzi

Deep Reinforcement Learning has shown great success in a variety of control tasks. However, it is unclear how close we are to the vision of putting Deep RL into practice to solve real world problems. In particular, common practice in the…

Machine Learning · Computer Science 2019-02-21 Chenyang Zhao , Olivier Sigaud , Freek Stulp , Timothy M. Hospedales

How sensitive should machine learning models be to input changes? We tackle the question of model smoothness and show that it is a useful inductive bias which aids generalization, adversarial robustness, generative modeling and…

Machine Learning · Statistics 2021-07-08 Mihaela Rosca , Theophane Weber , Arthur Gretton , Shakir Mohamed

Machine learning algorithms based on parametrized quantum circuits are prime candidates for near-term applications on noisy quantum computers. In this direction, various types of quantum machine learning models have been introduced and…

In the current quantum computing paradigm, significant focus is placed on the reduction or mitigation of quantum decoherence. When designing new quantum processing units, the general objective is to reduce the amount of noise qubits are…

Quantum Physics · Physics 2026-02-17 Viacheslav Kuzmin , Wilfrid Somogyi , Ekaterina Pankovets , Alexey Melnikov

This paper presents a study of robust policy networks in deep reinforcement learning. We investigate the benefits of policy parameterizations that naturally satisfy constraints on their Lipschitz bound, analyzing their empirical performance…

Machine Learning · Computer Science 2025-02-07 Nicholas H. Barbara , Ruigang Wang , Ian R. Manchester

We present a unified information-theoretic framework elucidating the interplay between stability, privacy, and the generalization performance of quantum learning algorithms. We establish a bound on the expected generalization error in terms…

Quantum Physics · Physics 2026-02-06 Ayanava Dasgupta , Naqueeb Ahmad Warsi , Masahito Hayashi

The interplay between quantum physics and machine learning gives rise to the emergent frontier of quantum machine learning, where advanced quantum learning models may outperform their classical counterparts in solving certain challenging…

Quantum Physics · Physics 2022-12-07 Weiyuan Gong , Dong Yuan , Weikang Li , Dong-Ling Deng

Robustness studies of black-box models is recognized as a necessary task for numerical models based on structural equations and predictive models learned from data. These studies must assess the model's robustness to possible…

Optimization and Control · Mathematics 2022-09-26 Marouane Il Idrissi , Nicolas Bousquet , Fabrice Gamboa , Bertrand Iooss , Jean-Michel Loubes