English
Related papers

Related papers: The interplay of robustness and generalization in …

200 papers

Robustness of deep learning models is a property that has recently gained increasing attention. We explore a notion of robustness for generative adversarial models that is pertinent to their internal interactive structure, and show that,…

Machine Learning · Computer Science 2019-10-11 Zhi Xu , Chengtao Li , Stefanie Jegelka

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

Machine Learning · Computer Science 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

Quantum machine learning explores the interplay between machine learning and quantum physics, which may lead to unprecedented perspectives for both fields. In fact, recent works have shown strong evidences that quantum computers could…

Quantum Physics · Physics 2021-11-08 Weiyuan Gong , Dong-Ling Deng

Adversarial attacks and the development of (deep) neural networks robust against them are currently two widely researched topics. The robustness of Learning Vector Quantization (LVQ) models against adversarial attacks has however not yet…

Machine Learning · Computer Science 2019-06-12 Sascha Saralajew , Lars Holdijk , Maike Rees , Thomas Villmann

Deep neural networks have shown remarkable performance across a wide range of vision-based tasks, particularly due to the availability of large-scale datasets for training and better architectures. However, data seen in the real world are…

Machine Learning · Computer Science 2018-11-26 Muhammad Usama , Dong Eui Chang

Generalization is the ability of machine learning models to make accurate predictions on new data by learning from training data. However, understanding generalization of quantum machine learning models has been a major challenge. Here, we…

Quantum Physics · Physics 2024-08-07 Tobias Haug , M. S. Kim

Adversarial machine learning is an emerging field that focuses on studying vulnerabilities of machine learning approaches in adversarial settings and developing techniques accordingly to make learning robust to adversarial manipulations. It…

Quantum Physics · Physics 2020-08-11 Sirui Lu , Lu-Ming Duan , Dong-Ling Deng

Quantum machine learning emerges from the symbiosis of quantum mechanics and machine learning. In particular, the latter gets displayed in quantum sciences as: (i) the use of classical machine learning as a tool applied to quantum physics…

Quantum Physics · Physics 2022-02-15 Yue Ban , Javier Echanobe , Erik Torrontegui , Jorge Casanova

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

Machine Learning · Computer Science 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer

Deep models, while being extremely versatile and accurate, are vulnerable to adversarial attacks: slight perturbations that are imperceptible to humans can completely flip the prediction of deep models. Many attack and defense mechanisms…

Machine Learning · Computer Science 2019-07-30 Kaiwen Wu , Yaoliang Yu

Quantum machine learning is a rapidly growing field at the intersection of quantum technology and artificial intelligence. This review provides a two-fold overview of several key approaches that can offer advancements in both the…

Quantum Physics · Physics 2023-03-07 Alexey Melnikov , Mohammad Kordzanganeh , Alexander Alodjants , Ray-Kuang Lee

It is by now well-established that modern over-parameterized models seem to elude the bias-variance tradeoff and generalize well despite overfitting noise. Many recent works attempt to analyze this phenomenon in the relatively tractable…

Machine Learning · Computer Science 2024-02-21 Daniel Barzilai , Ohad Shamir

Adversarial training and data augmentation with noise are widely adopted techniques to enhance the performance of neural networks. This paper investigates adversarial training and data augmentation with noise in the context of regularized…

Machine Learning · Statistics 2023-04-20 Teng Zhang , Kang Li

Transfer learning under limited data is a challenging setting, where models must adapt to new tasks with minimal supervision. Prior work has primarily focused on improving absolute accuracy in transfer learning. However, empirical evidence…

Quantum Physics · Physics 2026-05-12 Li-An Lo , Li-Yi Hsu , Hsien-Yi Hsieh

Adversarial training may be regarded as standard training with a modified loss function. But its generalization error appears much larger than standard training under standard loss. This phenomenon, known as robust overfitting, has…

Machine Learning · Computer Science 2024-02-13 Runzhi Tian , Yongyi Mao

Quantum Machine Learning is where nowadays machine learning meets quantum information science. In order to implement this new paradigm for novel quantum technologies, we still need a much deeper understanding of its underlying mechanisms,…

Quantum Physics · Physics 2021-07-07 Paolo Braccia , Filippo Caruso , Leonardo Banchi

Deep learning models have a propensity for fitting the entire training set even with random labels, which requires memorization of every training sample. In this paper, we explore the memorization effect in adversarial training (AT) for…

Machine Learning · Computer Science 2022-03-15 Yinpeng Dong , Ke Xu , Xiao Yang , Tianyu Pang , Zhijie Deng , Hang Su , Jun Zhu

Agents trained with deep reinforcement learning algorithms are capable of performing highly complex tasks including locomotion in continuous environments. We investigate transferring the learning acquired in one task to a set of previously…

Machine Learning · Computer Science 2024-03-06 Suzan Ece Ada , Emre Ugur , H. Levent Akin

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

Machine Learning · Computer Science 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas

We derive a novel information-theoretic analysis of the generalization property of meta-learning algorithms. Concretely, our analysis proposes a generic understanding of both the conventional learning-to-learn framework and the modern…

Machine Learning · Computer Science 2021-12-13 Qi Chen , Changjian Shui , Mario Marchand