English
Related papers

Related papers: Generalization despite overfitting in quantum mach…

200 papers

Modern deep learning models with great expressive power can be trained to overfit the training data but still generalize well. This phenomenon is referred to as \textit{benign overfitting}. Recently, a few studies have attempted to…

Machine Learning · Computer Science 2023-11-07 Yiwen Kou , Zixiang Chen , Yuanzhou Chen , Quanquan Gu

In many modern applications of deep learning the neural network has many more parameters than the data points used for its training. Motivated by those practices, a large body of recent theoretical research has been devoted to studying…

Statistics Theory · Mathematics 2022-12-07 A. Tsigler , P. L. Bartlett

Generalization is the ability of machine learning models to make accurate predictions on new data by learning from training data. However, understanding generalization of quantum machine learning models has been a major challenge. Here, we…

Quantum Physics · Physics 2024-08-07 Tobias Haug , M. S. Kim

The ultimate goal in machine learning is to construct a model function that has a generalization capability for unseen dataset, based on given training dataset. If the model function has too much expressibility power, then it may overfit to…

Quantum Physics · Physics 2023-01-24 Masahiro Kobayashi , Kouhei Nakaji , Naoki Yamamoto

The success of over-parameterized neural networks trained to near-zero training error has caused great interest in the phenomenon of benign overfitting, where estimators are statistically consistent even though they interpolate noisy…

Machine Learning · Statistics 2024-11-07 Moritz Haas , David Holzmüller , Ulrike von Luxburg , Ingo Steinwart

Recent empirical and theoretical studies have established the generalization capabilities of large machine learning models that are trained to (approximately or exactly) fit noisy data. In this work, we prove a surprising result that even…

Machine Learning · Computer Science 2024-01-26 Yifan Hao , Tong Zhang

Overfitting describes a machine learning phenomenon where the model fits too closely to the training data, resulting in poor generalization. While this occurrence is thoroughly documented for many forms of supervised learning, it is not…

Machine Learning · Computer Science 2024-08-23 Zachary Rabin , Jim Davis , Benjamin Lewis , Matthew Scherreik

The infrequent occurrence of overfit in deep neural networks is perplexing. On the one hand, theory predicts that as models get larger they should eventually become too specialized for a specific training set, with ensuing decrease in…

Machine Learning · Computer Science 2023-12-29 Uri Stern , Daphna Weinshall

The ability to use quantum technology to achieve useful tasks, be they scientific or industry related, boils down to precise quantum control. In general it is difficult to assess a proposed solution due to the difficulties in characterising…

Quantum Physics · Physics 2020-12-07 Akram Youssry , Gerardo A. Paz-Silva , Christopher Ferrie

Highly over-parameterized models can simultaneously memorize noisy labels and generalize well, yet how these behaviors coexist remains poorly understood. In this work, we investigate the underlying mechanisms of this coexistence using…

Machine Learning · Computer Science 2026-05-19 Linyu Liu , Pinyan Lu

Very large deep learning models trained using gradient descent are remarkably resistant to memorization given their huge capacity, but are at the same time capable of fitting large datasets of pure noise. Here methods are introduced by…

Machine Learning · Computer Science 2022-12-22 Benjamin L. Badger

This paper focuses on over-parameterized deep neural networks (DNNs) with ReLU activation functions and proves that when the data distribution is well-separated, DNNs can achieve Bayes-optimal test error for classification while obtaining…

Machine Learning · Computer Science 2023-06-01 Zhenyu Zhu , Fanghui Liu , Grigorios G Chrysos , Francesco Locatello , Volkan Cevher

Quantum neural networks (QNNs) play a pivotal role in addressing complex tasks within quantum machine learning, analogous to classical neural networks in deep learning. Ensuring consistent performance across diverse datasets is crucial for…

Quantum Physics · Physics 2025-01-28 Chenghong Zhu , Hongshun Yao , Yingjian Liu , Xin Wang

One of the most promising areas of research to obtain practical advantage is Quantum Machine Learning which was born as a result of cross-fertilisation of ideas between Quantum Computing and Classical Machine Learning. In this paper, we…

Quantum Physics · Physics 2021-11-08 N. Schetakis , D. Aghamalyan , M. Boguslavsky , P. Griffin

Quantum machine learning techniques are commonly considered one of the most promising candidates for demonstrating practical quantum advantage. In particular, quantum kernel methods have been demonstrated to be able to learn certain…

We study the overfitting behavior of fully connected deep Neural Networks (NNs) with binary weights fitted to perfectly classify a noisy training set. We consider interpolation using both the smallest NN (having the minimal number of…

Machine Learning · Computer Science 2024-10-28 Itamar Harel , William M. Hoza , Gal Vardi , Itay Evron , Nathan Srebro , Daniel Soudry

Transfer learning is a key component of modern machine learning, enhancing the performance of target tasks by leveraging diverse data sources. Simultaneously, overparameterized models such as the minimum-$\ell_2$-norm interpolator (MNI) in…

Machine Learning · Statistics 2026-01-19 Yeichan Kim , Ilmun Kim , Seyoung Park

State-of-the-art deep learning classifiers are heavily overparameterized with respect to the amount of training examples and observed to generalize well on "clean" data, but be highly susceptible to infinitesmal adversarial perturbations.…

Machine Learning · Computer Science 2021-09-28 Adhyyan Narang , Vidya Muthukumar , Anant Sahai

Meta-learning has arisen as a successful method for improving training performance by training over many similar tasks, especially with deep neural networks (DNNs). However, the theoretical understanding of when and why overparameterized…

Machine Learning · Computer Science 2023-04-11 Peizhong Ju , Yingbin Liang , Ness B. Shroff

Deep neural networks (DNNs) generalize remarkably well without explicit regularization even in the strongly over-parametrized regime where classical learning theory would instead predict that they would severely overfit. While many…

Machine Learning · Statistics 2019-04-23 Guillermo Valle-Pérez , Chico Q. Camargo , Ard A. Louis