中文
相关论文

相关论文: Generalization despite overfitting in quantum mach…

200 篇论文

The use of quantum computing for machine learning is among the most exciting prospective applications of quantum technologies. However, machine learning tasks where data is provided can be considerably different than commonly studied…

We study supervised learning algorithms in which a quantum device is used to perform a computational subroutine - either for prediction via probability estimation, or to compute a kernel via estimation of quantum states overlap. We design…

量子物理 · 物理学 2021-07-07 Ulysse Chabaud , Damian Markham , Adel Sohbi

We study the benign overfitting theory in the prediction of the conditional average treatment effect (CATE), with linear regression models. As the development of machine learning for causal inference, a wide range of large-scale models for…

计量经济学 · 经济学 2022-02-17 Masahiro Kato , Masaaki Imaizumi

The generalization capacity of various machine learning models exhibits different phenomena in the under- and over-parameterized regimes. In this paper, we focus on regression models such as feature regression and kernel regression and…

机器学习 · 计算机科学 2022-03-14 Björn Engquist , Kui Ren , Yunan Yang

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

密码学与安全 · 计算机科学 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

Modern deep learning models employ considerably more parameters than required to fit the training data. Whereas conventional statistical wisdom suggests such models should drastically overfit, in practice these models generalize remarkably…

机器学习 · 统计学 2020-08-18 Ben Adlam , Jeffrey Pennington

Deep Neural Networks miss a principled model of their operation. A novel framework for supervised learning based on Topological Quantum Field Theory that looks particularly well suited for implementation on quantum processors has been…

This paper examines the quantization methods used in large-scale data analysis models and their hyperparameter choices. The recent surge in data analysis scale has significantly increased computational resource requirements. To address…

机器学习 · 统计学 2024-01-31 Shuhei Kashiwamura , Ayaka Sakata , Masaaki Imaizumi

The problem of benign overfitting asks whether it is possible for a model to perfectly fit noisy training data and still generalize well. We study benign overfitting in two-layer leaky ReLU networks trained with the hinge loss on a binary…

机器学习 · 计算机科学 2024-10-04 Kedar Karhadkar , Erin George , Michael Murray , Guido Montúfar , Deanna Needell

Deep neural networks often contain far more parameters than training examples, yet they still manage to generalize well in practice. Classical complexity measures such as VC-dimension or PAC-Bayes bounds usually become vacuous in this…

机器学习 · 计算机科学 2025-08-26 Aviral Dhingra

We present a systematic investigation of deep learning methods applied to quantum error mitigation of noisy output probability distributions from measured quantum circuits. We compare different architectures, from fully connected neural…

Quantum classification and hypothesis testing are two tightly related subjects, the main difference being that the former is data driven: how to assign to quantum states $\rho(x)$ the corresponding class $c$ (or hypothesis) is learnt from…

量子物理 · 物理学 2021-11-30 Leonardo Banchi , Jason Pereira , Stefano Pirandola

In machine learning, overparameterization is associated with qualitative changes in the empirical risk landscape, which can lead to more efficient training dynamics. For many parameterized models used in statistical learning, there exists a…

量子物理 · 物理学 2023-07-11 Andrea Delgado , Francisco Rios , Kathleen E. Hamilton

One of the key obstacles in traditional deep learning is the reduction in model transparency caused by increasingly intricate model functions, which can lead to problems such as overfitting and excessive confidence in predictions. With the…

机器学习 · 计算机科学 2025-07-22 Maximilian Wendlinger , Kilian Tscharke , Pascal Debus

Quantum neural networks represent a new machine learning paradigm that has recently attracted much attention due to its potential promise. Under certain conditions, these models approximate the distribution of their dataset with a truncated…

量子物理 · 物理学 2023-11-02 Mo Kordzanganeh , Daria Kosichkina , Alexey Melnikov

Quantum Machine Learning algorithms based on Variational Quantum Circuits (VQCs) are important candidates for useful application of quantum computing. It is known that a VQC is a linear model in a feature space determined by its…

量子物理 · 物理学 2025-07-09 Slimane Thabet , Léo Monbroussou , Eliott Z. Mamon , Jonas Landman

Machine learning models can inherit hidden behavioral traits through innocuous public interfaces, a phenomenon known as subliminal learning. Here we extend this framework to quantum models and study two distillation pathways: an auxiliary…

量子物理 · 物理学 2026-05-29 Shi-Xin Zhang , Yu-Qin Chen

Quantum machine learning is the field that aims to integrate machine learning with quantum computation. In recent years, the field has emerged as an active research area with the potential to bring new insights to classical machine learning…

量子物理 · 物理学 2023-06-30 Berta Casas , Alba Cervera-Lierta

Overfitting is defined as the fact that the current model fits a specific data set perfectly, resulting in weakened generalization, and ultimately may affect the accuracy in predicting future data. In this research we used an EHR dataset…

机器学习 · 计算机科学 2022-08-04 Chuhan Xu , Pablo Coen-Pirani , Xia Jiang

We derive a tight generalization bound for quantum machine learning that is applicable to a wide range of supervised tasks, data, and models. Our bound is both efficiently computable and free of big-O notation. Furthermore, we point out…

量子物理 · 物理学 2025-10-29 Xin Wang , Rebing Wu