中文
相关论文

相关论文: Random-Matrix-Induced Simplicity Bias in Over-para…

200 篇论文

We present a hybrid quantum-classical framework for simulating generic matrix functions more amenable to early fault-tolerant quantum hardware than standard quantum singular-value transformations. The method is based on randomization over…

量子物理 · 物理学 2024-11-28 Allan Tosta , Thais de Lima Silva , Giancarlo Camilo , Leandro Aolita

Modern deep neural networks are highly over-parameterized compared to the data on which they are trained, yet they often generalize remarkably well. A flurry of recent work has asked: why do deep networks not overfit to their training data?…

机器学习 · 计算机科学 2023-03-24 Minyoung Huh , Hossein Mobahi , Richard Zhang , Brian Cheung , Pulkit Agrawal , Phillip Isola

Recently, there is interest in coincident 'sharpening' and 'learnability' transitions in monitored quantum systems. In the latter, an outside observer's ability to infer properties of a quantum system from measurements undergoes a phase…

统计力学 · 物理学 2025-04-15 Sun Woo P. Kim , Curt von Keyserlingk , Austen Lamacraft

Variational quantum circuits (VQCs) have shown great potential in near-term applications. However, the discriminative power of a VQC, in connection to its circuit architecture and depth, is not understood. To unleash the genuine…

量子物理 · 物理学 2021-07-19 Bingzhi Zhang , Quntao Zhuang

We present a set of methods to generate less complex error channels by quantum circuit parallelisation. The resulting errors are simplified as a consequence of their symmetrisation and randomisation. Initially, the case of a single error…

量子物理 · 物理学 2023-05-26 James Mills , Debasis Sadhukhan , Elham Kashefi

Parameterized quantum circuits (PQCs) have emerged as a foundational element in the development and applications of quantum algorithms. However, when initialized with random parameter values, PQCs often exhibit barren plateaus (BP). These…

量子物理 · 物理学 2025-07-02 Muhammad Kashif , Muhammad Rashid , Saif Al-Kuwari , Muhammad Shafique

Inspired by the possibility that generative models based on quantum circuits can provide a useful inductive bias for sequence modeling tasks, we propose an efficient training algorithm for a subset of classically simulable quantum circuit…

量子物理 · 物理学 2020-02-19 James Stokes , John Terilla

Modern deep learning models generalize remarkably well in-distribution, despite being overparametrized and trained with little to no explicit regularization. Instead, current theory credits implicit regularization imposed by the choice of…

机器学习 · 计算机科学 2026-03-17 Jonathan Wenger , Beau Coker , Juraj Marusic , John P. Cunningham

Neural networks (NNs) are known to exhibit simplicity bias where they tend to prefer learning 'simple' features over more 'complex' ones, even when the latter may be more informative. Simplicity bias can lead to the model making biased…

机器学习 · 计算机科学 2023-10-11 Bhavya Vasudeva , Kameron Shahabi , Vatsal Sharan

Generalization is a central concept in machine learning theory, yet for quantum models, it is predominantly analyzed through uniform bounds that depend on a model's overall capacity rather than the specific function learned. These…

Near-term quantum devices generally suffer from shallow circuit depth and hence limited expressivity due to noise and decoherence. To address this, we propose tensor-network-assisted parametrized quantum circuits, which concatenate a…

量子物理 · 物理学 2023-12-01 Junxiang Huang , Wenhao He , Yukun Zhang , Yusen Wu , Bujiao Wu , Xiao Yuan

We consider the hardness of computing additive approximations to output probabilities of random quantum circuits. We consider three random circuit families, namely, Haar random, $p=1$ QAOA, and random IQP circuits. Our results are as…

量子物理 · 物理学 2022-06-14 Hari Krovi

We study the ability of foundation models to learn representations for classification that are transferable to new, unseen classes. Recent results in the literature show that representations learned by a single classifier over many classes…

机器学习 · 计算机科学 2023-07-18 Tomer Galanti , András György , Marcus Hutter

Deep neural networks generalize well despite being heavily overparameterized, in apparent contradiction with classical learning theory based on uniform convergence over fixed hypothesis spaces. Uniform bounds over the entire parameter space…

机器学习 · 统计学 2026-05-15 Hubert Leroux , Jean Marcus , Julien Roger

Quantum machine learning models based on parametrized quantum circuits, also called quantum neural networks (QNNs), are considered to be among the most promising candidates for applications on near-term quantum devices. Here we explore the…

量子物理 · 物理学 2024-07-08 Chris Mingard , Jessica Pointing , Charles London , Yoonsoo Nam , Ard A. Louis

Recent studies have noted an intriguing phenomenon termed Neural Collapse, that is, when the neural networks establish the right correlation between feature spaces and the training targets, their last-layer features, together with the…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Yining Wang , Junjie Sun , Chenyue Wang , Mi Zhang , Min Yang

We analyse the entanglement structure of states generated by random constant-depth two-dimensional quantum circuits, followed by projective measurements of a subset of sites. By deriving a rigorous lower bound on the average entanglement…

量子物理 · 物理学 2025-05-21 Max McGinley , Wen Wei Ho , Daniel Malz

We introduce a new class of large structured random matrices characterized by four fundamental properties which we discuss. We prove that this class is stable under matrix-valued and pointwise non-linear operations. We then formulate an…

概率论 · 数学 2025-06-09 Denis Bernard , Ludwig Hruza

The overparameterization of variational quantum circuits, as a model of Quantum Neural Networks (QNN), not only improves their trainability but also serves as a method for evaluating the property of a given ansatz by investigating their…

量子物理 · 物理学 2023-05-23 Ali Rad

Generalization beyond a training dataset is a main goal of machine learning, but theoretical understanding of generalization remains an open problem for many models. The need for a new theory is exacerbated by recent observations in deep…

机器学习 · 统计学 2022-02-08 Abdulkadir Canatar , Blake Bordelon , Cengiz Pehlevan