English
Related papers

Related papers: Analyzing the barren plateau phenomenon in trainin…

200 papers

The exploding and vanishing gradient problem has been the major conceptual principle behind most architecture and training improvements in recurrent neural networks (RNNs) during the last decade. In this paper, we argue that this principle,…

Machine Learning · Computer Science 2020-03-06 Antônio H. Ribeiro , Koen Tiels , Luis A. Aguirre , Thomas B. Schön

Ground state preparation is classically intractable for general Hamiltonians. On quantum devices, shallow parameterized circuits can be effectively trained to obtain short-range entangled states under the paradigm of variational quantum…

Quantum Physics · Physics 2024-04-11 Hao-Kai Zhang , Shuo Liu , Shi-Xin Zhang

The optimization of quantum circuits can be hampered by a decay of average gradient amplitudes with increasing system size. When the decay is exponential, this is called the barren plateau problem. Considering explicit circuit…

Quantum Physics · Physics 2024-09-12 Qiang Miao , Thomas Barthel

Instantaneous quantum polynomial quantum circuit Born machines (IQP-QCBMs) have been proposed as quantum generative models with a classically tractable training objective based on the maximum mean discrepancy (MMD) and a potential quantum…

Quantum Physics · Physics 2026-02-16 Kevin Shen , Susanne Pielawa , Vedran Dunjko , Hao Wang

Solving linear systems of equations is essential for many problems in science and technology, including problems in machine learning. Existing quantum algorithms have demonstrated the potential for large speedups, but the required quantum…

Quantum Physics · Physics 2019-12-17 Hsin-Yuan Huang , Kishor Bharti , Patrick Rebentrost

The barren plateau phenomenon, in which cost-function gradients of variational quantum algorithms vanish exponentially, remains a central obstacle for near-term quantum computing. Existing analyses typically depend on t-design or…

Quantum Physics · Physics 2026-05-19 Tomohiro Nishiyama , Yoshihiko Hasegawa

Variational quantum circuits for image classification suffer from barren plateaus, while quantum kernel methods scale quadratically with dataset size. We propose an iterative framework based on Quadratic Unconstrained Binary Optimization…

Quantum Physics · Physics 2026-03-04 Mostafa Atallah , Rebekah Herrman

Quantum architecture search (QAS) involves optimizing both the quantum parametric circuit configuration but also its parameters for a variational quantum algorithm. Thus, the problem is known to be multi-level as the performance of a given…

Quantum Physics · Physics 2024-07-30 Vicente P. Soloviev , Vedran Dunjko , Concha Bielza , Pedro Larrañaga , Hao Wang

Parameterized quantum circuits can be used as quantum neural networks and have the potential to outperform their classical counterparts when trained for addressing learning problems. To date, much of the results on their performance on…

Quantum Physics · Physics 2023-04-13 Junyu Liu , Khadijeh Najafi , Kunal Sharma , Francesco Tacchino , Liang Jiang , Antonio Mezzacapo

Barren plateaus (BPs) are usually described by the exponential suppression of gradient variance, but the mechanism by which gradient signal disappears remains unclear. We show that this phenomenon can be understood as destructive…

Quantum Physics · Physics 2026-05-05 Pilsung Kang

This paper presents an easy-to-implement approach to mitigate the challenges posed by barren plateaus (BPs) in randomly initialized parameterized quantum circuits (PQCs) within variational quantum algorithms (VQAs). Recent state-of-the-art…

Quantum Physics · Physics 2024-12-10 Muhammad Kashif , Muhammad Shafique

Neural network-based algorithms have garnered considerable attention in condensed matter physics for their ability to learn complex patterns from very high dimensional data sets towards classifying complex long-range patterns of…

Quantum Physics · Physics 2021-01-01 Ian MacCormack , Conor Delaney , Alexey Galda , Nidhi Aggarwal , Prineha Narang

It has been shown that gradient descent can yield the zero training loss in the over-parametrized regime (the width of the neural networks is much larger than the number of data points). In this work, combining the ideas of some existing…

Optimization and Control · Mathematics 2019-11-05 Lei Li

The classification of quantum states into distinct classes poses a significant challenge. In this study, we address this problem using quantum neural networks in combination with a problem-inspired circuit and customised as well as…

Quantum Physics · Physics 2025-04-10 Diksha Sharma , Vivek Balasaheb Sabale , Thirumalai M. , Atul Kumar

Optimisation via parameterised quantum circuits is the prevalent technique of near-term quantum algorithms. However, the omnipresent phenomenon of barren plateaus - parameter regions with vanishing gradients - sets a persistent hurdle that…

Quantum Physics · Physics 2026-04-20 Lennart Binkowski , Gereon Koßmann , Tobias J. Osborne , René Schwonnek , Timo Ziegler

Quantum kernel method is one of the key approaches to quantum machine learning, which has the advantages that it does not require optimization and has theoretical simplicity. By virtue of these properties, several experimental…

Quantum Physics · Physics 2022-11-28 Norihito Shirai , Kenji Kubo , Kosuke Mitarai , Keisuke Fujii

We study the spin quantum Hall effect and transitions between Hall plateaus in quasi two-dimensional network models consisting of several coupled layers. Systems exhibiting the spin quantum Hall effect belong to class C in the symmetry…

Disordered Systems and Neural Networks · Physics 2015-03-18 J. T. Chalker , M. Ortuño , A. M. Somoza

The entanglement-induced barren plateau is an exponential vanishing of the parameter gradients with system size that limits the practical application of variational quantum algorithms(VQA). A landscape transition from barren plateau to…

Quantum Physics · Physics 2024-10-30 Gaurav Gyawali , Sonny Rappaport , Tiago Sereno , Michael J. Lawler

There are two widely known issues with properly training Recurrent Neural Networks, the vanishing and the exploding gradient problems detailed in Bengio et al. (1994). In this paper we attempt to improve the understanding of the underlying…

Machine Learning · Computer Science 2013-02-19 Razvan Pascanu , Tomas Mikolov , Yoshua Bengio

This paper revisits the so-called vanishing gradient phenomenon, which commonly occurs in deep randomly initialized neural networks. Leveraging an in-depth analysis of neural chains, we first show that vanishing gradients cannot be…

Machine Learning · Computer Science 2021-06-08 Antonio Orvieto , Jonas Kohler , Dario Pavllo , Thomas Hofmann , Aurelien Lucchi