English
Related papers

Related papers: Avoiding local minima in variational quantum eigen…

200 papers

Most popular optimizers for deep learning can be broadly categorized as adaptive methods (e.g. Adam) and accelerated schemes (e.g. stochastic gradient descent (SGD) with momentum). For many models such as convolutional neural networks…

Machine Learning · Computer Science 2020-12-22 Juntang Zhuang , Tommy Tang , Yifan Ding , Sekhar Tatikonda , Nicha Dvornek , Xenophon Papademetris , James S. Duncan

Gradient-based optimization drives the unprecedented performance of modern deep neural network models across diverse applications. Adaptive algorithms have accelerated neural network training due to their rapid convergence rates; however,…

Machine Learning · Computer Science 2025-05-06 Chia-Wei Hsu , Nien-Ti Tsou , Yu-Cheng Chen , Yang Jeong Park , Ju Li

Transformers are difficult to optimize with stochastic gradient descent (SGD) and largely rely on adaptive optimizers such as Adam. Despite their empirical success, the reasons behind Adam's superior performance over SGD remain poorly…

Machine Learning · Computer Science 2026-02-19 Akiyoshi Tomihari , Issei Sato

The intractability of deterministic solutions in solving $\mathcal{NP}$-Hard Combinatorial Optimisation Problems (COP) is well reported in the literature. One mechanism for overcoming this difficulty has been the use of efficient COP…

Quantum Physics · Physics 2022-04-25 Maxine T. Khumalo , Hazel A. Chieza , Krupa Prag , Matthew Woolway

We present a hybrid classical-quantum algorithm to solve optimization problems in current quantum computers, whose basic idea is to assist variational quantum eigensolvers (VQE) with adiabatic change of the Hamiltonian. The rational for…

Quantum Physics · Physics 2018-06-07 A. Garcia-Saez , J. I. Latorre

Adaptive gradient algorithms perform gradient-based updates using the history of gradients and are ubiquitous in training deep neural networks. While adaptive gradient methods theory is well understood for minimization problems, the…

Optimization and Control · Mathematics 2020-12-29 Mingrui Liu , Youssef Mroueh , Jerret Ross , Wei Zhang , Xiaodong Cui , Payel Das , Tianbao Yang

The study of convex optimization has historically been concerned with worst-case convergence rates. The development of the Optimized Gradient Method (OGM), due to \citet{drori2012PerformanceOF,Kim2016optimal}, marked a major milestone in…

Optimization and Control · Mathematics 2026-04-21 Benjamin Grimmer , Kevin Shu , Alex L. Wang

We propose a quantum algorithm, inspired by ADAPT-VQE, to variationally prepare the ground state of a quantum Hamiltonian, with the desirable property that if it fails to find the ground state, it still yields a physically meaningful…

Quantum Physics · Physics 2025-05-16 Shuchen Zhu , Yu Tong

Quantum computing is an emerging topic in engineering that promises to enhance supercomputing using fundamental physics. In the near term, the best candidate algorithms for achieving this advantage are variational quantum algorithms (VQAs).…

Variational quantum algorithms are proposed to solve relevant computational problems on near term quantum devices. Popular versions are variational quantum eigensolvers and quantum ap- proximate optimization algorithms that solve ground…

Quantum Physics · Physics 2022-04-15 Lennart Bittel , Martin Kliesch

Variational Hybrid Quantum Classical Algorithms (VHQCAs) are a class of quantum algorithms intended to run on noisy intermediate-scale quantum (NISQ) devices. These algorithms employ a parameterized quantum circuit (ansatz) and a…

Quantum Physics · Physics 2021-06-17 Aidan Pellow-Jarman , Ilya Sinayskiy , Anban Pillay , Francesco Petruccione

Variational Physics-Informed Neural Networks often suffer from poor convergence when using stochastic gradient-descent-based optimizers. By introducing a Least Squares solver for the weights of the last layer of the neural network, we…

Numerical Analysis · Mathematics 2025-03-20 Carlos Uriarte , Manuela Bastidas , David Pardo , Jamie M. Taylor , Sergio Rojas

We introduce ANASTAARS, a noise-aware scalable classical optimizer for variational quantum algorithms such as the quantum approximate optimization algorithm (QAOA). ANASTAARS leverages adaptive random subspace strategies to efficiently…

Quantum Physics · Physics 2025-12-03 Kwassi Joseph Dzahini , Jeffrey M. Larson , Matt Menickelly , Stefan M. Wild

VQA have attracted a lot of attention from the quantum computing community for the last few years. Their hybrid quantum-classical nature with relatively shallow quantum circuits makes them a promising platform for demonstrating the…

Variational quantum eigensolvers (VQEs) are among the most promising quantum algorithms for solving electronic structure problems in quantum chemistry, particularly during the Noisy Intermediate-Scale Quantum (NISQ) era. In this study, we…

Quantum Physics · Physics 2026-05-07 Abel Carreras , David Casanova , Román Orús

Quantum computers are expected to be highly beneficial for chemistry simulations, promising significant improvements in accuracy and speed. The most prominent algorithm for chemistry simulations on NISQ devices is the Variational Quantum…

Quantum Physics · Physics 2022-09-27 Marita Oliv , Andrea Matic , Thomas Messerer , Jeanette Miriam Lorenz

Quantum variational algorithms (QVAs) are increasingly potent tools for simulating quantum many-body systems on noisy intermediate-scale quantum (NISQ) devices. This work examines the application of the Variational Quantum Eigensolver (VQE)…

Nuclear Theory · Physics 2026-01-28 Dhritimalya Roy , Somnath Nag

We study adaptive methods for differentially private convex optimization, proposing and analyzing differentially private variants of a Stochastic Gradient Descent (SGD) algorithm with adaptive stepsizes, as well as the AdaGrad algorithm. We…

Machine Learning · Computer Science 2021-06-28 Hilal Asi , John Duchi , Alireza Fallah , Omid Javidbakht , Kunal Talwar

Analog models of quantum information processing, such as adiabatic quantum computation and analog quantum simulation, require the ability to subject a system to precisely specified Hamiltonians. Unfortunately, the hardware used to implement…

Quantum Physics · Physics 2014-02-25 Kevin C. Young , Robin Blume-Kohout , Daniel A. Lidar

This article introduces a novel family of optimization algorithms - Anisotropic Gaussian Smoothing Gradient Descent (AGS-GD), AGS-Stochastic Gradient Descent (AGS-SGD), and AGS-Adam - that employ anisotropic Gaussian smoothing to enhance…

Optimization and Control · Mathematics 2024-11-19 Andrew Starnes , Guannan Zhang , Viktor Reshniak , Clayton Webster