English
Related papers

Related papers: Natural Gradient Optimization for Optical Quantum …

200 papers

Gradient descent method, as one of the major methods in numerical optimization, is the key ingredient in many machine learning algorithms. As one of the most fundamental way to solve the optimization problems, it promises the function value…

Quantum Physics · Physics 2021-02-01 Keren Li , Shijie Wei , Feihao Zhang , Pan Gao , Zengrong Zhou , Tao Xin , Xiaoting Wang , Guilu Long

The natural gradient allows for more efficient gradient descent by removing dependencies and biases inherent in a function's parameterization. Several papers present the topic thoroughly and precisely. It remains a very difficult idea to…

Machine Learning · Computer Science 2012-05-10 Jascha Sohl-Dickstein

Efficient quantum circuit optimization schemes are central to quantum simulation of strongly interacting quantum many body systems. Here, we present an optimization algorithm which combines machine learning techniques and tensor network…

Quantum Physics · Physics 2024-08-23 David Rogerson , Ananda Roy

We consider the Quantum Natural Gradient Descent (QNGD) scheme which was recently proposed to train variational quantum algorithms. QNGD is Steepest Gradient Descent (SGD) operating on the complex projective space equipped with the…

Quantum Physics · Physics 2022-11-02 Touheed Anwar Atif , Uchenna Chukwu , Jesse Berwald , Raouf Dridi

Variational quantum algorithms are promising tools whose efficacy depends on their optimisation method. For noise-free unitary circuits, the quantum generalisation of natural gradient descent has been introduced and shown to be equivalent…

Quantum Physics · Physics 2023-09-12 Bálint Koczor , Simon C. Benjamin

Within the context of hybrid quantum-classical optimization, gradient descent based optimizers typically require the evaluation of expectation values with respect to the outcome of parameterized quantum circuits. In this work, we explore…

We present a first-order method for solving constrained optimization problems. The method is derived from our previous work, a modified search direction method inspired by singular value decomposition. In this work, we simplify its…

Optimization and Control · Mathematics 2023-02-24 Long Chen , Kai-Uwe Bletzinger , Nicolas R. Gauger , Yinyu Ye

We introduce an architecture for variational quantum algorithms that can be efficiently trained via parameter updates along exact geodesics on the Riemannian state manifold. This features a parameter-optimal circuit ansatz which supersedes…

We propose a sequential minimal optimization method for quantum-classical hybrid algorithms, which converges faster, is robust against statistical error, and is hyperparameter-free. Specifically, the optimization problem of the…

Quantum Physics · Physics 2020-11-04 Ken M. Nakanishi , Keisuke Fujii , Synge Todo

In this paper, we propose new structured second-order methods and structured adaptive-gradient methods obtained by performing natural-gradient descent on structured parameter spaces. Natural-gradient descent is an attractive approach to…

Machine Learning · Statistics 2022-02-22 Wu Lin , Frank Nielsen , Mohammad Emtiyaz Khan , Mark Schmidt

Natural Gradient Descent, a second-degree optimization method motivated by the information geometry, makes use of the Fisher Information Matrix instead of the Hessian which is typically used. However, in many cases, the Fisher Information…

Machine Learning · Computer Science 2023-03-10 Rajesh Shrestha

Variational quantum algorithms (VQAs) have recently received significant attention from the research community due to their promising performance in Noisy Intermediate-Scale Quantum computers (NISQ). However, VQAs run on parameterized…

Quantum Physics · Physics 2022-05-06 Zeyi Tao , Jindi Wu , Qi Xia , Qun Li

Quantum machine learning and optimization are exciting new areas that have been brought forward by the breakthrough quantum algorithm of Harrow, Hassidim and Lloyd for solving systems of linear equations. The utility of {classical} linear…

Quantum Physics · Physics 2021-03-02 Iordanis Kerenidis , Anupam Prakash

This work shows that minimizing the depth of a quantum circuit composed of commuting operations reduces to a vertex coloring problem on an appropriately constructed graph, where gates correspond to vertices and edges encode…

Quantum Physics · Physics 2026-02-11 Hochang Lee , Kyung Chul Jeong , Panjin Kim

Scaling of variational quantum algorithms to large problem sizes requires efficient optimization of random parameterized quantum circuits. For such circuits with uncorrelated parameters, the presence of exponentially vanishing gradients in…

Quantum Physics · Physics 2021-01-28 Tyler Volkoff , Patrick J. Coles

Recent studies have shown that fractional calculus is an effective alternative mathematical tool in various scientific fields. However, some investigations indicate that results established in differential and integral calculus do not…

Optimization and Control · Mathematics 2026-03-09 Higor V. M. Ferreira , Camila A. Tavares , Nelson H. T. Lemes , José P. C. dos Santos

Any gradient descent optimization requires to choose a learning rate. With deeper and deeper models, tuning that learning rate can easily become tedious and does not necessarily lead to an ideal convergence. We propose a variation of the…

Machine Learning · Statistics 2018-04-10 Mathieu Ravaut , Satya Gorti

We introduce a quantum-inspired algorithm for graph coloring problems (GCPs) that utilizes qudits in a product state, with each qudit representing a node in the graph and parameterized by d-dimensional spherical coordinates. We propose and…

Quantum Physics · Physics 2024-12-17 David Jansen , Timothy Heightman , Luke Mortimer , Ignacio Perito , Antonio Acín

Parameterized quantum circuits (PQCs) are a central component of many variational quantum algorithms, yet there is a lack of understanding of how their parameterization impacts algorithm performance. We initiate this discussion by using…

Quantum Physics · Physics 2022-08-24 Amara Katabarwa , Sukin Sim , Dax Enshan Koh , Pierre-Luc Dallaire-Demers

Optimization problems occurring in a wide variety of physical design problems, including but not limited to optical engineering, quantum control, structural engineering, involve minimization of a simple cost function of the state of the…

Optimization and Control · Mathematics 2021-11-05 Rahul Trivedi