English
Related papers

Related papers: Natural Gradient Optimization for Optical Quantum …

200 papers

In this proceedings we present quantum machine learning optimization experiments using stochastic gradient descent with the parameter shift rule algorithm. We first describe the gradient evaluation algorithm and its optimization procedure…

Quantum Physics · Physics 2022-10-21 Matteo Robbiati , Stavros Efthymiou , Andrea Pasquale , Stefano Carrazza

The optimization of physical parameters serves various purposes, such as system identification and efficiency in developing devices. Spin-torque oscillators have been applied to neuromorphic computing experimentally and theoretically, but…

Mesoscale and Nanoscale Physics · Physics 2024-09-17 Yusuke Imai , Shuhong Liu , Nozomi Akashi , Kohei Nakajima

Natural gradient methods have been used to optimise the parameters of probability distributions in a variety of settings, often resulting in fast-converging procedures. Unfortunately, for many distributions of interest, computing the…

Machine Learning · Statistics 2024-05-28 Jonathan So , Richard E. Turner

We consider a generic framework of optimization algorithms based on gradient descent. We develop a quantum algorithm that computes the gradient of a multi-variate real-valued function $f:\mathbb{R}^d\rightarrow \mathbb{R}$ by evaluating it…

Quantum Physics · Physics 2019-02-19 András Gilyén , Srinivasan Arunachalam , Nathan Wiebe

In this paper we propose several adaptive gradient methods for stochastic optimization. Unlike AdaGrad-type of methods, our algorithms are based on Armijo-type line search and they simultaneously adapt to the unknown Lipschitz constant of…

Many machine learning problems can be expressed as the optimization of some cost functional over a parametric family of probability distributions. It is often beneficial to solve such optimization problems using natural gradient methods.…

Machine Learning · Statistics 2020-02-14 Michael Arbel , Arthur Gretton , Wuchen Li , Guido Montufar

We propose a gradient descent method for solving optimization problems arising in settings of tropical geometry - a variant of algebraic geometry that has attracted growing interest in applications such as computational biology, economics,…

Optimization and Control · Mathematics 2025-11-17 Roan Talbut , Anthea Monod

The Variational Quantum Eigensolver (VQE) is one of the most promising algorithms for current quantum devices. It employs a classical optimizer to iteratively update the parameters of a variational quantum circuit in order to search for the…

Quantum Physics · Physics 2025-11-19 Chenyu Shi , Hao Wang

This paper bridges optimization and control, and presents a novel closed-loop control framework based on natural gradient descent, offering a trajectory-oriented alternative to traditional cost-function tuning. By leveraging the Fisher…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Ramin Esmzad , Farnaz Adib Yaghmaie , Hamidreza Modares

We propose a new gradient descent algorithm with added stochastic terms for finding the global optimizers of nonconvex optimization problems. A key component in the algorithm is the adaptive tuning of the randomness based on the value of…

Optimization and Control · Mathematics 2025-06-16 Björn Engquist , Kui Ren , Yunan Yang

We develop and implement automated methods for optimizing quantum circuits of the size and type expected in quantum computations that outperform classical computers. We show how to handle continuous gate parameters and report a collection…

Quantum Physics · Physics 2018-06-04 Yunseong Nam , Neil J. Ross , Yuan Su , Andrew M. Childs , Dmitri Maslov

Variational quantum algorithms use non-convex optimization methods to find the optimal parameters for a parametrized quantum circuit in order to solve a computational problem. The choice of the circuit ansatz, which consists of…

Quantum Physics · Physics 2024-03-13 Roeland Wiersema , Dylan Lewis , David Wierichs , Juan Carrasquilla , Nathan Killoran

Accelerating the convergence of second-order optimization, particularly Newton-type methods, remains a pivotal challenge in algorithmic research. In this paper, we extend previous work on the \textbf{Quadratic Gradient (QG)} and rigorously…

Optimization and Control · Mathematics 2026-04-01 John Chiang

We study the first-order convex optimization problem, where we have black-box access to a (not necessarily smooth) function $f:\mathbb{R}^n \to \mathbb{R}$ and its (sub)gradient. Our goal is to find an $\epsilon$-approximate minimum of $f$…

Data Structures and Algorithms · Computer Science 2020-10-06 Ankit Garg , Robin Kothari , Praneeth Netrapalli , Suhail Sherif

Accurate quantum tomography is a vital tool in both fundamental and applied quantum science. It is a task that involves processing a noisy measurement record in order to construct a reliable estimate of an unknown quantum state, and is…

Quantum Physics · Physics 2017-01-02 Eliot Bolduc , George Knee , Erik Gauger , Jonathan Leach

Variational quantum algorithms (VQAs) represent a promising approach to utilizing current quantum computing infrastructures. VQAs are based on a parameterized quantum circuit optimized in a closed loop via a classical algorithm. This hybrid…

Quantum Physics · Physics 2024-04-10 David Fitzek , Robert S. Jonsson , Werner Dobrautz , Christian Schäfer

In the context of over-parameterization, there is a line of work demonstrating that randomly initialized (stochastic) gradient descent (GD) converges to a globally optimal solution at a linear convergence rate for the quadratic loss…

Machine Learning · Computer Science 2025-06-16 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

Quantum machine learning aims to release the prowess of quantum computing to improve machine learning methods. By combining quantum computing methods with classical neural network techniques we aim to foster an increase of performance in…

High Energy Physics - Phenomenology · Physics 2021-03-17 Andrew Blance , Michael Spannowsky

Variational quantum algorithms are ubiquitous in applications of noisy intermediate-scale quantum computers. Due to the structure of conventional parametrized quantum gates, the evaluated functions typically are finite Fourier series of the…

Quantum Physics · Physics 2022-04-20 David Wierichs , Josh Izaac , Cody Wang , Cedric Yen-Yu Lin

In this paper, we consider continuous-time stochastic optimal control problems where the cost is evaluated through a coherent risk measure. We provide an explicit gradient descent-ascent algorithm which applies to problems subject to…

Optimization and Control · Mathematics 2023-06-23 Gabriel Velho , Jean Auriol , Riccardo Bonalli