English
Related papers

Related papers: Computing the gradients with respect to all parame…

200 papers

Gradients of neural networks encode valuable information for optimization, editing, and analysis of models. Therefore, practitioners often treat gradients as inputs to task-specific algorithms, e.g. for pruning or optimization. Recent works…

Machine Learning · Computer Science 2025-10-14 Yoav Gelberg , Yam Eitan , Aviv Navon , Aviv Shamsian , Theo , Putterman , Michael Bronstein , Haggai Maron

Gradient descent methods have long been the de facto standard for training deep neural networks. Millions of training samples are fed into models with billions of parameters, which are slowly updated over hundreds of epochs. Recently, it's…

Machine Learning · Computer Science 2023-02-14 Tim Whitaker

Training quantum neural networks (QNNs) using gradient-based or gradient-free classical optimisation approaches is severely impacted by the presence of barren plateaus in the cost landscapes. In this paper, we devise a framework for…

Quantum Physics · Physics 2024-06-04 Yidong Liao , Min-Hsiu Hsieh , Chris Ferrie

Training neural networks requires significant computational resources and energy. Methods like mixed-precision and quantization-aware training reduce bit usage, yet they still depend heavily on computationally expensive gradient-based…

Machine Learning · Computer Science 2025-09-30 Noa Cohen , Omkar Joglekar , Dotan Di Castro , Vladimir Tchuiev , Shir Kozlovsky , Michal Moshkovitz

There is no unique way to encode a quantum algorithm into a quantum circuit. With limited qubit counts, connectivities, and coherence times, circuit optimization is essential to make the best use of near-term quantum devices. We introduce…

Quantum computing is a hotspot technology for its potential to accelerate specific applications by exploiting quantum parallelism. However, current physical quantum computers are limited to a relatively small scale, simulators based on…

Quantum Physics · Physics 2022-11-15 Jingcheng Shen , Linbo Long , Masao Okita , Fumihiko Ino

Quantum Neural Networks (QNNs) with random structures have poor trainability due to the exponentially vanishing gradient as the circuit depth and the qubit number increase. This result leads to a general belief that a deep QNN will not be…

Quantum Physics · Physics 2022-09-28 Kaining Zhang , Min-Hsiu Hsieh , Liu Liu , Dacheng Tao

Quantum sensing is an important application of emerging quantum technologies. We explore whether a hybrid system of quantum sensors and quantum circuits can surpass the classical limit of sensing. In particular, we use optimization…

Many experimental proposals for noisy intermediate scale quantum devices involve training a parameterized quantum circuit with a classical optimization loop. Such hybrid quantum-classical algorithms are popular for applications in quantum…

Quantum Physics · Physics 2019-02-04 Jarrod R. McClean , Sergio Boixo , Vadim N. Smelyanskiy , Ryan Babbush , Hartmut Neven

Recent developments in quantum computing and machine learning have propelled the interdisciplinary study of quantum machine learning. Sequential modeling is an important task with high scientific and commercial value. Existing VQC or…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Samuel Yen-Chi Chen , Daniel Fry , Amol Deshmukh , Vladimir Rastunkov , Charlee Stefanski

Binary neural networks, i.e., neural networks whose parameters and activations are constrained to only two possible values, offer a compelling avenue for the deployment of deep learning models on energy- and memory-limited devices. However,…

We present a quantum circuit optimization technique that takes into account the variability in error rates that is inherent across present day noisy quantum computing platforms. This method can be run post qubit routing or post-compilation,…

Quantum Physics · Physics 2023-03-22 Paul D. Nation , Matthew Treinish

Application-inspired benchmarks measure how well a quantum device performs meaningful calculations. In the case of parameterized circuit training, the computational task is the preparation of a target quantum state via optimization over a…

Emerging Technologies · Computer Science 2019-12-02 Kathleen E. Hamilton , Raphael C. Pooser

Quantum machine learning has established as an interdisciplinary field to overcome limitations of classical machine learning and neural networks. This is a field of research which can prove that quantum computers are able to solve problems…

Quantum Physics · Physics 2023-03-13 Meghashrita Das , Tirupati Bolisetti

In the present noisy intermediate scale quantum computing era, there is a critical need to devise methods for the efficient implementation of gate-based variational quantum circuits. This ensures that a range of proposed applications can be…

Quantum Physics · Physics 2024-08-27 Ankit Kulshrestha , Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Bao Bach , Ilya Safro

In this proceedings we present quantum machine learning optimization experiments using stochastic gradient descent with the parameter shift rule algorithm. We first describe the gradient evaluation algorithm and its optimization procedure…

Quantum Physics · Physics 2022-10-21 Matteo Robbiati , Stavros Efthymiou , Andrea Pasquale , Stefano Carrazza

Quantum machine learning and optimization are exciting new areas that have been brought forward by the breakthrough quantum algorithm of Harrow, Hassidim and Lloyd for solving systems of linear equations. The utility of {classical} linear…

Quantum Physics · Physics 2021-03-02 Iordanis Kerenidis , Anupam Prakash

The gradient descent method aims at finding local minima of a given multivariate function by moving along the direction of its gradient, and hence, the algorithm typically involves computing all partial derivatives of a given function,…

Quantum Physics · Physics 2025-02-25 Nhat A. Nghiem

Variational quantum algorithms are promising tools for near-term quantum computers as their shallow circuits are robust to experimental imperfections. Their practical applicability, however, strongly depends on how many times their circuits…

Quantum Physics · Physics 2021-09-13 Barnaby van Straaten , Bálint Koczor

Memory footprint is one of the main limiting factors for large neural network training. In backpropagation, one needs to store the input to each operation in the computational graph. Every modern neural network model has quite a few…

Machine Learning · Computer Science 2022-02-04 Georgii Novikov , Daniel Bershatsky , Julia Gusak , Alex Shonenkov , Denis Dimitrov , Ivan Oseledets