English
Related papers

Related papers: Local Stochastic Factored Gradient Descent for Dis…

200 papers

Quantum state tomography (QST) aiming at reconstructing the density matrix of a quantum state plays an important role in various emerging quantum technologies. Recognizing the challenges posed by imperfect measurement data, we develop a…

Quantum Physics · Physics 2025-03-31 Hailan Ma , Daoyi Dong , Ian R. Petersen , Chang-Jiang Huang , Guo-Yong Xiang

We propose LQ-SGD (Low-Rank Quantized Stochastic Gradient Descent), an efficient communication gradient compression algorithm designed for distributed training. LQ-SGD further develops on the basis of PowerSGD by incorporating the low-rank…

Machine Learning · Computer Science 2025-06-24 Hongyang Li , Lincen Bai , Caesar Wu , Mohammed Chadli , Said Mammar , Pascal Bouvry

Stochastic Gradient Descent (SGD) and its variants underpin modern machine learning by enabling efficient optimization of large-scale models. However, their local search nature limits exploration in complex landscapes. In this paper, we…

Quantum Physics · Physics 2025-07-22 Sirui Peng , Shengminjie Chen , Xiaoming Sun , Hongyi Zhou

We introduce the concept of selective quantum state tomography or SQST, a tomographic scheme that enables a user to estimate arbitrary elements of an unknown quantum state using a fixed measurement record. We demonstrate how this may be…

Quantum Physics · Physics 2020-06-12 Joshua Morris , Borivoje Dakić

Variational quantum algorithms, optimized using gradient-based methods, often exhibit sub-optimal convergence performance due to their dependence on Euclidean geometry. Quantum natural gradient descent (QNGD) is a more efficient method that…

Quantum Physics · Physics 2025-06-05 Mohammad Aamir Sohail , Mohsen Heidari , S. Sandeep Pradhan

Stochastic gradient descent (SGD) is a fundamental optimization algorithm widely used in modern machine learning. In this paper, we propose Factor-Augmented SGD (FSGD), a new optimization method that leverages latent factor representations…

Machine Learning · Statistics 2026-05-20 Shubo Li , Yuefeng Han , Xiufan Yu

Quantum state tomography (QST) is a fundamental task in quantum information science that aims to reconstruct unknown quantum states from measurement data. However, the exponential growth of Hilbert-space dimension with system size makes…

Quantum Physics · Physics 2026-05-27 Zhen Qin , Michael B. Wakin , Zhihui Zhu

Stochastic distributed optimization methods that solve an optimization problem over a multi-agent network have played an important role in a variety of large-scale signal processing and machine leaning applications. Among the existing…

Optimization and Control · Mathematics 2023-02-06 Songyang Ge , Tsung-Hui Chang

We study the minimization of a convex function $f(X)$ over the set of $n\times n$ positive semi-definite matrices, but when the problem is recast as $\min_U g(U) := f(UU^\top)$, with $U \in \mathbb{R}^{n \times r}$ and $r \leq n$. We study…

Machine Learning · Statistics 2016-04-19 Srinadh Bhojanapalli , Anastasios Kyrillidis , Sujay Sanghavi

Machine learning techniques have opened new avenues for real-time quantum state tomography (QST). In this work, we demonstrate the deployment of machine learning-based QST onto edge devices, specifically utilizing field programmable gate…

Quantum state tomography (QST) is the process of reconstructing the state of a quantum system (mathematically described as a density matrix) through a series of different measurements, which can be solved by learning a parameterized…

Quantum Physics · Physics 2025-03-31 Hailan Ma , Zhenhong Sun , Daoyi Dong , Chunlin Chen , Herschel Rabitz

We propose a Stochastic Gradient Descent (SGD)-type algorithm for Personalized Federated Learning which can be particularly attractive for mobile energy-limited regimes due to its low per-client computational cost. The model to be trained…

Machine Learning · Computer Science 2025-12-15 Sotirios Nikoloutsopoulos , Iordanis Koutsopoulos , Michalis K. Titsias

Quantum state tomography, which aims to find the best description of a quantum state -- the density matrix, is an essential building block in quantum computation and communication. Standard techniques for state tomography are incapable of…

Quantum Physics · Physics 2022-11-18 Markus Rambach , Akram Youssry , Marco Tomamichel , Jacquiline Romero

This paper studies distributed nonconvex optimization problems with stochastic gradients for a multi-agent system, in which each agent aims to minimize the sum of all agents' cost functions by using local compressed information exchange. We…

Optimization and Control · Mathematics 2024-03-05 Antai Xie , Xinlei Yi , Xiaofan Wang , Ming Cao , Xiaoqiang Ren

We propose a novel algorithm for distributed stochastic gradient descent (SGD) with compressed gradient communication in the parameter-server framework. Our gradient compression technique, named flattened one-bit stochastic gradient descent…

Machine Learning · Computer Science 2024-05-21 Alexander Stollenwerk , Laurent Jacques

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

Machine Learning · Statistics 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

The article discusses distributed gradient-descent algorithms for computing local and global minima in nonconvex optimization. For local optimization, we focus on distributed stochastic gradient descent (D-SGD)--a simple network-based…

Optimization and Control · Mathematics 2020-09-17 Brian Swenson , Soummya Kar , H. Vincent Poor , José M. F. Moura , Aaron Jaech

Quantum state tomography (QST) is a challenging task in intermediate-scale quantum devices. Here, we apply conditional generative adversarial networks (CGANs) to QST. In the CGAN framework, two duelling neural networks, a generator and a…

Quantum Physics · Physics 2021-10-04 Shahnawaz Ahmed , Carlos Sánchez Muñoz , Franco Nori , Anton Frisk Kockum

Loss functions with non-isolated minima have emerged in several machine learning problems, creating a gap between theory and practice. In this paper, we formulate a new type of local convexity condition that is suitable to describe the…

Machine Learning · Computer Science 2022-05-31 Taehee Ko , Xiantao Li

Stochastic gradient descent (SGD) has been a go-to algorithm for nonconvex stochastic optimization problems arising in machine learning. Its theory however often requires a strong framework to guarantee convergence properties. We hereby…

Optimization and Control · Mathematics 2025-03-11 Azar Louzi