English
Related papers

Related papers: Warm-Start Variational Quantum Policy Iteration

200 papers

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

Machine Learning · Computer Science 2019-05-16 Narendra Patwardhan , Zequn Wang

First-order methods are widely used to solve convex quadratic programs (QPs) in real-time applications because of their low per-iteration cost. However, they can suffer from slow convergence to accurate solutions. In this paper, we present…

Optimization and Control · Mathematics 2022-12-19 Rajiv Sambharya , Georgina Hall , Brandon Amos , Bartolomeo Stellato

The performance of quantum simulations heavily depends on the efficiency of noise mitigation techniques and error correction algorithms. Reinforcement has emerged as a powerful strategy to enhance the efficiency of learning and optimization…

Quantum Physics · Physics 2025-12-03 Abolfazl Ramezanpour

We present an approach, which we term quantum-enhanced optimization, to accelerate classical optimization algorithms by leveraging quantum sampling. Our method uses quantum-generated samples as warm starts to classical heuristics for…

Quantum Physics · Physics 2025-08-25 Ieva Čepaitė , Niam Vaishnav , Leo Zhou , Ashley Montanaro

As humans, our goals and our environment are persistently changing throughout our lifetime based on our experiences, actions, and internal and external drives. In contrast, typical reinforcement learning problem set-ups consider decision…

Machine Learning · Computer Science 2020-06-19 Annie Xie , James Harrison , Chelsea Finn

Variational hybrid quantum-classical algorithms are some of the most promising workloads for near-term quantum computers without error correction. The aim of these variational algorithms is to guide the quantum system to a target state that…

Quantum Physics · Physics 2021-03-18 Shavindra P. Premaratne , A. Y. Matsuura

While Reinforcement Learning for Verifiable Rewards (RLVR) is powerful for training large reasoning models, its training dynamics harbor a critical challenge: RL overfitting, where models gain training rewards but lose generalization. Our…

Artificial Intelligence · Computer Science 2025-11-07 Zeng Zhiyuan , Jiashuo Liu , Zhangyue Yin , Ge Zhang , Wenhao Huang , Xipeng Qiu

Classical value iteration approaches are not applicable to environments with continuous states and actions. For such environments, the states and actions are usually discretized, which leads to an exponential increase in computational…

Machine Learning · Computer Science 2021-05-12 Michael Lutter , Shie Mannor , Jan Peters , Dieter Fox , Animesh Garg

The full optimization of a quantum heat engine requires operating at high power, high efficiency, and high stability (i.e. low power fluctuations). However, these three objectives cannot be simultaneously optimized - as indicated by the…

Quantum Physics · Physics 2023-05-04 Paolo Andrea Erdman , Alberto Rolandi , Paolo Abiuso , Martí Perarnau-Llobet , Frank Noé

Variational quantum algorithm (VQA), which is comprised of a classical optimizer and a parameterized quantum circuit, emerges as one of the most promising approaches for harvesting the power of quantum computers in the noisy intermediate…

Quantum Physics · Physics 2021-12-01 Samuel Stein , Yufei Ding , Nathan Wiebe , Bo Peng , Karol Kowalski , Nathan Baker , James Ang , Ang Li

In some applications of reinforcement learning, a dataset of pre-collected experience is already available but it is also possible to acquire some additional online data to help improve the quality of the policy. However, it may be…

Machine Learning · Computer Science 2023-07-11 Ruiqi Zhang , Andrea Zanette

We propose a \emph{collaborative} multi-agent reinforcement learning algorithm named variational policy propagation (VPP) to learn a \emph{joint} policy through the interactions over agents. We prove that the joint policy is a Markov Random…

Machine Learning · Computer Science 2022-02-01 Chao Qu , Hui Li , Chang Liu , Junwu Xiong , James Zhang , Wei Chu , Weiqiang Wang , Yuan Qi , Le Song

We introduce Wasserstein Policy Optimization (WPO), an actor-critic algorithm for reinforcement learning in continuous action spaces. WPO can be derived as an approximation to Wasserstein gradient flow over the space of all policies…

Machine Learning · Computer Science 2025-05-02 David Pfau , Ian Davies , Diana Borsa , Joao G. M. Araujo , Brendan Tracey , Hado van Hasselt

Reinforcement Learning (RL) has emerged as the key driver for post-training complex reasoning in Large Language Models (LLMs), yet online RL introduces significant instability and computational overhead. Offline RL offers a compelling…

Computation and Language · Computer Science 2026-04-06 Minjae Oh , Yunho Choi , Dongmin Choi , Yohan Jo

We propose a bottom-up approach, based on Reinforcement Learning, to the design of a chain achieving efficient excitation-transfer performances. We assume distance-dependent interactions among particles arranged in a chain under…

Quantum Physics · Physics 2024-02-27 S. Sgroi , G. Zicari , A. Imparato , M. Paternostro

Quantum optimization algorithms, such as the Quantum Approximate Optimization Algorithm, are emerging as promising heuristics for solving complex combinatorial problems. To improve performance, several extensions to the standard QAOA…

Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural…

Machine Learning · Computer Science 2023-06-22 Yang Ni , Danny Abraham , Mariam Issa , Yeseong Kim , Pietro Mercati , Mohsen Imani

We address the problem of quantum reinforcement learning (QRL) under model-free settings with quantum oracle access to the Markov Decision Process (MDP). This paper introduces a Quantum Natural Policy Gradient (QNPG) algorithm, which…

Quantum Physics · Physics 2025-07-02 Yang Xu , Vaneet Aggarwal

In this paper we present the Warm-starting Dynamic Thresholding algorithm, developed using dynamic programming, for a variant of the standard online selection problem. The problem allows job positions to be either free or already occupied…

Data Structures and Algorithms · Computer Science 2020-02-21 Mathilde Fekom , Nicolas Vayatis , Argyris Kalogeratos

We introduce a variational quantum annealing (VarQA) algorithm for electronic structure theory, in which we use the quantum annealer as a sampler and prepare an ansatz state through its statistics. We also introduce a strategy called the…

Quantum Physics · Physics 2025-03-20 Ka-Wa Yip , Kübra Yeter-Aydeniz , Sijia S. Dong