English
Related papers

Related papers: Model-Free Quantum Control with Reinforcement Lear…

200 papers

The wide-ranging adoption of quantum technologies requires practical, high-performance advances in our ability to maintain quantum coherence while facing the challenge of state collapse under measurement. Here we use techniques from control…

Quantum Physics · Physics 2017-02-01 Sandeep Mavadia , Virginia Frey , Jarrah Sastrawan , Stephen Dona , Michael J. Biercuk

As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. Biologically inspired, this work presents a framework for…

Robotics · Computer Science 2026-03-05 Fabian Domberg , Georg Schildbach

Quantum machine learning models based on parameterized circuits can be viewed as Fourier series approximators. However, they often struggle to learn functions with multiple frequency components, particularly high-frequency or non-dominant…

Quantum Physics · Physics 2026-05-06 Ammar Daskin

Approximation of the value functions in value-based deep reinforcement learning induces overestimation bias, resulting in suboptimal policies. We show that when the reinforcement signals received by the agents have a high variance, deep…

Machine Learning · Computer Science 2022-05-20 Baturay Saglam , Furkan Burak Mutlu , Dogan Can Cicek , Suleyman Serdar Kozat

This work provides a rigorous framework for studying continuous time control problems in uncertain environments. The framework considered models uncertainty in state dynamics as a measure on the space of functions. This measure is…

Optimization and Control · Mathematics 2018-02-22 Ryan Murray , Michele Palladino

In many practical control applications, the performance level of a closed-loop system degrades over time due to the change of plant characteristics. Thus, there is a strong need for redesigning a controller without going through the system…

Systems and Control · Electrical Eng. & Systems 2023-12-01 Mei Minami , Yuka Masumoto , Yoshihiro Okawa , Tomotake Sasaki , Yutaka Hori

Multi-Agent Reinforcement Learning is becoming increasingly more important in times of autonomous driving and other smart industrial applications. Simultaneously a promising new approach to Reinforcement Learning arises using the inherent…

We consider reinforcement learning in input-driven environments, where an exogenous, stochastic input process affects the dynamics of the system. Input processes arise in many applications, including queuing systems, robotics control with…

Machine Learning · Computer Science 2019-02-28 Hongzi Mao , Shaileshh Bojja Venkatakrishnan , Malte Schwarzkopf , Mohammad Alizadeh

Motivated by the novel paradigm developed by Van Roy and coauthors for reinforcement learning in arbitrary non-Markovian environments, we propose a related formulation and explicitly pin down the error caused by non-Markovianity of…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Siddharth Chandak , Pratik Shah , Vivek S Borkar , Parth Dodhia

Digital quantum simulation is a promising application for quantum computers. Their free programmability provides the potential to simulate the unitary evolution of any many-body Hamiltonian with bounded spectrum by discretizing the time…

Quantum Physics · Physics 2021-09-15 Adrien Bolens , Markus Heyl

Mathematical and computational tools have proven to be reliable in decision-making processes. In recent times, in particular, machine learning-based methods are becoming increasingly popular as advanced support tools. When dealing with…

Optimization and Control · Mathematics 2024-02-23 Christina Schenk , Aditya Vasudevan , Maciej Haranczyk , Ignacio Romero

We study the problem of learning the Hamiltonian of a many-body quantum system from experimental data. We show that the rate of learning depends on the amount of control available during the experiment. We consider three control models: one…

Quantum Physics · Physics 2024-11-27 Alicja Dutkiewicz , Thomas E. O'Brien , Thomas Schuster

In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Mohammed I. Abouheaf , Hashim A. Hashim , Mohammad A. Mayyas , Kyriakos G. Vamvoudakis

A central challenge in quantum information science and technology is achieving real-time estimation and feedforward control of quantum systems. This challenge is compounded by the inherent inhomogeneity of quantum resources, such as qubit…

Machine Learning · Computer Science 2024-05-28 Linsen Li , Pratyush Anand , Kaiming He , Dirk Englund

We derive simple models for the dynamics of a single atom coupled to a cavity field mode in the absorptive bistable parameter regime by projecting the time evolution of the state of the system onto a suitably chosen nonlinear…

Quantum Physics · Physics 2009-10-30 Anne E. B. Nielsen , Asa S. Hopkins , Hideo Mabuchi

We propose a novel Reinforcement Learning (RL) method for optimizing quantum circuits using graph-theoretic simplification rules of ZX-diagrams. The agent, trained using the Proximal Policy Optimization (PPO) algorithm, employs Graph Neural…

Quantum Physics · Physics 2025-06-04 Jordi Riu , Jan Nogué , Gerard Vilaplana , Artur Garcia-Saez , Marta P. Estarellas

Model-independent estimation of the properties of quantum states is a central challenge in quantum technologies, as experimental imperfections, drifts, and imprecise models of the actual quantum dynamics inevitably hinder accurate…

In recent years, deep reinforcement learning has emerged as a technique to solve closed-loop flow control problems. Employing simulation-based environments in reinforcement learning enables a priori end-to-end optimization of the control…

Fluid Dynamics · Physics 2024-04-11 Andre Weiner , Janis Geise

Control of quantum systems is a central element of high-precision experiments and the development of quantum technological applications. Control pulses that are typically temporally or spatially modulated are often designed based on…

Quantum Physics · Physics 2021-01-04 Frederic Sauvage , Florian Mintert

In this work, we present a learning based approach to analog circuit design, where the goal is to optimize circuit performance subject to certain design constraints. One of the aspects that makes this problem challenging to optimize, is…

Machine Learning · Computer Science 2020-11-17 Wook Lee , Frans A. Oliehoek