Related papers: The Quantum Cartpole: A benchmark environment for …
We give an introduction to feedback control in quantum systems, as well as an overview of the variety of applications which have been explored to date. This introductory review is aimed primarily at control theorists unfamiliar with quantum…
We investigate the important problem of certifying stability of reinforcement learning policies when interconnected with nonlinear dynamical systems. We show that by regulating the input-output gradients of policies, strong guarantees of…
In recent times, reinforcement learning has produced baffling results when it comes to performing control tasks with highly non-linear systems. The impressive results always outweigh the potential vulnerabilities or uncertainties associated…
We derive the quantum stochastic master equation for bosonic systems without measurement theory but control theory. It is shown that the quantum effect of the measurement can be represented as the correlation between dynamical and…
Energy storage is a basic physical process with many applications. When considering this task at the quantum scale, it becomes important to optimise the non-equilibrium dynamics of energy transfer to the storage device or battery. Here, we…
The paper introduces an interactive machine learning mechanism to process the measurements of an uncertain, nonlinear dynamic process and hence advise an actuation strategy in real-time. For concept demonstration, a trajectory-following…
Classical feedback is defined here as the knowledge by the transmitter of the quantum state of the qubit received by the receiver. Such classical feedback doubles capacities of certain memoryless quantum channels without preexisting…
Feedback control (based on the quantum continuous measurement) of quantum systems inevitably suffers from estimation delays. In this paper we give a delay-dependent stability criterion for a wide class of nonlinear stochastic systems…
The development of quantum technologies relies on creating and manipulating quantum systems of increasing complexity, with key applications in computation, simulation, and sensing. This poses severe challenges in efficient control,…
We find that feedback control may induce "pseudo" nonlinear dynamics in a damped harmonic oscillator, whose centroid trajectory in the phase space behaves like a classical nonlinear system. Thus, similar to nonlinear amplifiers (e.g.,…
A new method for doing feedback control of single quantum systems was proposed. Instead of feeding back precisely the process output, a cloning machine served to obtain the feedback signal and the output. A simple example was given to…
This paper presents the first algorithm for model-based offline quantum reinforcement learning and demonstrates its functionality on the cart-pole benchmark. The model and the policy to be optimized are each implemented as variational…
Reinforcement learning (RL) can be a powerful alternative to classical control methods when standard model-based control is insufficient, e.g., when deriving a suitable model is intractable or impossible. In many cases, however, the choice…
The ability to prepare a physical system in a desired quantum state is central to many areas of physics such as nuclear magnetic resonance, cold atoms, and quantum computing. Yet, preparing states quickly and with high fidelity remains a…
Robust control of quantum systems is an increasingly relevant field of study amidst the second quantum revolution, but there remains a gap between taming quantum physics and robust control in its modern analytical form that culminated in…
This paper discusses learning a structured feedback control to obtain sufficient robustness to exogenous inputs for linear dynamic systems with unknown state matrix. The structural constraint on the controller is necessary for many…
Reinforcement learning is an emerging approach to control dynamical systems for which classical approaches are difficult to apply. However, trained agents may not generalize against the variations of system parameters. This paper presents…
The paper proposes the use of structured neural networks for reinforcement learning based nonlinear adaptive control. The focus is on partially observable systems, with separate neural networks for the state and feedforward observer and the…
Developments in the foundations of quantum mechanics have identified several attributes and tests associated with the "quantumness" of systems, including entanglement, nonlocality, quantum erasure, Bell test, etc. Here we introduce and…
Safety is a critical feature of controller design for physical systems. When designing control policies, several approaches to guarantee this aspect of autonomy have been proposed, such as robust controllers or control barrier functions.…