Related papers: Integrating supervised and reinforcement learning …
For ExAO instruments for the Giant Segmented Mirror Telescopes (GSMTs), alternative architectures of WFS are under consideration because there is a tradeoff between detector size, speed, and noise that reduces the performance of GSMT-ExAO…
Learning-based approaches often outperform hand-coded algorithmic solutions for many problems in robotics. However, learning long-horizon tasks on real robot hardware can be intractable, and transferring a learned policy from simulation to…
The Pyramid Wavefront Sensor (PyWFS) is highly nonlinear and requires the use of beam modulation to successfully close an AO loop under varying atmospheric turbulence conditions, at the expense of a loss in sensitivity. In this work we…
Proportional-integral-derivative (PID) control underlies more than $97\%$ of automated industrial processes. Controlling these processes effectively with respect to some specified set of performance goals requires finding an optimal set of…
This work presents a suboptimality study of a particular model predictive control with a stage cost shaping based on the ideas of reinforcement learning. The focus of the suboptimality study is to derive quantities relating the…
Imaging techniques such as functional near-infrared spectroscopy (fNIRS) and diffuse optical tomography (DOT) achieve deep, non-invasive sensing in turbid media, but they are constrained by the photon budget. Wavefront shaping (WFS) can…
Wavefront sensing involves estimating the phase and intensity of light, enabling a wide range of imaging applications, from adaptive optics and astronomy to biomedical imaging. Since conventional image sensors can only measure the spatial…
We propose a focal-plane wavefront sensor (FPWFS) based on a short multimode fiber (MMF) capable of operating under moderately broadband illumination. By coupling the aberrated focal-plane field into an MMF of length <1 cm, we preserve…
In this paper, we present a novel algorithm named synchronous integral Q-learning, which is based on synchronous policy iteration, to solve the continuous-time infinite horizon optimal control problems of input-affine system dynamics. The…
Metasurfaces allow tailored control over electromagnetic wavefronts. However, due to the local conservation of power flow, a passive, lossless, and reflectionless metasurface is limited to imparting phase discontinuities -- and not power…
We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable. Our approach is based on Markov Decision Process (MDP). In the camera viewfinder or live preview mode, given the current…
Accurate and robust wavefront reconstruction methods for pyramid wavefront sensors are in high demand as these sensors are planned to be part of many instruments currently under development for ground based telescopes. The pyramid sensor…
Purpose: This study aims to address the challenges of controlling unstable and nonlinear systems by proposing an adaptive PID controller based on predictive reinforcement learning (PRL-PID), where the PRL-PID combines the advantages of both…
We demonstrate a new concept for reconfigurable nanophotonic devices exploiting ultrafast nonlinear control of shaped wavefronts in a multimode nanomaterial consisting of semiconductor nanowires. Femtosecond pulsed laser excitation of the…
In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of…
There are scientific and technological needs to improve the co-phasing of the primary mirrors of segmented telescopes. We have developed a methodology for using the wavefront sensor of an adaptive optics (AO) system to disentangle the phase…
Advanced wavefront sensors (WFS) are essential for enabling new science cases for telescopes that utilize adaptive optics (AO) systems. While complex field WFS -- those that estimate the electric field phase and amplitude through…
The basic outline of a pupil plane WaveFront Sensor is reviewed taking into account that the source to be sensed could be different from an unresolved source, i.e. it is extended, and that it could deploy also in a 3D fashion, enough to…
Optical distortions can significantly deteriorate the measurement accuracy in imaging systems. Such distortions can occur at fluctuating phase boundaries as well as multiple-phase flows and result from the accompanied refractive index…
Aerial simultaneous transmitting and reflecting reconfigurable intelligent surfaces (STAR-RIS) enables full-space coverage in dynamic wireless networks. However, most existing works assume fixed user grouping, overlooking the fact that…