English
Related papers

Related papers: Adaptive Optics control using Model-Based Reinforc…

200 papers

Setting up and controlling optical systems is often a challenging and tedious task. The high number of degrees of freedom to control mirrors, lenses, or phases of light makes automatic control challenging, especially when the complexity of…

Aberrations limit optical systems in many situations, for example when imaging in biological tissue. Machine learning offers novel ways to improve imaging under such conditions by learning inverse models of aberrations. Learning requires…

Optics · Physics 2021-04-30 Ivan Vishniakou , Johannes D. Seelig

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

To further improve the learning efficiency and performance of reinforcement learning (RL), in this paper we propose a novel uncertainty-aware model-based RL (UA-MBRL) framework, and then implement and validate it in autonomous driving under…

Robotics · Computer Science 2021-07-06 Jingda Wu , Zhiyu Huang , Chen Lv

The goal of many applications in energy and transport sectors is to control turbulent flows. However, because of chaotic dynamics and high dimensionality, the control of turbulent flows is exceedingly difficult. Model-free reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Defne E. Ozan , Andrea Nóvoa , Luca Magri

We propose a model-based reinforcement learning (RL) approach for noisy time-dependent gate optimization with improved sample complexity over model-free RL. Sample complexity is the number of controller interactions with the physical…

Adaptive optics normally concerns the feedback correction of phase aberrations. Such correction has been of benefit in various optical systems, with applications ranging in scale from astronomical telescopes to super-resolution microscopes.…

Optics · Physics 2021-10-07 Chao He , Jacopo Antonello , Martin J. Booth

Active perception describes a broad class of techniques that couple planning and perception systems to move the robot in a way to give the robot more information about the environment. In most robotic systems, perception is typically…

Visual Odometry (VO) is essential to downstream mobile robotics and augmented/virtual reality tasks. Despite recent advances, existing VO methods still rely on heuristic design choices that require several weeks of hyperparameter tuning by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Nico Messikommer , Giovanni Cioffi , Mathias Gehrig , Davide Scaramuzza

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

Machine Learning · Computer Science 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

Using an observational derived model optical turbulence profile (model-OTP) we have investigated the performance of Adaptive Optics (AO) at Siding Spring Observatory (SSO), Australia. The simulations cover the performance for AO techniques…

Instrumentation and Methods for Astrophysics · Physics 2015-06-11 Michael Goodwin , Charles Jenkins , Andrew Lambert

Adaptive optics (AO) have been used to correct wavefronts to achieve diffraction limited point spread functions in a broad range of optical applications, prominently ground-based astronomical telescopes operating in near infra-red. While…

Instrumentation and Methods for Astrophysics · Physics 2018-10-03 Alexandre J. T. S. Mello , Antonin H. Bouchez , Andrew Szentgyorgyi , Marcos A. van Dam , Henrique Lupinari

We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Chang Sun , Eurika Kaiser , Steven L. Brunton , J. Nathan Kutz

Adaptive robust optimization (ARO) extends static robust optimization by allowing decisions to depend on the realized uncertainty - weakly dominating static solutions within the modeled uncertainty set. However, ARO makes previous…

Optimization and Control · Mathematics 2025-11-20 Karl Zhu , Dimitris Bertsimas

Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems. However, an open question is how to make RL cope with partial observability which is…

Machine Learning · Computer Science 2021-04-23 Stephan Weigand , Pascal Klink , Jan Peters , Joni Pajarinen

In order to increase the corrected field of view of an adaptive optics (AO) system, several deformable mirrors (DM) have to be placed in the conjugate planes of the dominant turbulent layers (multi-conjugate adaptive optics, MCAO [Beckers…

Astrophysics · Physics 2022-04-20 T. Berkefeld , A. Glindemann , S. Hippler

In this paper, a multi-objective model-following control problem is solved using an observer-based adaptive learning scheme. The overall goal is to regulate the model-following error dynamics along with optimizing the dynamic variables of a…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Mohammed I. Abouheaf , Kyriakos G. Vamvoudakis , Mohammad A. Mayyas , Hashim A. Hashim

This work investigates resource optimization in heterogeneous satellite clusters performing autonomous Earth Observation (EO) missions using Reinforcement Learning (RL). In the proposed setting, two optical satellites and one Synthetic…

Artificial Intelligence · Computer Science 2025-11-18 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Zehong Cao , Ryszard Kowalczyk

The availability and performance of laser-based adaptive optics (AO) systems are strongly dependent on the power and quality of the laser beam before being projected to the sky. Frequent and time-consuming alignment procedures are usually…

Instrumentation and Methods for Astrophysics · Physics 2014-05-23 Clémentine Béchet , Andrés Guesalaga , Benoit Neichel , Vincent Fesquet , Héctor González-Núñez , Sebastián Zúñiga , Pedro Escarate , Dani Guzman

Capturing and simulating intelligent adaptive behaviours within spatially explicit individual-based models remains an ongoing challenge for researchers. While an ever-increasing abundance of real-world behavioural data are collected, few…

Multiagent Systems · Computer Science 2022-01-05 Sedar Olmez , Dan Birks , Alison Heppenstall