English
Related papers

Related papers: Adaptive Optics control using Model-Based Reinforc…

200 papers

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Adaptive optics (AO) is a powerful tool employed across various research fields, from aerospace to microscopy. Traditionally, AO has focused on correcting optical phase aberrations, with recent advances extending to polarisation…

Large area surveys will dominate the forthcoming decades of astronomy and their success requires characterizing thousands of discoveries through additional observations at higher spatial or spectral resolution, and at complementary cadences…

Instrumentation and Methods for Astrophysics · Physics 2021-11-10 Christoph Baranec , Reed Riddle , Nicholas M. Law

Reinforcement learning (RL) has significantly advanced the control of physics-based and robotic characters that track kinematic reference motion. However, methods typically rely on a weighted sum of conflicting reward functions, requiring…

Robotics · Computer Science 2025-05-30 Lucas N. Alegre , Agon Serifi , Ruben Grandia , David Müller , Espen Knoop , Moritz Bächer

The exponential growth of Low Earth Orbit (LEO) satellites has revolutionised Earth Observation (EO) missions, addressing challenges in climate monitoring, disaster management, and more. However, autonomous coordination in multi-satellite…

Artificial Intelligence · Computer Science 2025-11-06 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Jimmy Cao , Ryszard Kowalczyk

One important frontier for astronomical adaptive optics (AO) involves methods such as Multi-Object AO and Multi-Conjugate AO that have the potential to give a significantly larger field of view than conventional AO techniques. A second key…

Instrumentation and Methods for Astrophysics · Physics 2015-05-13 S. Mark Ammons , Luke Johnson , Edward A. Laag , Renate Kupke , Donald T. Gavel , Brian J. Bauman , Claire E. Max

Traditional wavefront control in high-energy, high-intensity laser systems usually lacks real-time capability, failing to address dynamic aberrations. This limits experimental accuracy due to shot-to-shot fluctuations and necessitates long…

Model-based Reinforcement Learning (MBRL) is a promising framework for learning control in a data-efficient manner. MBRL algorithms can be fairly complex due to the separate dynamics modeling and the subsequent planning algorithm, and as a…

Machine Learning · Computer Science 2021-03-01 Baohe Zhang , Raghu Rajan , Luis Pineda , Nathan Lambert , André Biedenkapp , Kurtland Chua , Frank Hutter , Roberto Calandra

Inverse Reinforcement Learning (RL) can be used to determine the behavior of Space Objects (SOs) by estimating the reward function that an SO is using for control. The approach discussed in this work can be used to analyze maneuvering of…

Systems and Control · Electrical Eng. & Systems 2019-12-09 Bryce Doerr , Richard Linares , Roberto Furfaro

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Model-based reinforcement learning (MBRL) is recognized with the potential to be significantly more sample-efficient than model-free RL. How an accurate model can be developed automatically and efficiently from raw sensory inputs (such as…

Robotics · Computer Science 2023-05-24 Jun Lv , Yunhai Feng , Cheng Zhang , Shuang Zhao , Lin Shao , Cewu Lu

This paper investigates unsupervised anomaly detection in multivariate time-series data using reinforcement learning (RL) in the latent space of an autoencoder. A significant challenge is the limited availability of anomalous data, often…

Machine Learning · Computer Science 2025-02-11 Saba Sanami , Amir G. Aghdam

Model-based offline Reinforcement Learning (RL) constructs environment models from offline datasets to perform conservative policy optimization. Existing approaches focus on learning state transitions through ensemble models, rollouting…

Machine Learning · Computer Science 2025-03-27 Hongye Cao , Fan Feng , Jing Huo , Shangdong Yang , Meng Fang , Tianpei Yang , Yang Gao

Predictive wavefront control is an important and rapidly developing field of adaptive optics (AO). Through the prediction of future wavefront effects, the inherent AO system servo-lag caused by the measurement, computation, and application…

Instrumentation and Methods for Astrophysics · Physics 2021-03-12 Robin Swanson , Masen Lamb , Carlos Correia , Suresh Sivanandam , Kiriakos Kutulakos

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems. Most of the current…

Mathematical Finance · Quantitative Finance 2022-05-31 Huifang Huang , Ting Gao , Yi Gui , Jin Guo , Peng Zhang

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Reinforcement learning (RL) is a class of artificial intelligence algorithms being used to design adaptive optimal controllers through online learning. This paper presents a model-free, real-time, data-efficient Q-learning-based algorithm…

Systems and Control · Electrical Eng. & Systems 2023-10-11 Ali Aalipour , Alireza Khani

Accurate and precise measurements of the Hubble constant are critical for testing our current standard cosmological model and revealing possibly new physics. With Hubble Space Telescope (HST) imaging, each strong gravitational lens system…

Building a good predictive model requires an array of activities such as data imputation, feature transformations, estimator selection, hyper-parameter search and ensemble construction. Given the large, complex and heterogenous space of…

Machine Learning · Computer Science 2019-03-06 Udayan Khurana , Horst Samulowitz