English
Related papers

Related papers: Self-optimizing adaptive optics control with Reinf…

200 papers

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics…

Robotics · Computer Science 2021-06-22 Spencer M. Richards , Navid Azizan , Jean-Jacques Slotine , Marco Pavone

Adjusting camera exposure in arbitrary lighting conditions is the first step to ensure the functionality of computer vision applications. Poorly adjusted camera exposure often leads to critical failure and performance degradation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Kyunghyun Lee , Ukcheol Shin , Byeong-Uk Lee

We present an algorithm for rapidly learning controllers for robotics systems. The algorithm follows the model-based reinforcement learning paradigm, and improves upon existing algorithms; namely Probabilistic learning in Control (PILCO)…

Robotics · Computer Science 2018-08-02 Juan Camilo Gamboa Higuera , David Meger , Gregory Dudek

Modern radio telescopes produce unprecedented amounts of data, which are passed through many processing pipelines before the delivery of scientific results. Hyperparameters of these pipelines need to be tuned by hand to produce optimal…

Instrumentation and Methods for Astrophysics · Physics 2021-05-26 Sarod Yatawatta , Ian M. Avruch

Predicting the response of an observed system to a known input is a fruitful first step to accurately control the system's dynamics. Despite the recent advances in fully data-driven algorithms, the most interpretable way to reach this goal…

Dynamical Systems · Mathematics 2026-03-03 Laurent Pagnier , Melvyn Tyloo , Akshita Jindal , Pragati Thakur , Kyle C. A. Wedgwood

Despite impressive results, reinforcement learning (RL) suffers from slow convergence and requires a large variety of tuning strategies. In this paper, we investigate the ability of RL algorithms on simple continuous control tasks. We show…

Robotics · Computer Science 2024-02-16 Daniel Layeghi , Steve Tonneau , Michael Mistry

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics…

Robotics · Computer Science 2022-04-15 Spencer M. Richards , Navid Azizan , Jean-Jacques Slotine , Marco Pavone

Optimal management of traffic light timing is one of the most effective factors in reducing urban traffic. In most old systems, fixed timing was used along with human factors to control traffic, which is not very efficient in terms of time…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Mahdi Jamebozorg , Mohsen Hami , Sajjad Deh Deh Jani

Reinforcement learning was carried out in a simulated environment to learn continuous velocity control over multiple motor axes. This was then applied to a real-world optical tweezers experiment with the objective of moving a laser-trapped…

Machine Learning · Computer Science 2020-11-11 Matthew Praeger , Yunhui Xie , James A. Grant-Jacob , Robert W. Eason , Ben Mills

We present an orientation adaptive controller to compensate for the effects of highly constrained environments on continuum manipulator actuation. A transformation matrix updated using optimal estimation techniques from optical flow…

Robotics · Computer Science 2019-09-04 Mrinal Verghese , Florian Richter , Aaron Gunn , Phil Weissbrod , Michael Yip

The direct imaging and characterization of exoplanets requires extreme adaptive optics (XAO), achieving exquisite wavefront correction (upwards of 90$\%$ Strehl) over a narrow field of view (a few arcseconds). For these XAO systems the…

Instrumentation and Methods for Astrophysics · Physics 2024-07-17 J. Fowler , Rebecca Jensen-Clem , Maaike A. M. van Kooten , Vincent Chambouleyron , Sylvain Cetre

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

Ground-based high contrast exoplanet imaging requires state-of-the-art adaptive optics (AO) systems in order to detect extremely faint planets next to their brighter host stars. For such extreme AO systems (with high actuator count…

Earth and Planetary Astrophysics · Physics 2022-08-02 J. Fowler , Maaike A. M. Van Kooten , Rebecca Jensen-Clem

Many industries extensively use flexible materials. Effective approaches for handling flexible objects with a robot manipulator must address residual vibrations. Existing solutions rely on complex models, use additional instrumentation for…

Robotics · Computer Science 2022-11-22 Daniele Ronzani , Shamil Mamedov , Jan Swevers

Common approaches to control a data-center cooling system rely on approximated system/environment models that are built upon the knowledge of mechanical cooling and electrical and thermal management. These models are difficult to design and…

Systems and Control · Computer Science 2018-08-31 Takao Moriyama , Giovanni De Magistris , Michiaki Tatsubori , Tu-Hoa Pham , Asim Munawar , Ryuki Tachibana

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

This paper introduces a novel neural network-based reinforcement learning approach for robot gaze control. Our approach enables a robot to learn and to adapt its gaze control strategy for human-robot interaction neither with the use of…

Robotics · Computer Science 2019-02-18 Stéphane Lathuilière , Benoit Massé , Pablo Mesejo , Radu Horaud

Reinforcement Learning, a machine learning framework for training an autonomous agent based on rewards, has shown outstanding results in various domains. However, it is known that learning a good policy is difficult in a domain where…

Machine Learning · Computer Science 2019-06-27 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

This paper introduces a novel model-free and a partially model-free algorithm for inverse optimal control (IOC), also known as inverse reinforcement learning (IRL), aimed at estimating the cost function of continuous-time nonlinear…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Hamed Jabbari Asl , Eiji Uchibe