English
Related papers

Related papers: Self-optimizing adaptive optics control with Reinf…

200 papers

While pre-trained visual representations have significantly advanced imitation learning, they are often task-agnostic as they remain frozen during policy learning. In this work, we explore leveraging pre-trained text-to-image diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Heeseong Shin , Byeongho Heo , Dongyoon Han , Seungryong Kim , Taekyung Kim

We propose a model-free reinforcement learning method for controlling mixed autonomy traffic in simulated traffic networks with through-traffic-only two-way and four-way intersections. Our method utilizes multi-agent policy decomposition…

Artificial Intelligence · Computer Science 2021-11-09 Zhongxia Yan , Cathy Wu

Efficient fine-tuning of vision-language models (VLMs) like CLIP for specific downstream tasks is gaining significant attention. Previous works primarily focus on prompt learning to adapt the CLIP into a variety of downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Jinlong Li , Dong Zhao , Zequn Jie , Elisa Ricci , Lin Ma , Nicu Sebe

In this paper, we focus on finding the optimal hedging strategy of a credit index option using reinforcement learning. We take a practical approach, where the focus is on realism i.e. discrete time, transaction costs; even testing our…

Trading and Market Microstructure · Quantitative Finance 2023-07-20 Francesco Mandelli , Marco Pinciroli , Michele Trapletti , Edoardo Vittori

We propose a novel reformulation of the stochastic optimal control problem as an approximate inference problem, demonstrating, that such a interpretation leads to new practical methods for the original problem. In particular we characterise…

Machine Learning · Computer Science 2010-09-22 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

Deformable mirrors with very high order correction generally have smaller dynamic range of motion than what is required to correct seeing over large aperture telescopes. As a result, systems will need to have an architecture that employs…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Donald Gavel , Andrew Norton

Adaptive control for real-time manipulation requires quick estimation and prediction of object properties. While robot learning in this area primarily focuses on using vision, many tasks cannot rely on vision due to object occlusion. Here,…

Robotics · Computer Science 2021-10-12 Ahalya Prabhakar , Stanislas Furrer , Lorenzo Panchetti , Maxence Perret , Aude Billard

Designing optimal controllers continues to be challenging as systems are becoming complex and are inherently nonlinear. The principal advantage of reinforcement learning (RL) is its ability to learn from the interaction with the environment…

Machine Learning · Computer Science 2018-10-05 Savinay Nagendra , Nikhil Podila , Rashmi Ugarakhod , Koshy George

The naive application of Reinforcement Learning algorithms to continuous control problems -- such as locomotion and manipulation -- often results in policies which rely on high-amplitude, high-frequency control signals, known colloquially…

Robotics · Computer Science 2019-02-14 Steven Bohez , Abbas Abdolmaleki , Michael Neunert , Jonas Buchli , Nicolas Heess , Raia Hadsell

End-to-end reinforcement learning on images showed significant progress in the recent years. Data-based approach leverage data augmentation and domain randomization while representation learning methods use auxiliary losses to learn…

Machine Learning · Computer Science 2024-01-19 Tom Dupuis , Jaonary Rabarisoa , Quoc-Cuong Pham , David Filliat

This paper proposes an on-policy reinforcement learning (RL) control algorithm that solves the optimal regulation problem for a class of uncertain continuous-time nonlinear systems under user-defined state constraints. We formulate the safe…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Soutrik Bandyopadhyay , Shubhendu Bhasin

Adaptive (or deformable) mirrors are widely used as wavefront correctors in adaptive optics systems. The optical calibration of an adaptive mirror is a fundamental step during its life-cycle: the process is in facts required to compute a…

Instrumentation and Methods for Astrophysics · Physics 2022-10-11 Runa Briguglio , Marco Xompero , Armando Riccardi

Structured optical waveforms are emerging as powerful control fields for the next generation of complex photonic and electromagnetic systems, where the temporal structure of light can determine the ultimate performance of scientific…

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Learning visuomotor control policies in robotic systems is a fundamental problem when aiming for long-term behavioral autonomy. Recent supervised-learning-based vision and motion perception systems, however, are often separately built with…

Robotics · Computer Science 2020-06-17 Marvin Chancán , Michael Milford

This paper proposes a novel robust reinforcement learning framework for discrete-time linear systems with model mismatch that may arise from the sim-to-real gap. A key strategy is to invoke advanced techniques from control theory. Using the…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Leilei Cui , Tamer Başar , Zhong-Ping Jiang

Learning-to-optimize is an emerging framework that leverages training data to speed up the solution of certain optimization problems. One such approach is based on the classical mirror descent algorithm, where the mirror map is modelled…

Optimization and Control · Mathematics 2023-06-05 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Andreas Hauptmann , Carola-Bibiane Schönlieb

The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Zenglin Shi , Pascal Mettes , Subhransu Maji , Cees G. M. Snoek

World models learn the consequences of actions in vision-based interactive systems. However, in practical scenarios such as autonomous driving, there commonly exists noncontrollable dynamics independent of the action signals, making it…

Machine Learning · Computer Science 2022-12-20 Minting Pan , Xiangming Zhu , Yunbo Wang , Xiaokang Yang