English
Related papers

Related papers: Autonomous Control of a Particle Accelerator using…

200 papers

Reinforcement learning is one of the core components in designing an artificial intelligent system emphasizing real-time response. Reinforcement learning influences the system to take actions within an arbitrary environment either having…

Artificial Intelligence · Computer Science 2020-02-03 Amit Kumar Mondal

In this article, we use artificial intelligence algorithms to show how to enhance the resolution of the elementary particle track fitting in inhomogeneous dense detectors, such as plastic scintillators. We use deep learning to replace more…

Data Analysis, Statistics and Probability · Physics 2023-06-21 Saúl Alonso-Monsalve , Davide Sgalaberna , Xingyu Zhao , Clark McGrew , André Rubbia

Cellular reprogramming can be used for both the prevention and cure of different diseases. However, the efficiency of discovering reprogramming strategies with classical wet-lab experiments is hindered by lengthy time commitments and high…

Machine Learning · Computer Science 2025-03-04 Andrzej Mizera , Jakub Zarzycki

Optimal control of the future is the next frontier for AI. Current approaches to this problem are typically rooted in reinforcement learning (RL). RL is mathematically distinct from supervised learning, which has been the main workhorse for…

Machine Learning · Statistics 2026-05-06 Yuxin Bai , Aranyak Acharyya , Ashwin De Silva , Zeyu Shen , James Hassett , Joshua T. Vogelstein

Particle accelerator beamline optimization is a high-dimensional control problem traditionally requiring significant expert intervention. We present RLABC (Reinforcement Learning for Accelerator Beamline Control), an open-source Python…

Machine Learning · Computer Science 2026-04-22 Anwar Ibrahim , Fedor Ratnikov , Maxim Kaledin , Alexey Petrenko , Denis Derkach

State-of-the-art reinforcement learning algorithms predominantly learn a policy from either a numerical state vector or images. Both approaches generally do not take structural knowledge of the task into account, which is especially…

Machine Learning · Computer Science 2022-03-14 Marco Oliva , Soubarna Banik , Josip Josifovski , Alois Knoll

This paper investigates the vision-based autonomous driving with deep learning and reinforcement learning methods. Different from the end-to-end learning method, our method breaks the vision-based lateral control system down into a…

Machine Learning · Computer Science 2018-10-31 Dong Li , Dongbin Zhao , Qichao Zhang , Yaran Chen

Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the potential to address…

Machine Learning · Computer Science 2023-10-24 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

Researchers have demonstrated that Deep Reinforcement Learning (DRL) is a powerful tool for finding policies that perform well on complex robotic systems. However, these policies are often unpredictable and can induce highly variable…

Robotics · Computer Science 2022-03-08 Sean Gillen , Asutay Ozmen , Katie Byl

Particle accelerators are complex facilities that produce large amounts of structured data and have clear optimization goals as well as precisely defined control requirements. As such they are naturally amenable to data-driven research…

Accelerator Physics · Physics 2023-03-01 Sichen Li , Andreas Adelmann

This paper introduces a method, based on deep reinforcement learning, for automatically generating a general purpose decision making function. A Deep Q-Network agent was trained in a simulated environment to handle speed and lane change…

Robotics · Computer Science 2019-05-10 Carl-Johan Hoel , Krister Wolff , Leo Laine

In modern power systems, frequency regulation is a fundamental prerequisite for ensuring system reliability and assessing the robustness of expansion projects. Conventional feedback control schemes, however, exhibit limited accuracy under…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Amin Masoumi , Mert Korkali

In this paper, we study the use of robust model independent bounded extremum seeking (ES) feedback control to improve the robustness of deep reinforcement learning (DRL) controllers for a class of nonlinear time-varying systems. DRL has the…

Machine Learning · Computer Science 2026-03-11 Shaifalee Saxena , Alan Williams , Rafael Fierro , Alexander Scheinker

Self-paced reinforcement learning (RL) aims to improve the data efficiency of learning by automatically creating sequences, namely curricula, of probability distributions over contexts. However, existing techniques for self-paced RL fail in…

Machine Learning · Computer Science 2023-05-29 Cevahir Koprulu , Ufuk Topcu

Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. However, for the majority of intersections regulated by traffic lights, the problem could be solved by a simple rule-based method in which the…

Robotics · Computer Science 2021-05-04 Alessandro Paolo Capasso , Paolo Maramotti , Anthony Dell'Eva , Alberto Broggi

Existing approaches in reinforcement learning train an agent to learn desired optimal behavior in an environment with rule based surrounding agents. In safety critical applications such as autonomous driving it is crucial that the rule…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Arjun Srinivasan , Anubhav Paras , Aniket Bera

With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. This review summarises deep…

Machine Learning · Computer Science 2021-01-26 B Ravi Kiran , Ibrahim Sobh , Victor Talpaert , Patrick Mannion , Ahmad A. Al Sallab , Senthil Yogamani , Patrick Pérez

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework. RL is an autonomous…

Machine Learning · Computer Science 2021-02-05 Rajesh Siraskar

This paper proposes a novel approach to controller design for MR-damped vehicle suspension system. This approach is predicated on the premise that the optimal control strategy can be learned through real-world or simulated experiments…

Systems and Control · Electrical Eng. & Systems 2023-09-06 AmirReza BabaAhmadi , Masoud ShariatPanahi , Moosa Ayati

Reinforcement learning has shown strong performance in robotic manipulation, but learned policies often degrade in performance when test conditions differ from the training distribution. This limitation is especially important in…

Robotics · Computer Science 2026-04-02 Shaifalee Saxena , Rafael Fierro , Alexander Scheinker