English
Related papers

Related papers: Real-time Artificial Intelligence for Accelerator …

200 papers

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

This paper is dedicated to the application of reinforcement learning combined with neural networks to the general formulation of user scheduling problem. Our simulator resembles real world problems by means of stochastic changes in…

Artificial Intelligence · Computer Science 2020-11-10 Filipp Skomorokhov , George Ovchinnikov

Training reinforcement learning (RL) agents to control fluid dynamics systems is computationally expensive due to the high cost of direct numerical simulations (DNS) of the governing equations. Surrogate models offer a promising alternative…

Machine Learning · Computer Science 2026-03-31 Tim Plotzki , Sebastian Peitz

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new…

Deep artificial neural networks, trained with labeled data sets are widely used in numerous vision and robotics applications today. In terms of AI, these are called reflex models, referring to the fact that they do not self-evolve or…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Hai Xiao , Jin Shang , Mengyuan Huang

Deep reinforcement learning is becoming increasingly popular for robot control algorithms, with the aim for a robot to self-learn useful feature representations from unstructured sensory input leading to the optimal actuation policy. In…

Robotics · Computer Science 2017-03-16 Steven Bohez , Tim Verbelen , Elias De Coninck , Bert Vankeirsbilck , Pieter Simoens , Bart Dhoedt

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning…

The increasing penetration of renewables in distribution networks calls for faster and more advanced voltage regulation strategies. A promising approach is to formulate the problem as an optimization problem, where the optimal reactive…

Optimization and Control · Mathematics 2020-02-24 Yize Chen , Yuanyuan Shi , Baosen Zhang

Controlling the complex combustion dynamics within solid fuel ramjets (SFRJs) remains a critical challenge limiting deployment at scale. This paper proposes the use of a neural network model to process in-situ measurements for monitoring…

Optimization and Control · Mathematics 2025-06-11 Ryan DeBoskey , Parham Oveissi , Venkat Narayanaswamy , Ankit Goel

We approach the task of network congestion control in datacenters using Reinforcement Learning (RL). Successful congestion control algorithms can dramatically improve latency and overall network throughput. Until today, no such…

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

The calibration and training of a neural network is a complex and time-consuming procedure that requires significant computational resources to achieve satisfactory results. Key obstacles are a large number of hyperparameters to select and…

Machine Learning · Computer Science 2023-09-07 Raffaele Giuseppe Cestari , Gabriele Maroni , Loris Cannelli , Dario Piga , Simone Formentin

Numerical simulations are ubiquitous in science and engineering. Machine learning for science investigates how artificial neural architectures can learn from these simulations to speed up scientific discovery and engineering processes. Most…

Artificial Intelligence · Computer Science 2022-12-12 Lucas Meyer , Alejandro Ribés , Bruno Raffin

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

We consider the problem of scheduling in constrained queueing networks with a view to minimizing packet delay. Modern communication systems are becoming increasingly complex, and are required to handle multiple types of traffic with widely…

Machine Learning · Computer Science 2021-05-04 Mohammani Zaki , Avi Mohan , Aditya Gopalan , Shie Mannor

Reinforcement learning was carried out in a simulated environment to learn continuous velocity control over multiple motor axes. This was then applied to a real-world optical tweezers experiment with the objective of moving a laser-trapped…

Machine Learning · Computer Science 2020-11-11 Matthew Praeger , Yunhui Xie , James A. Grant-Jacob , Robert W. Eason , Ben Mills

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

The rise of microgrid-based architectures is heavily modifying the energy control landscape in distribution systems making distributed control mechanisms necessary to ensure reliable power system operations. In this paper, we propose the…

Systems and Control · Electrical Eng. & Systems 2020-10-14 Sergio Rozada , Dimitra Apostolopoulou , Eduardo Alonso