English
Related papers

Related papers: Handling Delay in Real-Time Reinforcement Learning

200 papers

The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling…

Artificial Intelligence · Computer Science 2023-03-14 Shaohuai Liu , Jinbo Liu , Weirui Ye , Nan Yang , Guanglun Zhang , Haiwang Zhong , Chongqing Kang , Qirong Jiang , Xuri Song , Fangchun Di , Yang Gao

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

Research in machine learning is making progress in fixing its own reproducibility crisis. Reinforcement learning (RL), in particular, faces its own set of unique challenges. Comparison of point estimates, and plots that show successful…

Machine Learning · Computer Science 2024-02-07 Ted Fujimoto , Joshua Suetterlein , Samrat Chatterjee , Auroop Ganguly

Significant progress has been made in the area of model-based reinforcement learning. State-of-the-art algorithms are now able to match the asymptotic performance of model-free methods while being significantly more data efficient. However,…

Machine Learning · Computer Science 2019-10-29 Yunzhi Zhang , Ignasi Clavera , Boren Tsai , Pieter Abbeel

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Cristiano Capone , Paolo Muratore

Neural networks rely on learning synaptic weights. However, this overlooks other neural parameters that can also be learned and may be utilized by the brain. One such parameter is the delay: the brain exhibits complex temporal dynamics with…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Pengfei Sun , Jascha Achterberg , Zhe Su , Dan F. M. Goodman , Danyal Akarca

Neural-network processing in machine learning applications relies on layer synchronization. This is practiced even in artificial Spiking Neural Networks (SNNs), which are touted as consistent with neurobiology, in spite of processing in the…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Roel Koopman , Amirreza Yousefzadeh , Mahyar Shahsavari , Guangzhi Tang , Manolis Sifalakis

Deep reinforcement learning (DRL) agents are trained through trial-and-error interactions with the environment. This leads to a long training time for dense neural networks to achieve good performance. Hence, prohibitive computation and…

Machine Learning · Computer Science 2022-05-09 Ghada Sokar , Elena Mocanu , Decebal Constantin Mocanu , Mykola Pechenizkiy , Peter Stone

Recent reinforcement learning (RL) techniques have yielded impressive reasoning improvements in language models, yet it remains unclear whether post-training truly extends a model's reasoning ability beyond what it acquires during…

Computation and Language · Computer Science 2025-12-09 Charlie Zhang , Graham Neubig , Xiang Yue

The integration of Reinforcement Learning (RL) with heuristic methods is an emerging trend for solving optimization problems, which leverages RL's ability to learn from the data generated during the search process. One promising approach is…

Machine Learning · Computer Science 2024-09-19 Arthur Müller , Lukas Vollenkemper

In this work, we augment reinforcement learning with an inference-time collision model to ensure safe and efficient container management in a waste-sorting facility with limited processing capacity. Each container has two optimal emptying…

Machine Learning · Computer Science 2025-03-24 Abhijeet Pendyala , Tobias Glasmachers

How do humans and animals perform trial-and-error learning when the space of possibilities is infinite? In a previous study, we used an interval timing production task and discovered an updating strategy in which the agent adjusted the…

Neurons and Cognition · Quantitative Biology 2022-05-10 Jing Wang , Yousuf El-Jayyousi , Ilker Ozden

Autonomous agents must often deal with conflicting requirements, such as completing tasks using the least amount of time/energy, learning multiple tasks, or dealing with multiple opponents. In the context of reinforcement learning~(RL),…

Machine Learning · Computer Science 2019-10-30 Santiago Paternain , Luiz F. O. Chamon , Miguel Calvo-Fullana , Alejandro Ribeiro

Self-paced reinforcement learning (RL) aims to improve the data efficiency of learning by automatically creating sequences, namely curricula, of probability distributions over contexts. However, existing techniques for self-paced RL fail in…

Machine Learning · Computer Science 2023-05-29 Cevahir Koprulu , Ufuk Topcu

Cloud computing is a reliable solution to provide distributed computation power. However, real-time response is still challenging regarding the enormous amount of data generated by the IoT devices in 5G and 6G networks. Thus, multi-access…

Artificial Intelligence · Computer Science 2022-11-03 Anahita Mazloomi , Hani Sami , Jamal Bentahar , Hadi Otrok , Azzam Mourad

Reinforcement Learning (RL) trains agents to learn optimal behavior by maximizing reward signals from experience datasets. However, RL training often faces memory limitations, leading to execution latencies and prolonged training times. To…

We propose an automata-theoretic approach for reinforcement learning (RL) under complex spatio-temporal constraints with time windows. The problem is formulated using a Markov decision process under a bounded temporal logic constraint.…

Artificial Intelligence · Computer Science 2023-08-01 Xiaoshan Lin , Abbasali Koochakzadeh , Yasin Yazicioglu , Derya Aksaray

Reinforcement learning (RL) has increasingly been applied to solve real-world planning problems, with progress in handling large state spaces and time horizons. However, a key bottleneck in many domains is that RL methods cannot accommodate…

Machine Learning · Computer Science 2025-03-19 Lily Xu , Bryan Wilder , Elias B. Khalil , Milind Tambe

Working memory requires the brain to maintain information from the recent past to guide ongoing behavior. Neurons can contribute to this capacity by slowly integrating their inputs over time, creating persistent activity that outlasts the…

Neurons and Cognition · Quantitative Biology 2025-11-20 Nicoas Zucchet , Qianqian Feng , Axel Laborieux , Friedemann Zenke , Walter Senn , João Sacramento

Multi-agent reinforcement learning (MARL) for cyber-physical vehicle systems usually requires a significantly long training time due to their inherent complexity. Furthermore, deploying the trained policies in the real world demands a…

Robotics · Computer Science 2026-02-24 Chinmay Vilas Samak , Tanmay Vilas Samak , Venkat Narayan Krovi