English
Related papers

Related papers: Dynamic Decision Frequency with Continuous Options

200 papers

We study reinforcement learning (RL) in the setting of continuous time and space, for an infinite horizon with a discounted objective and the underlying dynamics driven by a stochastic differential equation. Built upon recent advances in…

Machine Learning · Computer Science 2023-10-19 Hanyang Zhao , Wenpin Tang , David D. Yao

Robots that navigate among pedestrians use collision avoidance algorithms to enable safe and efficient operation. Recent works present deep reinforcement learning as a framework to model the complex interactions and cooperation. However,…

Robotics · Computer Science 2018-05-08 Michael Everett , Yu Fan Chen , Jonathan P. How

In reinforcement learning, agents learn by performing actions and observing their outcomes. Sometimes, it is desirable for a human operator to \textit{interrupt} an agent in order to prevent dangerous situations from happening. Yet, as part…

Artificial Intelligence · Computer Science 2017-05-23 El Mahdi El Mhamdi , Rachid Guerraoui , Hadrien Hendrikx , Alexandre Maurer

Many reinforcement learning algorithms are built on an assumption that an agent interacts with an environment over fixed-duration, discrete time steps. However, physical systems are continuous in time, requiring a choice of…

Machine Learning · Computer Science 2024-09-04 Kris De Asis , Richard S. Sutton

Interference among concurrent transmissions in a wireless network is a key factor limiting the system performance. One way to alleviate this problem is to manage the radio resources in order to maximize either the average or the worst-case…

Machine Learning · Computer Science 2019-06-24 Navid Naderializadeh , Jaroslaw Sydir , Meryem Simsek , Hosein Nikopour , Shilpa Talwar

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Recommendation systems often use online collaborative filtering (CF) algorithms to identify items a given user likes over time, based on ratings that this user and a large number of other users have provided in the past. This problem has…

Machine Learning · Computer Science 2021-02-01 Wasim Huleihel , Soumyabrata Pal , Ofer Shayevitz

Standard reinforcement learning (RL) aims to find an optimal policy that identifies the best action for each state. However, in healthcare settings, many actions may be near-equivalent with respect to the reward (e.g., survival). We…

Machine Learning · Computer Science 2020-07-27 Shengpu Tang , Aditya Modi , Michael W. Sjoding , Jenna Wiens

We consider online convex optimization (OCO) with multi-slot feedback delay, where an agent makes a sequence of online decisions to minimize the accumulation of time-varying convex loss functions, subject to short-term and long-term…

Information Theory · Computer Science 2021-08-17 Juncheng Wang , Ben Liang , Min Dong , Gary Boudreau , Hatem Abou-zeid

Biological agents learn and act intelligently in spite of a highly limited capacity to process and store information. Many real-world problems involve continuous control, which represents a difficult task for artificial intelligence agents.…

Machine Learning · Computer Science 2025-05-16 Tailia Malloy , Chris R. Sims , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro

Continuous-time reinforcement learning tasks commonly use discrete steps of fixed cycle times for actions. As practitioners need to choose the action-cycle time for a given task, a significant concern is whether the hyper-parameters of the…

Machine Learning · Computer Science 2023-06-02 Homayoon Farrahi , A. Rupam Mahmood

Frequency control is an important problem in modern recommender systems. It dictates the delivery frequency of recommendations to maintain product quality and efficiency. For example, the frequency of delivering promotional notifications…

Machine Learning · Computer Science 2020-12-22 Yang Liu , Zhengxing Chen , Kittipat Virochsiri , Juan Wang , Jiahao Wu , Feng Liang

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

A policy is said to be robust if it maximizes the reward while considering a bad, or even adversarial, model. In this work we formalize two new criteria of robustness to action uncertainty. Specifically, we consider two scenarios in which…

Machine Learning · Computer Science 2019-05-08 Chen Tessler , Yonathan Efroni , Shie Mannor

This study explores the interference in temporal processing within a dual-task paradigm from an artificial intelligence (AI) perspective. In this context, the dual-task setup is implemented as a simplified version of the Overcooked…

Artificial Intelligence · Computer Science 2025-11-04 Amrapali Pednekar , Álvaro Garrido-Pérez , Yara Khaluf , Pieter Simoens

In multi-agent reinforcement learning, multiple agents learn simultaneously while interacting with a common environment and each other. Since the agents adapt their policies during learning, not only the behavior of a single agent becomes…

Artificial Intelligence · Computer Science 2022-04-13 Yuan Tian , Klaus-Rudolf Kladny , Qin Wang , Zhiwu Huang , Olga Fink

Temporal abstraction in reinforcement learning (RL), offers the promise of improving generalization and knowledge transfer in complex environments, by propagating information more efficiently over time. Although option learning was…

Machine Learning · Computer Science 2021-12-07 Martin Klissarov , Doina Precup

Reinforcement learning (RL) algorithms can find an optimal policy for a single agent to accomplish a particular task. However, many real-world problems require multiple agents to collaborate in order to achieve a common goal. For example, a…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Hadi Partovi Aria , Hyohun Kim , Daniel Neider , Zhe Xu

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

Machine Learning · Computer Science 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

Deep reinforcement learning (RL) models, despite their efficiency in learning an optimal policy in static environments, easily loses previously learned knowledge (i.e., catastrophic forgetting). It leads RL models to poor performance in…

Machine Learning · Computer Science 2025-09-08 Wonseo Jang , Dongjae Kim