English
Related papers

Related papers: On Credit Assignment in Hierarchical Reinforcement…

200 papers

Deep reinforcement learning (DRL) is capable of learning high-performing policies on a variety of complex high-dimensional tasks, ranging from video games to robotic manipulation. However, standard DRL methods often suffer from poor sample…

Machine Learning · Computer Science 2020-03-04 Caleb Chuck , Supawit Chockchowwat , Scott Niekum

High-frequency trading (HFT) uses computer algorithms to make trading decisions in short time scales (e.g., second-level), which is widely used in the Cryptocurrency (Crypto) market (e.g., Bitcoin). Reinforcement learning (RL) in financial…

Trading and Market Microstructure · Quantitative Finance 2023-09-25 Molei Qin , Shuo Sun , Wentao Zhang , Haochong Xia , Xinrun Wang , Bo An

Reinforcement learning (RL) exhibits remarkable potential in addressing autonomous driving tasks. However, it is difficult to train a sample-efficient and safe policy in complex scenarios. In this article, we propose a novel hierarchical…

Robotics · Computer Science 2025-06-23 Yiou Huang

The recommender system is an important form of intelligent application, which assists users to alleviate from information redundancy. Among the metrics used to evaluate a recommender system, the metric of conversion has become more and more…

Machine Learning · Computer Science 2019-03-25 Dongyang Zhao , Liang Zhang , Bo Zhang , Lizhou Zheng , Yongjun Bao , Weipeng Yan

Classical theory in reinforcement learning (RL) predominantly focuses on the single task setting, where an agent learns to solve a task through trial-and-error experience, given access to data only from that task. However, many recent…

Machine Learning · Computer Science 2022-06-28 Aldo Pacchiano , Ofir Nachum , Nilseh Tripuraneni , Peter Bartlett

The management of mixed traffic that consists of robot vehicles (RVs) and human-driven vehicles (HVs) at complex intersections presents a multifaceted challenge. Traditional signal controls often struggle to adapt to dynamic traffic…

Robotics · Computer Science 2024-03-25 Dawei Wang , Weizi Li , Lei Zhu , Jia Pan

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

High Performance Computing (HPC) systems are used across a wide range of disciplines for both large and complex computations. HPC systems often receive many thousands of computational tasks at a time, colloquially referred to as jobs. These…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-16 Elliot Kolker-Hicks , Di Zhang , Dong Dai

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

Machine Learning · Computer Science 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Reinforcement Learning (RL) algorithms suffer from the dependency on accurately engineered reward functions to properly guide the learning agents to do the required tasks. Preference-based reinforcement learning (PbRL) addresses that by…

Artificial Intelligence · Computer Science 2024-08-23 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

Machine Learning · Computer Science 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn

Cooperative air-ground delivery has emerged as a promising logistics paradigm by leveraging the complementary strengths of UAVs and ground carriers. However, effective dispatching in such heterogeneous systems faces two critical challenges:…

Computers and Society · Computer Science 2026-02-16 Songxin Lei , Chunming Ma , Haomin Wen , Yexin Li , Lizhenghe Chen , Qianyu Yang , Fugee Tsung , Lei Chen , Sijie Ruan , Yuxuan Liang

Reinforcement learning and symbolic planning have both been used to build intelligent autonomous agents. Reinforcement learning relies on learning from interactions with real world, which often requires an unfeasibly large amount of…

Machine Learning · Computer Science 2018-06-07 Fangkai Yang , Daoming Lyu , Bo Liu , Steven Gustafson

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo

Hierarchical Reinforcement Learning (HRL) algorithms have been demonstrated to perform well on high-dimensional decision making and robotic control tasks. However, because they solely optimize for rewards, the agent tends to search the same…

Robotics · Computer Science 2022-12-27 Kandai Watanabe , Mathew Strong , Omer Eldar

Reinforcement learning (RL) techniques have been developed to optimize industrial cooling systems, offering substantial energy savings compared to traditional heuristic policies. A major challenge in industrial control involves learning…

Machine Learning · Computer Science 2022-09-20 William Wong , Praneet Dutta , Octavian Voicu , Yuri Chervonyi , Cosmin Paduraru , Jerry Luo

Deep Reinforcement Learning (DRL) is emerging as a promising approach to generate adaptive behaviors for robotic platforms. However, a major drawback of using DRL is the data-hungry training regime that requires millions of trial and error…

Preference based Reinforcement Learning (PbRL) removes the need to hand specify a reward function by learning a reward from preference feedback over policy behaviors. Current approaches to PbRL do not address the credit assignment problem…

Machine Learning · Computer Science 2024-04-16 Mudit Verma , Katherine Metcalf

In many daily tasks we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning theory suggests two classes of…

Neurons and Cognition · Quantitative Biology 2019-11-13 Marco Lehmann , He Xu , Vasiliki Liakoni , Michael Herzog , Wulfram Gerstner , Kerstin Preuschoff