English
Related papers

Related papers: Learn a Prior for RHEA for Better Online Planning

200 papers

Reinforcement Learning (RL) has demonstrated significant potential in certain real-world industrial applications, yet its broader deployment remains limited by inherent challenges such as sample inefficiency and unstable learning dynamics.…

Machine Learning · Computer Science 2025-07-03 Tom Maus , Asma Atamna , Tobias Glasmachers

Deep Reinforcement Learning (DRL) algorithms have been successfully applied to a range of challenging control tasks. However, these methods typically suffer from three core difficulties: temporal credit assignment with sparse rewards, lack…

Machine Learning · Computer Science 2018-10-30 Shauharda Khadka , Kagan Tumer

Most meta reinforcement learning (meta-RL) methods learn to adapt to new tasks by directly optimizing the parameters of policies over primitive action space. Such algorithms work well in tasks with relatively slight difference. However,…

Machine Learning · Computer Science 2020-03-05 Haotian Fu , Hongyao Tang , Jianye Hao , Wulong Liu , Chen Chen

Hierarchical policies enable strong performance in many sequential decision-making problems, such as those with high-dimensional action spaces, those requiring long-horizon planning, and settings with sparse rewards. However, learning…

Machine Learning · Computer Science 2025-03-19 Carolin Schmidt , Daniele Gammelli , James Harrison , Marco Pavone , Filipe Rodrigues

Large language models (LLMs) are increasingly adopted as the backbone of recommender systems. However, user-item interactions in real-world scenarios are non-stationary, making preference drift over time inevitable. Existing model update…

Information Retrieval · Computer Science 2026-03-24 Jin Zeng , Yupeng Qi , Hui Li , Chengming Li , Ziyu Lyu , Lixin Cui , Lu Bai

Hindsight Experience Replay (HER) is a technique used in reinforcement learning (RL) that has proven to be very efficient for training off-policy RL-based agents to solve goal-based robotic manipulation tasks using sparse rewards. Even…

With the rapid growth of user historical behavior data, user interest modeling has become a prominent aspect in Click-Through Rate (CTR) prediction, focusing on learning user intent representations. However, this complexity poses…

Information Retrieval · Computer Science 2025-05-09 Xin Song , Xiaochen Li , Jinxin Hu , Hong Wen , Zulong Chen , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Hierarchical Reinforcement Learning (HRL) approaches have shown successful results in solving a large variety of complex, structured, long-horizon problems. Nevertheless, a full theoretical understanding of this empirical evidence is…

Machine Learning · Computer Science 2025-02-05 Gianluca Drappo , Alberto Maria Metelli , Marcello Restelli

Manipulation in clutter requires solving complex sequential decision making problems in an environment rich with physical interactions. The transfer of motion planning solutions from simulation to the real world, in open-loop, suffers from…

Robotics · Computer Science 2018-07-30 Wissam Bejjani , Rafael Papallas , Matteo Leonetti , Mehmet R. Dogar

In this paper, a new swarm intelligence algorithm based on orca behaviors is proposed for problem solving. The algorithm called artificial orca algorithm (AOA) consists of simulating the orca lifestyle and in particular the social…

Neural and Evolutionary Computing · Computer Science 2023-02-20 Habiba Drias , Lydia Sonia Bendimerad , Yassine Drias

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

In robust optimization problems, the magnitude of perturbations is relatively small. Consequently, solutions within certain regions are less likely to represent the robust optima when perturbations are introduced. Hence, a more efficient…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Wei Du , Wenxuan Fang , Chen Liang , Yang Tang , Yaochu Jin

We consider a hybrid reinforcement learning setting (Hybrid RL), in which an agent has access to an offline dataset and the ability to collect experience via real-world online interaction. The framework mitigates the challenges that arise…

Machine Learning · Computer Science 2023-03-14 Yuda Song , Yifei Zhou , Ayush Sekhari , J. Andrew Bagnell , Akshay Krishnamurthy , Wen Sun

Reinforcement learning (RL) agents often suffer from high sample complexity in sparse or delayed reward settings due to limited prior structure. Large language models (LLMs) can provide subgoal decompositions, plausible trajectories, and…

Machine Learning · Computer Science 2026-02-23 Narjes Nourzad , Carlee Joe-Wong

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

We provide a general mechanism to design online learning algorithms based on a minimax analysis within a drifting-games framework. Different online learning settings (Hedge, multi-armed bandit problems and online convex optimization) are…

Machine Learning · Computer Science 2014-10-31 Haipeng Luo , Robert E. Schapire

Offline policy evaluation (OPE) allows us to evaluate and estimate a new sequential decision-making policy's performance by leveraging historical interaction data collected from other policies. Evaluating a new policy online without a…

Machine Learning · Computer Science 2024-11-04 Allen Nie , Yash Chandak , Christina J. Yuan , Anirudhan Badrinath , Yannis Flet-Berliac , Emma Brunskil

This paper studies an online optimization problem with a finite prediction window of cost functions and additional switching costs on decisions. We propose two gradient-based online algorithms: Receding Horizon Gradient Descent (RHGD), and…

Optimization and Control · Mathematics 2020-03-10 Yingying Li , Guannan Qu , Na Li

After the repeal of Roe vs. Wade in June 2022, women face long-distance travel across state lines to access abortion care. For women who also face socioeconomic hardship, travel for abortion care is a significant burden. To ease this…

Systems and Control · Electrical Eng. & Systems 2024-06-11 Shriya Karam , Lauren Shanos , Jessica Ford , Lorenzo Castaneda , Megan S. Ryerson , Rakesh Vohra

Metaheuristics (MHs) in general and Evolutionary Algorithms (EAs) in particular are well known tools for successful optimization of difficult problems. But when is their application meaningful and how does one approach such a project as a…

Neural and Evolutionary Computing · Computer Science 2021-07-26 Wilfried Jakob