English
Related papers

Related papers: Bias-reduced Multi-step Hindsight Experience Repla…

200 papers

Hierarchical reinforcement learning (HRL) decomposes the policy into a manager and a worker, enabling long-horizon planning but introducing a performance gap on tasks requiring agility. We identify a root cause: in subgoal-based HRL, the…

Artificial Intelligence · Computer Science 2026-04-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Multi-behavior recommendation (MBR) aims to improve the performance w.r.t. the target behavior (i.e., purchase) by leveraging auxiliary behaviors (e.g., click, favourite). However, in real-world scenarios, a recommendation method often…

Information Retrieval · Computer Science 2026-01-13 Wenhao Lai , Weike Pan , Zhong Ming

Human Mesh Recovery (HMR) is the task of estimating a parameterized 3D human mesh from an image. There is a kind of methods first training a regression model for this problem, then further optimizing the pretrained regression model for any…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yongwei Nie , Mingxian Fan , Chengjiang Long , Qing Zhang , Jian Zhu , Xuemiao Xu

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL algorithm based on…

Systems and Control · Electrical Eng. & Systems 2021-06-08 Myoung Hoon Lee , Jun Moon

Recently, neural heuristics based on deep reinforcement learning have exhibited promise in solving multi-objective combinatorial optimization problems (MOCOPs). However, they are still struggling to achieve high learning efficiency and…

Machine Learning · Computer Science 2023-10-25 Jinbiao Chen , Jiahai Wang , Zizhen Zhang , Zhiguang Cao , Te Ye , Siyuan Chen

Hierarchy Of Multi-label classifiers (HOMER) is a multi-label learning algorithm that breaks the initial learning task to several, easier sub-tasks by first constructing a hierarchy of labels from a given label set and secondly employing a…

Machine Learning · Statistics 2016-12-31 Yannis Papanikolaou , Ioannis Katakis , Grigorios Tsoumakas

In class-incremental learning (CIL), effective incremental learning strategies are essential to mitigate task confusion and catastrophic forgetting, especially as the number of tasks $t$ increases. Current exemplar replay strategies impose…

Machine Learning · Computer Science 2025-05-19 Milad Khademi Nori , Il-Min Kim , Guanghui Wang

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

This paper presents a Multi-modal Emotion Recognition (MER) system designed to enhance emotion recognition accuracy in challenging acoustic conditions. Our approach combines a modified and extended Hierarchical Token-semantic Audio…

Sound · Computer Science 2025-07-30 Ohad Cohen , Gershon Hazan , Sharon Gannot

Continual Learning (CL) aims at incrementally learning new tasks without forgetting the knowledge acquired from old ones. Experience Replay (ER) is a simple and effective rehearsal-based strategy, which optimizes the model with current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Tao Zhuo , Zhiyong Cheng , Zan Gao , Hehe Fan , Mohan Kankanhalli

The advancement of deep learning has led to the emergence of Mixture-of-Experts (MoEs) models, known for their dynamic allocation of computational resources based on input. Despite their promise, MoEs face challenges, particularly in terms…

Computation and Language · Computer Science 2024-04-09 Alexandre Muzio , Alex Sun , Churan He

This work re-implements the OpenAI Gym multi-goal robotic manipulation environment, originally based on the commercial Mujoco engine, onto the open-source Pybullet engine. By comparing the performances of the Hindsight Experience…

Robotics · Computer Science 2023-03-10 Xintong Yang , Ze Ji , Jing Wu , Yu-Kun Lai

Long-horizon goal-conditioned tasks pose fundamental challenges for reinforcement learning (RL), particularly when goals are distant and rewards are sparse. While hierarchical and graph-based methods offer partial solutions, their reliance…

Machine Learning · Computer Science 2026-05-21 Jaebak Hwang , Sanghyeon Lee , Jeongmo Kim , Seungyul Han

In a multi-stage recommendation system, reranking plays a crucial role in modeling intra-list correlations among items. A key challenge lies in exploring optimal sequences within the combinatorial space of permutations. Recent research…

Information Retrieval · Computer Science 2025-10-30 Zhijie Lin , Zhuofeng Li , Chenglei Dai , Wentian Bao , Shuai Lin , Enyun Yu , Haoxiang Zhang , Liang Zhao

A crucial challenge in reinforcement learning is to reduce the number of interactions with the environment that an agent requires to master a given task. Transfer learning proposes to address this issue by re-using knowledge from previously…

Machine Learning · Computer Science 2023-04-28 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Model-based reinforcement learning (MBRL) has shown its advantages in sample-efficiency over model-free reinforcement learning (MFRL). Despite the impressive results it achieves, it still faces a trade-off between the ease of data…

Machine Learning · Computer Science 2020-06-17 Xiaoyu Tan , Chao Qu , Junwu Xiong , James Zhang

Designing effective reward functions in multi-agent reinforcement learning (MARL) is a significant challenge, often leading to suboptimal or misaligned behaviors in complex, coordinated environments. We introduce Multi-agent Reinforcement…

Multiagent Systems · Computer Science 2025-06-05 Ziyan Wang , Zhicheng Zhang , Fei Fang , Yali Du

Recent advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) have enabled powerful semantic and multimodal reasoning capabilities, creating new opportunities to enhance sample efficiency, high-level planning, and…

Machine Learning · Computer Science 2026-02-03 Elad Sharony , Tom Jurgenson , Orr Krupnik , Dotan Di Castro , Shie Mannor

We present a novel technique called Dynamic Experience Replay (DER) that allows Reinforcement Learning (RL) algorithms to use experience replay samples not only from human demonstrations but also successful transitions generated by RL…

Artificial Intelligence · Computer Science 2020-10-19 Jieliang Luo , Hui Li

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model-free methods. Unfortunately, the sample…

Machine Learning · Computer Science 2021-07-20 Aske Plaat , Walter Kosters , Mike Preuss