English
Related papers

Related papers: Generalized Per-Agent Advantage Estimation for Mul…

200 papers

Applying deep reinforcement learning (RL) on real systems suffers from slow data sampling. We propose an enhanced generative adversarial network (EGAN) to initialize an RL agent in order to achieve faster learning. The EGAN utilizes the…

Artificial Intelligence · Computer Science 2017-05-30 Vincent Huang , Tobias Ley , Martha Vlachou-Konchylaki , Wenfeng Hu

In this paper, we propose multi-agent automated machine learning (MA2ML) with the aim to effectively handle joint optimization of modules in automated machine learning (AutoML). MA2ML takes each machine learning module, such as data…

Machine Learning · Computer Science 2022-10-18 Zhaozhi Wang , Kefan Su , Jian Zhang , Huizhu Jia , Qixiang Ye , Xiaodong Xie , Zongqing Lu

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Machine learning methods often assume that input features are available at no cost. However, in domains like healthcare, where acquiring features could be expensive or harmful, it is necessary to balance a feature's acquisition cost against…

Machine Learning · Statistics 2025-04-18 Henrik von Kleist , Alireza Zamanian , Ilya Shpitser , Narges Ahmidi

We present a new algorithm for amortized inference in sparse probabilistic graphical models (PGMs), which we call $\Delta$-amortized inference ($\Delta$-AI). Our approach is based on the observation that when the sampling of variables in a…

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

The Centralized Training with Decentralized Execution (CTDE) paradigm has gained significant attention in multi-agent reinforcement learning (MARL) and is the foundation of many recent algorithms. However, decentralized policies operate…

Multiagent Systems · Computer Science 2025-08-19 Zhuofan Xu , Benedikt Bollig , Matthias Függer , Thomas Nowak , Vincent Le Dréau

In reinforcement learning (RL), we always expect the agent to explore as many states as possible in the initial stage of training and exploit the explored information in the subsequent stage to discover the most returnable trajectory. Based…

Machine Learning · Computer Science 2020-09-16 Yubo Huang , Xuechun Wang , Luobao Zou , Zhiwei Zhuang , Weidong Zhang

In this work, we propose and explore Deep Graph Value Network (DeepGV) as a promising method to work around sample complexity in deep reinforcement-learning agents using a message-passing mechanism. The main idea is that the agent should be…

Artificial Intelligence · Computer Science 2021-10-22 Mingxuan Li , Michael L. Littman

Group-based policy optimization methods like GRPO and GSPO have become standard for training multimodal models, leveraging group-wise rollouts and relative advantage estimation. However, they suffer from a critical \emph{gradient vanishing}…

Machine Learning · Computer Science 2025-11-25 Zengjie Hu , Jiantao Qiu , Tianyi Bai , Haojin Yang , Binhang Yuan , Qi Jing , Conghui He , Wentao Zhang

General Value Functions (GVFs) (Sutton et al., 2011) represent predictive knowledge in reinforcement learning. Each GVF computes the expected return for a given policy, based on a unique reward. Existing methods relying on fixed behavior…

Machine Learning · Computer Science 2024-10-15 Arushi Jain , Josiah P. Hanna , Doina Precup

For many applications, an ensemble of base classifiers is an effective solution. The tuning of its parameters(number of classes, amount of data on which each classifier is to be trained on, etc.) requires G, the generalization error of a…

The exploration mechanism used by a Deep Reinforcement Learning (RL) agent plays a key role in determining its sample efficiency. Thus, improving over random exploration is crucial to solve long-horizon tasks with sparse rewards. We propose…

Machine Learning · Computer Science 2019-12-17 Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , Animesh Garg

We study the problem of learning a good set of policies, so that when combined together, they can solve a wide variety of unseen reinforcement learning tasks with no or very little new data. Specifically, we consider the framework of…

Machine Learning · Computer Science 2022-03-16 Safa Alver , Doina Precup

Recent advances in reinforcement learning have inspired increasing interest in learning user modeling adaptively through dynamic interactions, e.g., in reinforcement learning based recommender systems. Reward function is crucial for most of…

Machine Learning · Computer Science 2021-05-06 Xiaocong Chen , Lina Yao , Xianzhi Wang , Aixin Sun , Wenjie Zhang , Quan Z. Sheng

This paper introduces a novel agent-based approach for enhancing existing portfolio strategies using Proximal Policy Optimization (PPO). Rather than focusing solely on traditional portfolio construction, our approach aims to improve an…

Portfolio Management · Quantitative Finance 2025-02-06 Daniil Karzanov , Rubén Garzón , Mikhail Terekhov , Caglar Gulcehre , Thomas Raffinot , Marcin Detyniecki

In Multi-Goal Reinforcement Learning, an agent learns to achieve multiple goals with a goal-conditioned policy. During learning, the agent first collects the trajectories into a replay buffer, and later these trajectories are selected…

Machine Learning · Computer Science 2020-05-26 Rui Zhao , Xudong Sun , Volker Tresp

Student performance prediction is a critical research problem to understand the students' needs, present proper learning opportunities/resources, and develop the teaching quality. However, traditional machine learning methods fail to…

Machine Learning · Computer Science 2021-12-23 Yinkai Wang , Aowei Ding , Kaiyi Guan , Shixi Wu , Yuanqi Du

This paper presents an algorithmic framework for learning robust policies in asymmetric imperfect-information games, where the joint reward could depend on the uncertain opponent type (a private information known only to the opponent itself…

Artificial Intelligence · Computer Science 2020-03-05 Macheng Shen , Jonathan P. How

While multiagent systems have shown promise for tackling complex tasks via specialization, finetuning multiple agents simultaneously faces two key challenges: (1) credit assignment across agents, and (2) sample efficiency of expensive…

Artificial Intelligence · Computer Science 2026-02-05 Ed Li , Junyu Ren , Cat Yan