English
Related papers

Related papers: Optimistic {\epsilon}-Greedy Exploration for Coope…

200 papers

While in general trading off exploration and exploitation in reinforcement learning is hard, under some formulations relatively simple solutions exist. In this paper, we first derive upper bounds for the utility of selecting different…

Artificial Intelligence · Computer Science 2018-06-06 Christos Dimitrakakis

We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is…

Optimization and Control · Mathematics 2017-08-15 Xinmiao Sun , Christos G. Cassandras , Xiangyu Meng

Reinforcement learning (RL) for exponential-utility optimization in discounted Markov decision processes (MDPs) lacks principled value-based algorithms. We address this gap in the fixed risk-aversion setting. Building on the Bellman-type…

Machine Learning · Computer Science 2026-05-11 Gugan Thoppe , L. A. Prashanth , Ankur Naskar , Sanjay Bhat

We study the multi-armed bandit problem with subgaussian rewards. The explore-then-commit (ETC) strategy, which consists of an exploration phase followed by an exploitation phase, is one of the most widely used algorithms in a variety of…

Machine Learning · Computer Science 2020-11-20 Tianyuan Jin , Pan Xu , Xiaokui Xiao , Quanquan Gu

Despite being a relatively new communication technology, Low-Power Wide Area Networks (LPWANs) have shown their suitability to empower a major part of Internet of Things applications. Nonetheless, most LPWAN solutions are built on star…

Networking and Internet Architecture · Computer Science 2017-05-24 Sergio Barrachina-Muñoz , Boris Bellalta

Online reinforcement learning (RL) with complex function approximations such as transformers and deep neural networks plays a significant role in the modern practice of artificial intelligence. Despite its popularity and importance,…

Machine Learning · Computer Science 2025-06-30 Tong Yang , Bo Dai , Lin Xiao , Yuejie Chi

In this paper we propose an algorithm for polynomial-time reinforcement learning in factored Markov decision processes (FMDPs). The factored optimistic initial model (FOIM) algorithm, maintains an empirical model of the FMDP in a…

Artificial Intelligence · Computer Science 2009-04-23 Istvan Szita , Andras Lorincz

In this paper we propose a novel experimental design-based algorithm to minimize regret in online stochastic linear and combinatorial bandits. While existing literature tends to focus on optimism-based algorithms--which have been shown to…

Machine Learning · Computer Science 2021-03-02 Andrew Wagenmaker , Julian Katz-Samuels , Kevin Jamieson

Efficient learning in multi-armed bandit mechanisms such as pay-per-click (PPC) auctions typically involves three challenges: 1) inducing truthful bidding behavior (incentives), 2) using personalization in the users (context), and 3)…

Machine Learning · Computer Science 2023-07-18 Yinglun Xu , Bhuvesh Kumar , Jacob Abernethy

Autonomous exploration is an application of growing importance in robotics. A promising strategy is ergodic trajectory planning, whereby an agent spends in each area a fraction of time which is proportional to its probability information…

Optimization and Control · Mathematics 2021-07-06 Dimitris Gkouletsos , Andrea Iannelli , Mathias Hudoba de Badyn , John Lygeros

Online learning algorithms, widely used to power search and content optimization on the web, must balance exploration and exploitation, potentially sacrificing the experience of current users in order to gain information that will lead to…

Machine Learning · Computer Science 2021-12-28 Manish Raghavan , Aleksandrs Slivkins , Jennifer Wortman Vaughan , Zhiwei Steven Wu

We study a posterior sampling approach to efficient exploration in constrained reinforcement learning. Alternatively to existing algorithms, we propose two simple algorithms that are more efficient statistically, simpler to implement and…

Machine Learning · Computer Science 2022-09-09 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

A long line of works characterizes the sample complexity of regret minimization in sequential decision-making by min-max programs. In the corresponding saddle-point game, the min-player optimizes the sampling distribution against an…

Machine Learning · Computer Science 2024-03-18 Johannes Kirschner , Seyed Alireza Bakhtiari , Kushagra Chandak , Volodymyr Tkachuk , Csaba Szepesvári

Skill-based reinforcement learning (SBRL) enables rapid adaptation in environments with sparse rewards by pretraining a skill-conditioned policy. Effective skill learning requires jointly maximizing both exploration and skill diversity.…

Machine Learning · Computer Science 2026-03-17 Geonwoo Cho , Jaemoon Lee , Jaegyun Im , Subi Lee , Jihwan Lee , Sundong Kim

Cooperative game theory has diverse applications in contemporary artificial intelligence, including domains like interpretable machine learning, resource allocation, and collaborative decision-making. However, specifying a cooperative game…

Computer Science and Game Theory · Computer Science 2024-12-05 Filip Úradník , David Sychrovský , Jakub Černý , Martin Černý

Deep reinforcement learning (DRL) faces significant challenges in addressing the hard-exploration problems in tasks with sparse or deceptive rewards and large state spaces. These challenges severely limit the practical application of DRL.…

Machine Learning · Computer Science 2024-01-03 Guojian Wang , Faguo Wu , Xiao Zhang , Ning Guo , Zhiming Zheng

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and agent policy. By…

Machine Learning · Computer Science 2025-01-14 Liyuan Hu

Due to practical constraints such as partial observability and limited communication, Centralized Training with Decentralized Execution (CTDE) has become the dominant paradigm in cooperative Multi-Agent Reinforcement Learning (MARL).…

Artificial Intelligence · Computer Science 2026-03-16 Yueheng Li , Guangming Xie , Zongqing Lu

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

Numerical Analysis · Mathematics 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu

In multi-agent reinforcement learning (MARL), the centralized training with decentralized execution (CTDE) framework has gained widespread adoption due to its strong performance. However, the further development of CTDE faces two key…

Multiagent Systems · Computer Science 2024-12-25 Lunjun Liu , Weilai Jiang , Yaonan Wang