中文
相关论文

相关论文: Invariance to Quantile Selection in Distributional…

200 篇论文

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical…

机器人学 · 计算机科学 2023-12-06 Mohammad Safeea , Pedro Neto

As one of the latest fields of interest in both academia and industry, quantum computing has garnered significant attention. Among various topics in quantum computing, variational quantum circuits (VQC) have been noticed for their ability…

量子物理 · 物理学 2023-01-11 Won Joon Yun , Jae Pyoung Kim , Soyi Jung , Jae-Hyun Kim , Joongheon Kim

We observe that several existing policy gradient methods (such as vanilla policy gradient, PPO, A2C) may suffer from overly large gradients when the current policy is close to deterministic (even in some very simple environments), leading…

机器学习 · 计算机科学 2019-11-19 Chuheng Zhang , Yuanqi Li , Jian Li

Autonomous driving involves multiple, often conflicting objectives such as safety, efficiency, and comfort. In reinforcement learning (RL), these objectives are typically combined through weighted summation, which collapses their relative…

机器人学 · 计算机科学 2026-03-24 Ahmed Abouelazm , Jonas Michel , Daniel Bogdoll , Philip Schörner , J. Marius Zöllner

We study the adaption of Soft Actor-Critic (SAC), which is considered as a state-of-the-art reinforcement learning (RL) algorithm, from continuous action space to discrete action space. We revisit vanilla discrete SAC and provide an…

机器学习 · 计算机科学 2024-11-21 Haibin Zhou , Tong Wei , Zichuan Lin , junyou li , Junliang Xing , Yuanchun Shi , Li Shen , Chao Yu , Deheng Ye

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

多智能体系统 · 计算机科学 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

This work studies the intersection of continual and federated learning, in which independent agents face unique tasks in their environments and incrementally develop and share knowledge. We introduce a mathematical framework capturing the…

机器学习 · 计算机科学 2024-12-24 Long Le , Marcel Hussing , Eric Eaton

Revenue-optimal auction design is a challenging problem with significant theoretical and practical implications. Sequential auction mechanisms, known for their simplicity and strong strategyproofness guarantees, are often limited by…

计算机科学与博弈论 · 计算机科学 2024-07-12 Sai Srivatsa Ravindranath , Zhe Feng , Di Wang , Manzil Zaheer , Aranyak Mehta , David C. Parkes

Reinforcement learning algorithms are known to be sample inefficient, and often performance on one task can be substantially improved by leveraging information (e.g., via pre-training) on other related tasks. In this work, we propose a…

机器学习 · 计算机科学 2019-10-15 Jonathan Lebensold , William Hamilton , Borja Balle , Doina Precup

Motivated by the recent applications of game-theoretical learning techniques to the design of distributed control systems, we study a class of control problems that can be formulated as potential games with continuous action sets, and we…

最优化与控制 · 数学 2014-12-03 Steven Perkins , Panayotis Mertikopoulos , David S. Leslie

The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other…

人工智能 · 计算机科学 2023-10-19 Jianlan Luo , Perry Dong , Jeffrey Wu , Aviral Kumar , Xinyang Geng , Sergey Levine

While there has been substantial success for solving continuous control with actor-critic methods, simpler critic-only methods such as Q-learning find limited application in the associated high-dimensional action spaces. However, most…

We study a sequential prediction problem in which an adversary is allowed to inject arbitrarily many adversarial instances in a stream of i.i.d. instances, but at each round, the learner may also abstain from making a prediction without…

机器学习 · 计算机科学 2026-03-19 Jialin Yu , Moïse Blanchard

We propose a novel distributionally robust $Q$-learning algorithm for the non-tabular case accounting for continuous state spaces where the state transition of the underlying Markov decision process is subject to model uncertainty. The…

机器学习 · 计算机科学 2025-05-27 Chung I Lu , Julian Sester , Aijia Zhang

The synergies between Quality-Diversity (QD) and Deep Reinforcement Learning (RL) have led to powerful hybrid QD-RL algorithms that have shown tremendous potential, and brings the best of both fields. However, only a single deep RL…

机器学习 · 计算机科学 2023-03-14 Bryan Lim , Manon Flageat , Antoine Cully

Consider the problem of training robustly capable agents. One approach is to generate a diverse collection of agent polices. Training can then be viewed as a quality diversity (QD) optimization problem, where we search for a collection of…

机器学习 · 计算机科学 2022-04-18 Bryon Tjanaka , Matthew C. Fontaine , Julian Togelius , Stefanos Nikolaidis

Applied Difference-in-Differences studies often involve outcomes that are discrete, mixed, censored, or otherwise non-continuously distributed, while policy questions frequently concern distributional effects rather than mean effects alone.…

计量经济学 · 经济学 2026-05-22 Nelly K. Djuazon , Emmanuel Selorm Tsyawo

We consider the distributed resource selection problem in Vehicle-to-vehicle (V2V) communication in the absence of a base station. Each vehicle autonomously selects transmission resources from a pool of shared resources to disseminate…

网络与互联网体系结构 · 计算机科学 2020-10-13 Alperen Gündogan , H. Murat Gürsu , Volker Pauli , Wolfgang Kellerer

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

机器学习 · 计算机科学 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

Massive practical works addressed by Deep Q-network (DQN) algorithm have indicated that stochastic policy, despite its simplicity, is the most frequently used exploration approach. However, most existing stochastic exploration approaches…

机器学习 · 计算机科学 2022-06-22 Wenhui Huang , Cong Zhang , Jingda Wu , Xiangkun He , Jie Zhang , Chen Lv