中文
相关论文

相关论文: Parameter-Efficient Distributional RL via Normaliz…

200 篇论文

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard RL. At the…

最优化与控制 · 数学 2023-03-27 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

机器学习 · 计算机科学 2025-06-05 Raj Ghugare , Benjamin Eysenbach

A multi-agent deep reinforcement learning (DRL)-based model is presented in this study to reconstruct flow fields from noisy data. A combination of the reinforcement learning with pixel-wise rewards (PixelRL), physical constraints…

流体动力学 · 物理学 2023-09-28 Mustafa Z. Yousif , Meng Zhang , Yifan Yang , Haifeng Zhou , Linqi Yu , HeeChang Lim

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

人工智能 · 计算机科学 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

Chaotic dynamical systems pose a fundamental challenge for Reinforcement Learning (RL): exponential sensitivity to initial conditions induces high-variance bootstrap targets and poorly conditioned gradient updates. Chaotic dynamics arise…

机器学习 · 计算机科学 2026-05-29 James Rudd-Jones , Mirco Musolesi , María Pérez-Ortiz

This paper describes an effective and efficient image classification framework nominated distributed deep representation learning model (DDRL). The aim is to strike the balance between the computational intensive deep learning approaches…

计算机视觉与模式识别 · 计算机科学 2016-07-05 Le Dong , Na Lv , Qianni Zhang , Shanshan Xie , Ling He , Mengdie Mao

Reinforcement learning (RL) allows an agent interacting sequentially with an environment to maximize its long-term expected return. In the distributional RL (DistrRL) paradigm, the agent goes beyond the limit of the expected value, to…

机器学习 · 计算机科学 2023-05-01 Mastane Achab , Reda Alami , Yasser Abdelaziz Dahou Djilali , Kirill Fedyanin , Eric Moulines

We present a distributional approach to theoretical analyses of reinforcement learning algorithms for constant step-sizes. We demonstrate its effectiveness by presenting simple and unified proofs of convergence for a variety of…

机器学习 · 计算机科学 2020-03-30 Philip Amortila , Doina Precup , Prakash Panangaden , Marc G. Bellemare

Reinforcement Learning (RL) is increasingly applied to large-scale decision-making problems like logistics, scheduling, and recommender systems, but existing algorithms struggle with the curse of dimensionality in such large discrete action…

机器学习 · 计算机科学 2026-05-12 Heiko Hoppe , Fabian Akkerman , Wouter van Heeswijk , Maximilian Schiffer

Reinforcement learning is typically treated as a uniform, data-driven optimization process, where updates are guided by rewards and temporal-difference errors without explicitly exploiting global structure. In contrast, dynamic programming…

机器学习 · 计算机科学 2026-04-21 Ivo Nowak

While most reinforcement learning methods today flatten the distribution of future returns to a single scalar value, distributional RL methods exploit the return distribution to provide stronger learning signals and to enable applications…

机器学习 · 计算机科学 2026-03-05 Perry Dong , Chongyi Zheng , Chelsea Finn , Dorsa Sadigh , Benjamin Eysenbach

Action-constrained reinforcement learning (ACRL) is a popular approach for solving safety-critical and resource-allocation related decision making problems. A major challenge in ACRL is to ensure agent taking a valid action satisfying…

机器学习 · 计算机科学 2024-02-09 Janaka Chathuranga Brahmanage , Jiajing Ling , Akshat Kumar

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

机器学习 · 统计学 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Embedding the intrinsic symmetry of a flow system in training its machine learning algorithms has become a significant trend in the recent surge of their application in fluid mechanics. This paper leverages the geometric symmetry of a…

流体动力学 · 物理学 2025-06-04 Xuan Dai , Da Xu , Mengqi Zhang , Yantao Yang

With the increasing penetration of distributed energy resources, distributed optimization algorithms have attracted significant attention for power systems applications due to their potential for superior scalability, privacy, and…

系统与控制 · 电气工程与系统科学 2022-05-09 Sihan Zeng , Alyssa Kody , Youngdae Kim , Kibaek Kim , Daniel K. Molzahn

Most conventional Reinforcement Learning (RL) algorithms aim to optimize decision-making rules in terms of the expected returns. However, especially for risk management purposes, other risk-sensitive criteria such as the value-at-risk or…

机器学习 · 计算机科学 2012-03-19 Tetsuro Morimura , Masashi Sugiyama , Hisashi Kashima , Hirotaka Hachiya , Toshiyuki Tanaka

Distributional reinforcement learning, which focuses on learning the entire return distribution instead of only its expectation in standard RL, has demonstrated remarkable success in enhancing performance. Despite these advancements, our…

机器学习 · 计算机科学 2024-09-24 Ke Sun , Bei Jiang , Linglong Kong

The empirical success of distributional reinforcement learning (RL) highly relies on the choice of distribution divergence equipped with an appropriate distribution representation. In this paper, we propose \textit{Sinkhorn distributional…

机器学习 · 计算机科学 2024-10-16 Ke Sun , Yingnan Zhao , Wulong Liu , Bei Jiang , Linglong Kong

Although distributional reinforcement learning (DRL) has been widely examined in the past few years, there are two open questions people are still trying to address. One is how to ensure the validity of the learned quantile function, the…

机器学习 · 计算机科学 2021-05-17 Fan Zhou , Zhoufan Zhu , Qi Kuang , Liwen Zhang

We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…

流体动力学 · 物理学 2023-02-09 L. Guastoni , J. Rabault , P. Schlatter , H. Azizpour , R. Vinuesa