中文
相关论文

相关论文: Randomized Value Functions via Multiplicative Norm…

200 篇论文

Normalizing flows are deep generative models that allow efficient likelihood calculation and sampling. The core requirement for this advantage is that they are constructed using functions that can be efficiently inverted and for which the…

机器学习 · 计算机科学 2021-01-11 You Lu , Bert Huang

Value functions are central to Dynamic Programming and Reinforcement Learning but their exact estimation suffers from the curse of dimensionality, challenging the development of practical value-function (VF) estimation algorithms. Several…

人工智能 · 计算机科学 2021-04-20 Sergio Rozada , Victor Tenorio , Antonio G. Marques

Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelihood. However, data of interest are typically assumed to live…

机器学习 · 统计学 2021-11-04 Anthony L. Caterini , Gabriel Loaiza-Ganem , Geoff Pleiss , John P. Cunningham

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

机器学习 · 计算机科学 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which…

天体物理仪器与方法 · 物理学 2023-06-21 Héctor J. Hortúa , Luz Ángela García , Leonardo Castañeda C

Among the many variants of RL, an important class of problems is where the state and action spaces are continuous -- autonomous robots, autonomous vehicles, optimal control are all examples of such problems that can lend themselves…

人工智能 · 计算机科学 2024-10-16 Rajesh Mangannavar , Gopalakrishnan Srinivasaraghavan

We study the optimal control of mean-field systems with heterogeneous and asymmetric interactions. This leads to considering a family of controlled Brownian diffusion processes with dynamics depending on the whole collection of marginal…

概率论 · 数学 2024-07-29 Anna De Crescenzo , Marco Fuhrman , Idris Kharroubi , Huyên Pham

We propose the Value Gradient Sampler (VGS), a diffusion sampler parameterized by value functions. VGS generates samples from an unnormalized target density (i.e., energy) by evolving randomly initialized particles along the gradient of the…

Bayesian posterior inference is prevalent in various machine learning problems. Variational inference provides one way to approximate the posterior distribution, however its expressive power is limited and so is the accuracy of resulting…

机器学习 · 计算机科学 2018-07-11 Guoqing Zheng , Yiming Yang , Jaime Carbonell

Many large MDPs can be represented compactly using a dynamic Bayesian network. Although the structure of the value function does not retain the structure of the process, recent work has shown that value functions in factored MDPs can often…

人工智能 · 计算机科学 2013-01-18 Daphne Koller , Ron Parr

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

概率论 · 数学 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

In many real-world multi-agent cooperative tasks, due to high cost and risk, agents cannot continuously interact with the environment and collect experiences during learning, but have to learn from offline datasets. However, the transition…

机器学习 · 计算机科学 2023-08-01 Jiechuan Jiang , Zongqing Lu

This work adopts the very successful distributional perspective on reinforcement learning and adapts it to the continuous control setting. We combine this within a distributed framework for off-policy learning in order to develop what we…

In addition to their undisputed success in solving classical optimization problems, neuroevolutionary and population-based algorithms have become an alternative to standard reinforcement learning methods. However, evolutionary methods often…

神经与进化计算 · 计算机科学 2021-05-18 Jörg Stork , Martin Zaefferer , Nils Eisler , Patrick Tichelmann , Thomas Bartz-Beielstein , A. E. Eiben

We introduce a simple and effective method for regularizing large convolutional neural networks. We replace the conventional deterministic pooling operations with a stochastic procedure, randomly picking the activation within each pooling…

机器学习 · 计算机科学 2013-01-17 Matthew D. Zeiler , Rob Fergus

Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory,…

机器学习 · 统计学 2024-02-27 Daniel Andrade

Value function factorization has achieved great success in multi-agent reinforcement learning by optimizing joint action-value functions through the maximization of factorized per-agent utilities. To ensure Individual-Global-Maximum…

多智能体系统 · 计算机科学 2023-12-27 Huiqun Li , Hanhan Zhou , Yifei Zou , Dongxiao Yu , Tian Lan

We investigate the problem of distributed training under partial observability, whereby cooperative multi-agent reinforcement learning agents (MARL) maximize the expected cumulative joint reward. We propose distributed value decomposition…

机器学习 · 计算机科学 2025-02-12 Guilherme S. Varela , Alberto Sardinha , Francisco S. Melo

Randomization is a powerful tool that endows algorithms with remarkable properties. For instance, randomized algorithms excel in adversarial settings, often surpassing the worst-case performance of deterministic algorithms with large…

机器学习 · 计算机科学 2024-08-21 Johannes von Oswald , Seijin Kobayashi , Yassir Akram , Angelika Steger

This work develops a fully decentralized multi-agent algorithm for policy evaluation. The proposed scheme can be applied to two distinct scenarios. In the first scenario, a collection of agents have distinct datasets gathered following…

机器学习 · 计算机科学 2019-08-13 Lucas Cassano , Kun Yuan , Ali H. Sayed