English
Related papers

Related papers: Discrete Probabilistic Inference as Control in Mul…

200 papers

Direct optimization is an appealing framework that replaces integration with optimization of a random objective for approximating gradients in models with discrete random variables. A$^\star$ sampling is a framework for optimizing such…

Machine Learning · Computer Science 2020-10-26 Guy Lorberbom , Chris J. Maddison , Nicolas Heess , Tamir Hazan , Daniel Tarlow

Diffusion models generate samples through an iterative denoising process, guided by a neural network. While training the denoiser on real-world data is computationally demanding, the sampling procedure itself is more flexible. This…

Machine Learning · Computer Science 2026-02-10 Constant Bourdrez , Alexandre Vérine , Olivier Cappé

This paper studies the problem of data collection for policy evaluation in Markov decision processes (MDPs). In policy evaluation, we are given a target policy and asked to estimate the expected cumulative reward it will obtain in an…

Machine Learning · Computer Science 2022-06-22 Subhojyoti Mukherjee , Josiah P. Hanna , Robert Nowak

Maximum entropy models provide the least constrained probability distributions that reproduce statistical properties of experimental datasets. In this work we characterize the learning dynamics that maximizes the log-likelihood in the case…

Disordered Systems and Neural Networks · Physics 2016-09-21 Ulisse Ferrari

Enhancing the diversity of policies is beneficial for robustness, exploration, and transfer in reinforcement learning (RL). In this paper, we aim to seek diverse policies in an under-explored setting, namely RL tasks with structured action…

Machine Learning · Computer Science 2023-02-24 Wenhao Li , Baoxiang Wang , Shanchao Yang , Hongyuan Zha

Optimal decision making with limited or no information in stochastic environments where multiple agents interact is a challenging topic in the realm of artificial intelligence. Reinforcement learning (RL) is a popular approach for arriving…

Machine Learning · Computer Science 2019-01-08 Roi Ceren

While most approaches to the problem of Inverse Reinforcement Learning (IRL) focus on estimating a reward function that best explains an expert agent's policy or demonstrated behavior on a control task, it is often the case that such…

Machine Learning · Computer Science 2020-05-01 Dexter R. R. Scobee , S. Shankar Sastry

The goal of this paper is to study a distributed version of the gradient temporal-difference (GTD) learning algorithm for multi-agent Markov decision processes (MDPs). The temporal difference (TD) learning is a reinforcement learning (RL)…

Optimization and Control · Mathematics 2018-08-23 Donghwan Lee , Hyungjin Yoon , Naira Hovakimyan

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

In this paper, we focus on solving a distributed convex optimization problem in a network, where each agent has its own convex cost function and the goal is to minimize the sum of the agents' cost functions while obeying the network…

Optimization and Control · Mathematics 2020-02-11 Shi Pu , Wei Shi , Jinming Xu , Angelia Nedić

Finding effective prompts for language models (LMs) is critical yet notoriously difficult: the prompt space is combinatorially large, rewards are sparse due to expensive target-LM evaluation. Yet, existing RL-based prompt optimizers often…

Artificial Intelligence · Computer Science 2026-02-04 Junmo Cho , Suhan Kim , Sangjune An , Minsu Kim , Dong Bok Lee , Heejun Lee , Sung Ju Hwang , Hae Beom Lee

In traditional reinforcement learning (RL), the learner aims to solve a single objective optimization problem: find the policy that maximizes expected reward. However, in many real-world settings, it is important to optimize over multiple…

Machine Learning · Computer Science 2025-02-18 Eric Eaton , Marcel Hussing , Michael Kearns , Aaron Roth , Sikata Bela Sengupta , Jessica Sorrell

We provide new perspectives and inference algorithms for Maximum Entropy (MaxEnt) Inverse Reinforcement Learning (IRL), which provides a principled method to find a most non-committal reward function consistent with given expert…

Machine Learning · Computer Science 2021-06-08 Aaron J. Snoswell , Surya P. N. Singh , Nan Ye

Reinforcement learning (RL) is attracting attention as an effective way to solve sequential optimization problems that involve high dimensional state/action space and stochastic uncertainties. Many such problems involve constraints…

Machine Learning · Computer Science 2021-04-01 Haeun Yoo , Victor M. Zavala , Jay H. Lee

Queuing network control is essential for managing congestion in job-processing systems such as service systems, communication networks, and manufacturing processes. Despite growing interest in applying reinforcement learning (RL)…

Machine Learning · Computer Science 2024-09-06 Ethan Che , Jing Dong , Hongseok Namkoong

Given a dataset of expert demonstrations, inverse reinforcement learning (IRL) aims to recover a reward for which the expert is optimal. This work proposes a model-free algorithm to solve entropy-regularized IRL problem. In particular, we…

Machine Learning · Computer Science 2025-03-04 Titouan Renard , Andreas Schlaginhaufen , Tingting Ni , Maryam Kamgarpour

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

We cast episodic Markov decision process (MDP) planning as Bayesian inference over policies. A policy is treated as the latent variable and is assigned an unnormalized probability of optimality that is monotone in its expected return,…

Machine Learning · Computer Science 2026-04-14 David Tolpin

Seeking to improve model generalization, we consider a new approach based on distributionally robust learning (DRL) that applies stochastic gradient descent to the outer minimization problem. Our algorithm efficiently estimates the gradient…

Machine Learning · Statistics 2020-12-24 Soumyadip Ghosh , Mark Squillante

This paper addresses a distributed optimization problem in a communication network where nodes are active sporadically. Each active node applies some learning method to control its action to maximize the global utility function, which is…

Optimization and Control · Mathematics 2021-04-20 Wenjie Li , Mohamad Assaad , Shiqi Zheng