English
Related papers

Related papers: Efficient Model-Based Concave Utility Reinforcemen…

200 papers

Reinforcement Learning (RL) has gained substantial attention across diverse application domains and theoretical investigations. Existing literature on RL theory largely focuses on risk-neutral settings where the decision-maker learns to…

Machine Learning · Computer Science 2024-12-24 Zhengqi Wu , Renyuan Xu

Learning-to-optimize (L2O) is an emerging research area in large-scale optimization with applications in data science. Recently, researchers have proposed a novel L2O framework called learned mirror descent (LMD), based on the classical…

Optimization and Control · Mathematics 2024-05-13 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Carola-Bibiane Schönlieb

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

Deep reinforcement learning (DRL) has recently shown its success in tackling complex combinatorial optimization problems. When these problems are extended to multiobjective ones, it becomes difficult for the existing DRL approaches to…

Artificial Intelligence · Computer Science 2022-02-15 Zizhen Zhang , Zhiyuan Wu , Hang Zhang , Jiahai Wang

The gloabal objective of inverse Reinforcement Learning (IRL) is to estimate the unknown cost function of some MDP base on observed trajectories generated by (approximate) optimal policies. The classical approach consists in tuning this…

Machine Learning · Computer Science 2021-05-26 Firas Jarboui , Vianney Perchet

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without further environment interaction. A key challenge is the distribution shift between the learned and behavior policies, leading to…

Machine Learning · Computer Science 2025-08-11 Haohui Chen , Zhiyong Chen

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

Constrained Markov Decision Processes are a class of stochastic decision problems in which the decision maker must select a policy that satisfies auxiliary cost constraints. This paper extends upper confidence reinforcement learning for…

Machine Learning · Computer Science 2020-01-28 Liyuan Zheng , Lillian J. Ratliff

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

Multi-objective reinforcement learning (MORL) is an extension of ordinary, single-objective reinforcement learning (RL) that is applicable to many real-world tasks where multiple objectives exist without known relative costs. We study the…

Machine Learning · Computer Science 2021-01-12 Dongruo Zhou , Jiahao Chen , Quanquan Gu

Mirror descent (MD), a well-known first-order method in constrained convex optimization, has recently been shown as an important tool to analyze trust-region algorithms in reinforcement learning (RL). However, there remains a considerable…

Machine Learning · Computer Science 2021-06-08 Manan Tomar , Lior Shani , Yonathan Efroni , Mohammad Ghavamzadeh

Multi-objective reinforcement learning (MORL) is the generalization of standard reinforcement learning (RL) approaches to solve sequential decision making problems that consist of several, possibly conflicting, objectives. Generally, in…

Artificial Intelligence · Computer Science 2019-10-08 Xi Chen , Ali Ghadirzadeh , Mårten Björkman , Patric Jensfelt

We consider the inverse reinforcement learning (IRL) problem, where an unknown reward function of some Markov decision process is estimated based on observed expert demonstrations. In most existing approaches, IRL is formulated and solved…

Machine Learning · Computer Science 2025-06-27 Hao Zhu , Yuan Zhang , Joschka Boedecker

This paper proposes a learning algorithm to find a scheduling policy that achieves an optimal delay-power trade-off in communication systems. Reinforcement learning (RL) is used to minimize the expected latency for a given energy constraint…

Systems and Control · Electrical Eng. & Systems 2020-06-11 Yu Zhao , Joohyun Lee , Wei Chen

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel…

Machine Learning · Statistics 2022-02-10 Yiyuan She , Jiahui Shen , Chao Zhang

Media streaming is the dominant application over wireless edge (access) networks. The increasing softwarization of such networks has led to efforts at intelligent control, wherein application-specific actions may be dynamically taken to…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Archana Bura , Sarat Chandra Bobbili , Shreyas Rameshkumar , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

Model predictive control (MPC) is a powerful technique for solving dynamic control tasks. In this paper, we show that there exists a close connection between MPC and online learning, an abstract theoretical framework for analyzing online…

Robotics · Computer Science 2019-10-10 Nolan Wagener , Ching-An Cheng , Jacob Sacks , Byron Boots

While Reinforcement Learning (RL) achieves tremendous success in sequential decision-making problems of many domains, it still faces key challenges of data inefficiency and the lack of interpretability. Interestingly, many researchers have…

Artificial Intelligence · Computer Science 2023-06-02 Yan Zeng , Ruichu Cai , Fuchun Sun , Libo Huang , Zhifeng Hao

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

Machine Learning · Computer Science 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar