English
Related papers

Related papers: Autoregressive Policy Optimization for Constrained…

200 papers

This work addresses competitive resource allocation in a sequential setting, where two players allocate resources across objects or locations of shared interest. Departing from the simultaneous Colonel Blotto game, our framework introduces…

Computer Science and Game Theory · Computer Science 2025-04-24 Omkar Thakoor , Rajgopal Kannan , Victor Prasanna

Solving large-scale robust portfolio optimization problems is challenging due to the high computational demands associated with an increasing number of assets, the amount of data considered, and market uncertainty. To address this issue, we…

Computational Finance · Quantitative Finance 2024-08-16 Chung-Han Hsieh , Jie-Ling Lu

To economically deploy robotic manipulators the programming and execution of robot motions must be swift. To this end, we propose a novel, constraint-based method to intuitively specify sequential manipulation tasks and to compute…

Robotics · Computer Science 2022-08-22 Mun Seng Phoon , Philipp S. Schmitt , Georg v. Wichert

We study the safe reinforcement learning problem with nonlinear function approximation, where policy optimization is formulated as a constrained optimization problem with both the objective and the constraint being nonconvex functions. For…

Machine Learning · Computer Science 2019-10-29 Ming Yu , Zhuoran Yang , Mladen Kolar , Zhaoran Wang

Edge computing has become a very popular service that enables mobile devices to run complex tasks with the help of network-based computing resources. However, edge clouds are often resource-constrained, which makes resource allocation a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-02 Caroline Rublein , Fidan Mehmeti , Mark Mahon , Thomas F. La Porta

In reinforcement learning (RL), it is often advantageous to consider additional constraints on the action space to ensure safety or action relevance. Existing work on such action-constrained RL faces challenges regarding effective policy…

Machine Learning · Computer Science 2025-12-01 Roland Stolz , Michael Eichelbeck , Matthias Althoff

Recent advances in constrained reinforcement learning (RL) have endowed reinforcement learning with certain safety guarantees. However, deploying existing constrained RL algorithms in continuous control tasks with general hard constraints…

Machine Learning · Computer Science 2023-12-22 Shutong Ding , Jingya Wang , Yali Du , Ye Shi

Online portfolio selection is an integral componentof wealth management. The fundamental undertaking is tomaximise returns while minimising risk given investor con-straints. We aim to examine and improve modern strategiesto generate higher…

Computational Engineering, Finance, and Science · Computer Science 2021-09-29 Matthew Kruger , Terence L. van Zyl , Andrew Paskaramoorthy

Autoregressive processes naturally arise in a large variety of real-world scenarios, including stock markets, sales forecasting, weather prediction, advertising, and pricing. When facing a sequential decision-making problem in such a…

Decision makers are increasingly relying on machine learning in sensitive situations. Algorithmic recourse aims to provide individuals with actionable and minimally costly steps to reverse unfavorable AI-driven decisions. While existing…

Artificial Intelligence · Computer Science 2026-05-12 Zahra Khotanlou , Kate Larson , Amir-Hossein Karimi

Stock portfolio optimization is the process of constant re-distribution of money to a pool of various stocks. In this paper, we will formulate the problem such that we can apply Reinforcement Learning for the task properly. To maintain a…

Machine Learning · Computer Science 2020-12-14 Le Trung Hieu

We propose a successive convex approximation based off-policy optimization (SCAOPO) algorithm to solve the general constrained reinforcement learning problem, which is formulated as a constrained Markov decision process (CMDP) in the…

Machine Learning · Computer Science 2022-04-20 Chang Tian , An Liu , Guang Huang , Wu Luo

Safety in goal directed Reinforcement Learning (RL) settings has typically been handled through constraints over trajectories and have demonstrated good performance in primarily short horizon tasks. In this paper, we are specifically…

Artificial Intelligence · Computer Science 2024-01-10 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham

We introduce a novel class of algorithms to efficiently approximate the unknown return distributions in policy evaluation problems from distributional reinforcement learning (DRL). The proposed distributional dynamic programming algorithms…

Machine Learning · Statistics 2024-07-22 Julian Gerstenberg , Ralph Neininger , Denis Spiegel

In this paper, the distributed resource allocation optimization problem is investigated. The allocation decisions are made to minimize the sum of all the agents' local objective functions while satisfying both the global network resource…

Optimization and Control · Mathematics 2017-04-11 Peng Yi , Yiguang Hong , Feng Liu

Recommender systems rely heavily on increasing computation resources to improve their business goal. By deploying computation-intensive models and algorithms, these systems are able to inference user interests and exhibit certain ads or…

Systems and Control · Electrical Eng. & Systems 2021-03-04 Xun Yang , Yunli Wang , Cheng Chen , Qing Tan , Chuan Yu , Jian Xu , Xiaoqiang Zhu

Safety-critical learning requires policies that improve performance without leaving the safe operating regime. We study constrained policy learning where model parameters must satisfy rollout-based safety constraints that can be evaluated…

Machine Learning · Computer Science 2026-05-21 Shengfan Cao , Francesco Borrelli , Eunhyek Joa

Recent developments in deep learning techniques have motivated intensive research in machine learning-aided stock trading strategies. However, since the financial market has a highly non-stationary nature hindering the application of…

Portfolio Management · Quantitative Finance 2020-12-15 Kentaro Imajo , Kentaro Minami , Katsuya Ito , Kei Nakagawa

Conventionally, the resource allocation is formulated as an optimization problem and solved online with instantaneous scenario information. Since most resource allocation problems are not convex, the optimal solutions are very difficult to…

Machine Learning · Computer Science 2017-12-20 Jun-Bo Wang , Junyuan Wang , Yongpeng Wu , Jin-Yuan Wang , Huiling Zhu , Min Lin , Jiangzhou Wang

Continual learning (CL) requires models to continuously adapt to new tasks without forgetting past knowledge. In this work, we propose \underline{P}roactive \underline{L}ow-rank \underline{A}llocatio\underline{N} (PLAN), a framework that…

Machine Learning · Computer Science 2025-10-27 Xiequn Wang , Zhan Zhuang , Yu Zhang