English
Related papers

Related papers: Smart Predict-then-Optimize Method with Dependent …

200 papers

We introduce Self-correction Relative Policy Optimization (ScRPO), a novel reinforcement learning framework designed to empower large language models with advanced mathematical reasoning capabilities through iterative self-reflection and…

Artificial Intelligence · Computer Science 2026-01-06 Lianrui Li , Dakuan Lu , Jiawei Shao , Xuelong Li

This paper introduces a hybrid framework for portfolio optimization that fuses Long Short-Term Memory (LSTM) forecasting with a Proximal Policy Optimization (PPO) reinforcement learning strategy. The proposed system leverages the predictive…

Machine Learning · Computer Science 2025-11-25 Jun Kevin , Pujianto Yugopuspito

Fund allocation has been an increasingly important problem in the financial domain. In reality, we aim to allocate the funds to buy certain assets within a certain future period. Naive solutions such as prediction-only or…

Machine Learning · Computer Science 2025-07-18 Fuyuan Lyu , Linfeng Du , Yunpeng Weng , Qiufang Ying , Zhiyan Xu , Wen Zou , Haolun Wu , Xiuqiang He , Xing Tang

Robots often have to operate in discrete partially observable worlds, where the states of world are only observable at runtime. To react to different world states, robots need contingencies. However, computing contingencies is costly and…

Robotics · Computer Science 2023-09-20 Janis Eric Freund , Camille Phiquepal , Andreas Orthey , Marc Toussaint

Model-free adaptive optimization methods are capable of optimizing unknown, time-varying processes even when other optimization methods are not. However, their practical application is often limited by perturbations that are used to gather…

Systems and Control · Electrical Eng. & Systems 2025-08-28 Leontine Aarnoudse , Mark Haring , Nathan van de Wouw , Alexey Pavlov

Offline model-based optimization (MBO) seeks to discover high-performing designs using only a fixed dataset of past evaluations. Most existing methods rely on learning a surrogate model via regression and implicitly assume that good…

Machine Learning · Computer Science 2026-03-05 Shen-Huan Lyu , Rong-Xi Tan , Ke Xue , Yi-Xiao He , Yu Huang , Qingfu Zhang , Chao Qian

Automated hyperparameter optimization (HPO) can support practitioners to obtain peak performance in machine learning models. However, there is often a lack of valuable insights into the effects of different hyperparameters on the final…

Machine Learning · Computer Science 2022-01-27 Julia Moosbauer , Julia Herbinger , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

Consensus-based optimization (CBO) is a powerful and versatile zero-order multi-particle method designed to provably solve high-dimensional global optimization problems, including those that are genuinely nonconvex or nonsmooth. The method…

Optimization and Control · Mathematics 2026-02-13 Massimo Fornasier , Hui Huang , Jona Klemenc , Greta Malaspina

This paper proposes Proximal Policy Optimization with Linear Temporal Logic Constraints (PPO-LTL), a framework that integrates safety constraints written in LTL into PPO for safe reinforcement learning. LTL constraints offer rigorous…

Machine Learning · Computer Science 2026-03-03 Maifang Zhang , Hang Yu , Qian Zuo , Cheng Wang , Vaishak Belle , Fengxiang He

Existing methods for vision-language task planning excel in short-horizon tasks but often fall short in complex, long-horizon planning within dynamic environments. These challenges primarily arise from the difficulty of effectively training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xiwen Liang , Min Lin , Weiqi Ruan , Rongtao Xu , Yuecheng Liu , Jiaqi Chen , Bingqian Lin , Yuzheng Zhuang , Xiaodan Liang

We propose a statistically optimal approach to construct data-driven decisions for stochastic optimization problems. Fundamentally, a data-driven decision is simply a function that maps the available training data to a feasible action. It…

Optimization and Control · Mathematics 2023-12-18 Tobias Sutter , Bart P. G. Van Parys , Daniel Kuhn

Proximal Policy Optimization (PPO) is among the most widely used algorithms in reinforcement learning, which achieves state-of-the-art performance in many challenging problems. The keys to its success are the reliable policy updates through…

Machine Learning · Computer Science 2021-07-02 Mónika Farsang , Luca Szegletes

This study introduces a novel computational framework for Robust Topology Optimization (RTO) considering imprecise random field parameters. Unlike the worst-case approach, the present method provides upper and lower bounds for the mean and…

Computational Engineering, Finance, and Science · Computer Science 2022-01-28 Kang Gao , Duy Minh Doc , Sheng Chu , Gang Wu , H. Alicia Kim , Carol A. Featherston

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO) are among the most successful policy gradient approaches in deep reinforcement learning (RL). While these methods achieve state-of-the-art performance across a…

Machine Learning · Computer Science 2020-06-22 Ahmed Touati , Amy Zhang , Joelle Pineau , Pascal Vincent

Existing approaches to online convex optimization (OCO) make sequential one-slot-ahead decisions, which lead to (possibly adversarial) losses that drive subsequent decision iterates. Their performance is evaluated by the so-called regret…

Systems and Control · Computer Science 2017-11-22 Tianyi Chen , Qing Ling , Georgios B. Giannakis

The idea of iterative process optimization based on collected output measurements, or "real-time optimization" (RTO), has gained much prominence in recent decades, with many RTO algorithms being proposed, researched, and developed. While…

Optimization and Control · Mathematics 2013-08-14 Gene A. Bunin , Grégory François , Dominique Bonvin

We study differentially private (DP) algorithms for stochastic convex optimization (SCO). In this problem the goal is to approximately minimize the population loss given i.i.d. samples from a distribution over convex and Lipschitz loss…

Machine Learning · Computer Science 2019-08-28 Raef Bassily , Vitaly Feldman , Kunal Talwar , Abhradeep Thakurta

Stochastic computer simulations enable users to gain new insights into complex physical systems. Optimization is a common problem in this context: users seek to find model inputs that maximize the expected value of an objective function.…

Optimization and Control · Mathematics 2018-09-13 Atiye Alaeddini , Daniel J. Klein

Clinical trials are essential to drug development but time-consuming, costly, and prone to failure. Accurate trial outcome prediction based on historical trial data promises better trial investment decisions and more trial success. Existing…

Machine Learning · Computer Science 2023-04-12 Zifeng Wang , Cao Xiao , Jimeng Sun

This paper studies the performative prediction problem which optimizes a stochastic loss function with data distribution that depends on the decision variable. We consider a setting where the agent(s) provides samples adapted to the…

Optimization and Control · Mathematics 2021-10-05 Qiang Li , Hoi-To Wai