English
Related papers

Related papers: Approximate Dynamic Programming for a Remanufactur…

200 papers

Autonomous Mobility-on-Demand (AMoD) services offer an opportunity for improving passenger service while reducing pollution and energy consumption through effective vehicle coordination. A primary challenge in the autonomous fleets…

Optimization and Control · Mathematics 2025-07-08 Xinling Li , Xiaotong Guo , Qingyi Wang , Gioele Zardini , Jinhua Zhao

Reinforcement finetuning (RFT) has shown great potential for enhancing the mathematical reasoning capabilities of large language models (LLMs), but it is often sample- and compute-inefficient, requiring extensive training. In this work, we…

Machine Learning · Computer Science 2026-02-03 Taiwei Shi , Yiyang Wu , Linxin Song , Tianyi Zhou , Jieyu Zhao

The proximal policy optimization (PPO) algorithm stands as one of the most prosperous methods in the field of reinforcement learning (RL). Despite its success, the theoretical understanding of PPO remains deficient. Specifically, it is…

Machine Learning · Computer Science 2023-06-09 Han Zhong , Tong Zhang

E-commerce operations are essentially online, with customer orders arriving dynamically. However, very little is known about the performance of online policies for warehousing with respect to optimality, particularly for order picking and…

Optimization and Control · Mathematics 2026-02-19 Catherine Lorenz , Alena Otto , Michel Gendreau

This paper presents a new formulation for model-free robust optimal regulation of continuous-time nonlinear systems. The proposed reinforcement learning based approach, referred to as incremental adaptive dynamic programming (IADP),…

Systems and Control · Electrical Eng. & Systems 2022-03-25 Cong Li , Yongchao Wang , Fangzhou Liu , Qingchen Liu , Martin Buss

While many theoretical works concerning Adaptive Dynamic Programming (ADP) have been proposed, application results are scarce. Therefore, we design an ADP-based optimal trajectory tracking controller and apply it to a large-scale…

Systems and Control · Electrical Eng. & Systems 2021-01-26 Florian Köpf , Sean Kille , Jairo Inga , Sören Hohmann

This letter presents a method to reduce the computational demands of including second-order dynamics sensitivity information into the Differential Dynamic Programming (DDP) trajectory optimization algorithm. An approach to DDP is developed…

Robotics · Computer Science 2022-07-01 John N. Nganga , Patrick M. Wensing

The advent of smart manufacturing is addressing the limitations of traditional centralized scheduling and inflexible production line configurations in the rubber tyre industry, especially in terms of coping with dynamic production demands.…

Artificial Intelligence · Computer Science 2025-11-20 Yinghao Ruan , Wei Pang , Shuaihao Liu , Huili Yang , Leyi Han , Xinghui Dong

In this paper, we will develop a systematic approach to deriving guaranteed bounds for approximate dynamic programming (ADP) schemes in optimal control problems. Our approach is inspired by our recent results on bounding the performance of…

Optimization and Control · Mathematics 2014-03-31 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki , Bill Moran

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

Technology advancement for on-road vehicles has gained significant momentum in the past decades, particularly in the field of vehicle automation and powertrain electrification. The optimization of powertrain controls for autonomous vehicles…

Systems and Control · Electrical Eng. & Systems 2023-12-14 Mohammadali Kargar , Xingyong Song

This paper presents a constrained adaptive dynamic programming (CADP) algorithm to solve general nonlinear nonaffine optimal control problems with known dynamics. Unlike previous ADP algorithms, it can directly deal with problems with state…

Systems and Control · Electrical Eng. & Systems 2022-04-11 Jingliang Duan , Zhengyu Liu , Shengbo Eben Li , Qi Sun , Zhenzhong Jia , Bo Cheng

We propose and solve a stochastic dynamic programming (DP) problem addressing the optimal provision of regulation service reserves (RSR) by controlling dynamic demand preferences in smart buildings. A major contribution over past dynamic…

Systems and Control · Computer Science 2017-07-26 Bowen Zhang , Michael C. Caramanis , John Baillieul

The reliability of a system can be improved by the addition of redundant elements, giving rise to the well-known redundancy allocation problem (RAP). We propose a novel extension to the RAP called the Bi-Objective Integrated Design and…

Optimization and Control · Mathematics 2025-11-10 Luke Fairley , Rob Shone , Peter Jacko , Jefferson Huang

This paper introduces a new algorithm for trajectory optimization, Decoupled Reduced-space and Adaptive Feasibility-repair Trajectory Optimization (DRAFTO). It first constructs a constrained objective that accounts for smoothness, safety,…

Robotics · Computer Science 2026-03-13 Yichang Feng , Xiao Liang , Minghui Zheng

We consider the problem of policy transfer between two Markov Decision Processes (MDPs). We introduce a lemma based on existing theoretical results in reinforcement learning to measure the relativity gap between two arbitrary MDPs, that is…

Machine Learning · Computer Science 2024-01-25 Jiawei Xu , Cheng Zhou , Yizheng Zhang , Baoxiang Wang , Lei Han

For years, there has been interest in approximation methods for solving dynamic programming problems, because of the inherent complexity in computing optimal solutions characterized by Bellman's principle of optimality. A wide range of…

Optimization and Control · Mathematics 2020-06-18 Yajing Liu , Edwin Chong , Ali Pezeshki , Zhenliang Zhang

Multi-objective optimization models that encode ordered sequential constraints provide a solution to model various challenging problems including encoding preferences, modeling a curriculum, and enforcing measures of safety. A recently…

Artificial Intelligence · Computer Science 2022-09-16 Kyle Hollins Wray , Stas Tiomkin , Mykel J. Kochenderfer , Pieter Abbeel

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

We consider the Demand Strip Packing problem (DSP), in which we are given a set of jobs, each specified by a processing time and a demand. The task is to schedule all jobs such that they are finished before some deadline $D$ while…

Data Structures and Algorithms · Computer Science 2024-08-19 Franziska Eberle , Felix Hommelsheim , Malin Rau , Stefan Walzer