English
Related papers

Related papers: A Stochastic LQR Model for Child Order Placement i…

200 papers

We explore reinforcement learning methods for finding the optimal policy in the linear quadratic regulator (LQR) problem. In particular, we consider the convergence of policy gradient methods in the setting of known and unknown parameters.…

Machine Learning · Computer Science 2021-06-25 Ben Hambly , Renyuan Xu , Huining Yang

This paper investigates a stochastic inventory management problem in which a cash-constrained small retailer periodically purchases a product from suppliers and sells it to a market while facing non-stationary demands. In each period, the…

Optimization and Control · Mathematics 2021-08-13 Zhen Chen , Roberto Rossi

While reinforcement learning (RL) has been central to the recent success of large language models (LLMs), RL optimization is notoriously unstable, especially when compared to supervised fine-tuning (SFT). In this work, we investigate the…

Machine Learning · Computer Science 2026-03-03 Hongzhan Chen , Tao Yang , Yuhua Zhu , Shiping Gao , Xiaojun Quan , Ting Yao

Many robotics problems, from robot motion planning to object manipulation, can be modeled as mixed-integer convex programs (MICPs). However, state-of-the-art algorithms are still unable to solve MICPs for control problems quickly enough for…

Robotics · Computer Science 2021-07-20 A. Cauligi , P. Culbertson , E. Schmerling , M. Schwager , B. Stellato , M. Pavone

Reinforcement learning (RL) is an effective approach for solving optimal control problems without knowing the exact information of the system model. However, the classical Q-learning method, a model-free RL algorithm, has its limitations,…

Optimization and Control · Mathematics 2025-06-04 Xiushan Jiang , Weihai Zhang

Neural combinatorial optimization (NCO) has gained significant attention due to the potential of deep learning to efficiently solve combinatorial optimization problems. NCO has been widely applied to job shop scheduling problems (JSPs) with…

Artificial Intelligence · Computer Science 2024-12-19 Igor G. Smit , Yaoxin Wu , Pavel Troubil , Yingqian Zhang , Wim P. M. Nuijten

Self-Organizing Maps (SOM) are a classical method for unsupervised learning, vector quantization, and topographic mapping of high-dimensional data. However, existing SOM formulations often involve a trade-off between computational…

Machine Learning · Computer Science 2026-04-16 Seiki Ubukata , Akira Notsu , Katsuhiro Honda

One innovative solution to the last-mile delivery problem is the self-service locker system. Motivated by a real case in Singapore, we consider a POP-Locker Alliance who operates a set of POP-stations and wishes to improve the last-mile…

Optimization and Control · Mathematics 2020-02-25 Yun Hui Lin , Dongdong He , Yuan Wang , Loo Hay Lee

Offline reinforcement learning (RL) is a compelling framework for learning optimal policies from past experiences without additional interaction with the environment. Nevertheless, offline RL inevitably faces the problem of distributional…

Machine Learning · Computer Science 2024-04-09 Yeda Song , Dongwook Lee , Gunhee Kim

Robust optimization (RO) is one of the key paradigms for solving optimization problems affected by uncertainty. Two principal approaches for RO, the robust counterpart method and the adversarial approach, potentially lead to excessively…

Optimization and Control · Mathematics 2024-09-05 Krzysztof Postek , Shimrit Shtern

Learning to Optimize (LtO) is a problem setting in which a machine learning (ML) model is trained to emulate a constrained optimization solver. Learning to produce optimal and feasible solutions subject to complex constraints is a difficult…

Machine Learning · Computer Science 2024-03-18 James Kotary , Ferdinando Fioretto

The Container Relocation Problem (CRP) is concerned with finding a sequence of moves of containers that minimizes the number of relocations needed to retrieve all containers, while respecting a given order of retrieval. However, the…

Data Structures and Algorithms · Computer Science 2017-10-13 Virgile Galle , Setareh Borjian Boroujeni , Vahideh H. Manshadi , Cynthia Barnhart , Patrick Jaillet

This paper studies a limit order book (LOB) model, in which the order dynamics depend on both, the current best available prices and the current volume density functions. For the joint dynamics of the best bid price, the best ask price, and…

Mathematical Finance · Quantitative Finance 2016-05-23 Ulrich Horst , Dörte Kreher

Unlike traditional model-based reinforcement learning approaches that estimate system parameters from data, non-model-based data-driven control learns the optimal policy directly from input-state data without any intermediate model…

Optimization and Control · Mathematics 2026-05-05 Leilei Cui , Zhong-Ping Jiang , Petter N. Kolm , Grégoire G. Macqueron

In collaborative human-robot order picking systems, human pickers and Autonomous Mobile Robots (AMRs) travel independently through a warehouse and meet at pick locations where pickers load items onto the AMRs. In this paper, we consider an…

Optimal control provides a principled framework for transforming dynamical system models into intelligent decision-making, yet classical computational approaches are often too expensive for real-time deployment in dynamic or uncertain…

Optimization and Control · Mathematics 2026-01-01 Wuzhe Xu , Jiequn Han , Rongjie Lai

A new method for stochastic control based on neural networks and using randomisation of discrete random variables is proposed and applied to optimal stopping time problems. The method models directly the policy and does not need the…

Computational Finance · Quantitative Finance 2021-01-11 Thomas Deschatre , Joseph Mikael

We study the problem of private online learning, specifically, online prediction from experts (OPE) and online convex optimization (OCO). We propose a new transformation that transforms lazy online learning algorithms into private…

Machine Learning · Computer Science 2025-02-25 Hilal Asi , Tomer Koren , Daogao Liu , Kunal Talwar

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

Machine Learning · Computer Science 2020-06-16 Jun Song , Chaoyue Zhao

Algorithmic trading refers to executing buy and sell orders for specific assets based on automatically identified trading opportunities. Strategies based on reinforcement learning (RL) have demonstrated remarkable capabilities in addressing…

Trading and Market Microstructure · Quantitative Finance 2024-07-03 Xi Cheng , Jinghao Zhang , Yunan Zeng , Wenfang Xue