English
Related papers

Related papers: Offline Deep Reinforcement Learning for Dynamic Pr…

200 papers

We study offline dynamic pricing when historical data provide incomplete coverage of the price space such that some candidate prices, including the optimal one, may be entirely unobserved. This setting is common in practice and is…

Machine Learning · Statistics 2026-05-25 Zeyu Bian , Lan Wang , Zhengling Qi

An automatic program that generates constant profit from the financial market is lucrative for every market practitioner. Recent advance in deep reinforcement learning provides a framework toward end-to-end training of such trading agent.…

Trading and Market Microstructure · Quantitative Finance 2018-07-10 Chien Yi Huang

Recommendation is crucial in both academia and industry, and various techniques are proposed such as content-based collaborative filtering, matrix factorization, logistic regression, factorization machines, neural networks and multi-armed…

Information Retrieval · Computer Science 2019-10-30 Feng Liu , Ruiming Tang , Xutao Li , Weinan Zhang , Yunming Ye , Haokun Chen , Huifeng Guo , Yuzhou Zhang

Offline reinforcement learning allows training reinforcement learning models on data from live deployments. However, it is limited to choosing the best combination of behaviors present in the training data. In contrast, simulation…

Machine Learning · Computer Science 2024-09-24 Eshagh Kargar , Ville Kyrki

Batch reinforcement learning enables policy learning without direct interaction with the environment during training, relying exclusively on previously collected sets of interactions. This approach is, therefore, well-suited for high-risk…

Machine Learning · Computer Science 2024-11-18 Amna Najib , Stefan Depeweg , Phillip Swazinna

This paper considers an online reinforcement learning algorithm that leverages pre-collected data (passive memory) from the environment for online interaction. We show that using passive memory improves performance and further provide…

Machine Learning · Computer Science 2024-10-21 Anay Pattanaik , Lav R. Varshney

In this paper, we propose a model-based offline reinforcement learning method that integrates count-based conservatism, named $\texttt{Count-MORL}$. Our method utilizes the count estimates of state-action pairs to quantify model estimation…

Machine Learning · Computer Science 2023-07-24 Byeongchan Kim , Min-hwan Oh

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

We present a data-efficient reinforcement learning algorithm resistant to observation noise. Our method extends the highly data-efficient PILCO algorithm (Deisenroth & Rasmussen, 2011) into partially observed Markov decision processes…

Machine Learning · Statistics 2016-02-09 Rowan McAllister , Carl Edward Rasmussen

Imitation learning has proven effective for training robots to perform complex tasks from expert human demonstrations. However, it remains limited by its reliance on high-quality, task-specific data, restricting adaptability to the diverse…

In state of the art model-free off-policy deep reinforcement learning, a replay memory is used to store past experience and derive all network updates. Even if both state and action spaces are continuous, the replay memory only holds a…

Machine Learning · Computer Science 2020-07-16 Sabrina Hoppe , Marc Toussaint

Machine Learning has invariantly found its way into various Credit Risk applications. Due to the intrinsic nature of Credit Risk, quantifying the uncertainty of the predicted risk metrics is essential, and applying uncertainty-aware deep…

Risk Management · Quantitative Finance 2023-12-12 Ashish Dhiman

We generalize a standard benchmark of reinforcement learning, the classical cartpole balancing problem, to the quantum regime by stabilizing a particle in an unstable potential through measurement and feedback. We use state-of-the-art deep…

Quantum Physics · Physics 2020-09-08 Zhikang T. Wang , Yuto Ashida , Masahito Ueda

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without further environment interaction. A key challenge is the distribution shift between the learned and behavior policies, leading to…

Machine Learning · Computer Science 2025-08-11 Haohui Chen , Zhiyong Chen

We consider an offline learning problem for an agent who first estimates an unknown price impact kernel from a static dataset, and then designs strategies to liquidate a risky asset while creating transient price impact. We propose a novel…

Optimization and Control · Mathematics 2023-09-07 Eyal Neuman , Wolfgang Stockinger , Yufei Zhang

Recent advancements in deep reinforcement learning (RL) have demonstrated notable progress in sample efficiency, spanning both model-based and model-free paradigms. Despite the identification and mitigation of specific bottlenecks in prior…

Machine Learning · Computer Science 2024-04-02 Yibo Wang , Jiang Zhao

While many real-world problems that might benefit from reinforcement learning, these problems rarely fit into the MDP mold: interacting with the environment is often expensive and specifying reward functions is challenging. Motivated by…

Machine Learning · Computer Science 2023-07-26 Kyle Hatch , Benjamin Eysenbach , Rafael Rafailov , Tianhe Yu , Ruslan Salakhutdinov , Sergey Levine , Chelsea Finn

In reinforcement learning, offline value function learning is the procedure of using an offline dataset to estimate the expected discounted return from each state when taking actions according to a fixed target policy. The stability of this…

Machine Learning · Computer Science 2026-01-21 Brahma S. Pavse , Yudong Chen , Qiaomin Xie , Josiah P. Hanna

Offline reinforcement learning provides a viable approach to obtain advanced control strategies for dynamical systems, in particular when direct interaction with the environment is not available. In this paper, we introduce a conceptual…

Machine Learning · Computer Science 2024-01-04 Marc Weber , Phillip Swazinna , Daniel Hein , Steffen Udluft , Volkmar Sterzing

Unfair pricing policies have been shown to be one of the most negative perceptions customers can have concerning pricing, and may result in long-term losses for a company. Despite the fact that dynamic pricing models help companies maximize…

Machine Learning · Computer Science 2018-03-28 Roberto Maestre , Juan Duque , Alberto Rubio , Juan Arévalo