English
Related papers

Related papers: Exploring Competitive and Collusive Behaviors in A…

200 papers

This paper establishes a new and comprehensive theoretical analysis for the application of reinforcement learning (RL) in high-frequency market making. We bridge the modern RL theory and the continuous-time statistical models in…

Trading and Market Microstructure · Quantitative Finance 2024-08-13 Yuheng Zheng , Zihan Ding

We develop theory and algorithms for average-reward on-policy Reinforcement Learning (RL). We first consider bounding the difference of the long-term average reward for two policies. We show that previous work based on the discounted return…

Machine Learning · Computer Science 2021-06-15 Yiming Zhang , Keith W. Ross

Owe to the recent advancements in Artificial Intelligence especially deep learning, many data-driven decision support systems have been implemented to facilitate medical doctors in delivering personalized care. We focus on the deep…

Machine Learning · Computer Science 2019-07-24 Siqi Liu , Kee Yuan Ngiam , Mengling Feng

A properly calibrated rule-based autoscaler can beat every one of six mainstream deep reinforcement learning (DRL) algorithms on cost across every workload we test - so when, if ever, does DRL actually help? We study this in RLScale-Bench,…

Machine Learning · Computer Science 2026-05-27 Guilin Zhang , Chuanyi Sun , Kai Zhao , Shahryar Sarkani , John Fossaceca

Deep reinforcement learning (DRL) has been widely studied in the portfolio management task. However, it is challenging to understand a DRL-based trading strategy because of the black-box nature of deep neural networks. In this paper, we…

Portfolio Management · Quantitative Finance 2021-12-21 Mao Guan , Xiao-Yang Liu

There is growing experimental evidence that $Q$-learning agents may learn to charge supracompetitive prices. We provide the first theoretical explanation for this behavior in infinite repeated games. Firms update their pricing policies…

General Economics · Economics 2025-05-30 Cristian Chica , Yinglong Guo , Gilad Lerman

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in utilizing RL for online advertising in recommendation platforms (e.g., e-commerce and news feed sites). However, most RL-based advertising…

Information Retrieval · Computer Science 2021-05-06 Xiangyu Zhao , Changsheng Gu , Haoshenglun Zhang , Xiwang Yang , Xiaobing Liu , Jiliang Tang , Hui Liu

Algorithmic collusion is an emerging concept in current artificial intelligence age. Whether algorithmic collusion is a creditable threat remains as an argument. In this paper, we propose an algorithm which can extort its human rival to…

Econometrics · Economics 2018-02-23 Nan Zhou , Li Zhang , Shijian Li , Zhijian Wang

A deep reinforcement learning (DRL) agent observes its states through observations, which may contain natural measurement errors or adversarial noises. Since the observations deviate from the true states, they can mislead the agent into…

Machine Learning · Computer Science 2021-07-15 Huan Zhang , Hongge Chen , Chaowei Xiao , Bo Li , Mingyan Liu , Duane Boning , Cho-Jui Hsieh

With the widespread adoption of deep learning, reinforcement learning (RL) has experienced a dramatic increase in popularity, scaling to previously intractable problems, such as playing complex games from pixel observations, sustaining…

Machine Learning · Computer Science 2023-04-20 Rafael Figueiredo Prudencio , Marcos R. O. A. Maximo , Esther Luna Colombini

Deep Reinforcement Learning (DRL) techniques have been successfully applied for solving complex decision-making and control tasks in multiple fields including robotics, autonomous driving, healthcare and natural language processing. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-07 Amanda Jayanetti , Saman Halgamuge , Rajkumar Buyya

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Deep reinforcement learning (DRL) has been envisioned to have a competitive edge in quantitative finance. However, there is a steep development curve for quantitative traders to obtain an agent that automatically positions to win in the…

Trading and Market Microstructure · Quantitative Finance 2021-11-19 Xiao-Yang Liu , Hongyang Yang , Jiechao Gao , Christina Dan Wang

The realm of High-Frequency Trading (HFT) is characterized by rapid decision-making processes that capitalize on fleeting market inefficiencies. As the financial markets become increasingly competitive, there is a pressing need for…

Trading and Market Microstructure · Quantitative Finance 2023-11-21 Soumyadip Sarkar

As a popular concept proposed in the field of psychology, affordance has been regarded as one of the important abilities that enable humans to understand and interact with the environment. Briefly, it captures the possibilities and effects…

Robotics · Computer Science 2024-11-04 Xintong Yang , Ze Ji , Jing Wu , Yu-kun Lai

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

The rise of autonomous pricing systems has sparked growing concern over algorithmic collusion in markets from retail to housing. This paper examines controlled information quality as an ex ante policy lever: by reducing the fidelity of data…

General Economics · Economics 2025-09-04 Niuniu Zhang

While researchers in the asset management industry have mostly focused on techniques based on financial and risk planning techniques like Markowitz efficient frontier, minimum variance, maximum diversification or equal risk parity, in…

Machine Learning · Computer Science 2020-10-20 Eric Benhamou , David Saltiel , Sandrine Ungari , Abhishek Mukhopadhyay

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

Machine Learning · Computer Science 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

AI agents are increasingly deployed in ecosystems where they repeatedly interact not only with each other but also with humans. In this work, we study these human-AI ecosystems from a theoretical perspective, focusing on the classical…

Machine Learning · Computer Science 2025-12-01 Natalie Collina , Eshwar Ram Arunachaleswaran , Meena Jagadeesan