English
Related papers

Related papers: ARL-Based Multi-Action Market Making with Hawkes P…

200 papers

Traditional portfolio management methods can incorporate specific investor preferences but rely on accurate forecasts of asset returns and covariances. Reinforcement learning (RL) methods do not rely on these explicit forecasts and are…

Portfolio Management · Quantitative Finance 2022-03-23 Ruan Pretorius , Terence van Zyl

Markov games (MGs) and multi-agent reinforcement learning (MARL) are studied to model decision making in multi-agent systems. Traditionally, the objective in MG and MARL has been risk-neutral, i.e., agents are assumed to optimize a…

Computer Science and Game Theory · Computer Science 2024-06-11 Hafez Ghaemi , Shirin Jamshidi , Mohammad Mashreghi , Majid Nili Ahmadabadi , Hamed Kebriaei

The integration of Reinforcement Learning (RL) with heuristic methods is an emerging trend for solving optimization problems, which leverages RL's ability to learn from the data generated during the search process. One promising approach is…

Machine Learning · Computer Science 2024-09-19 Arthur Müller , Lukas Vollenkemper

Recent advancements in Large Language Models (LLMs) and Visual Language Models (VLMs) have significantly impacted robotics, enabling high-level semantic motion planning applications. Reinforcement Learning (RL), a complementary paradigm,…

Traditional reinforcement learning (RL) generates discrete control policies, assigning one action per cycle. These policies are usually implemented as in a fixed-frequency control loop. This rigidity presents challenges as optimal control…

Robotics · Computer Science 2024-07-02 Dong Wang , Giovanni Beltrame

Model-based reinforcement learning (MBRL) improves sample efficiency by leveraging learned dynamics models for policy optimization. However, the effectiveness of methods such as actor-critic is often limited by compounding model errors,…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Chengyang Gu , Yuxin Pan , Hui Xiong , Yize Chen

Reinforcement Learning has emerged as a promising framework for developing adaptive and data-driven strategies, enabling market makers to optimize decision-making policies based on interactions with the limit order book environment. This…

Trading and Market Microstructure · Quantitative Finance 2026-02-17 Rafael Zimmer , Oswaldo Luiz do Valle Costa

Decentralized combinatorial optimization in evolving multi-agent systems poses significant challenges, requiring agents to balance long-term decision-making, short-term optimized collective outcomes, while preserving autonomy of interactive…

Multiagent Systems · Computer Science 2025-09-23 Chuhao Qin , Evangelos Pournaras

Hawkes processes are a class of point processes that have the ability to model the self- and mutual-exciting phenomena. Although the classic Hawkes processes cover a wide range of applications, their expressive ability is limited due to…

Machine Learning · Computer Science 2021-06-10 Feng Zhou , Quyu Kong , Yixuan Zhang , Cheng Feng , Jun Zhu

Agent-based models (ABMs) are simulation models used in economics to overcome some of the limitations of traditional frameworks based on general equilibrium assumptions. However, agents within an ABM follow predetermined 'bounded rational'…

Machine Learning · Computer Science 2024-10-23 Simone Brusatin , Tommaso Padoan , Andrea Coletta , Domenico Delli Gatti , Aldo Glielmo

This work focuses on a self-exciting point process defined by a Hawkes-like intensity and a switching mechanism based on a hidden Markov chain. Previous works in such a setting assume constant intensities between consecutive events. We…

Methodology · Statistics 2025-02-07 Timothée Fabre , Ioane Muni Toke

Establishing sound experimental standards and rigour is important in any growing field of research. Deep Multi-Agent Reinforcement Learning (MARL) is one such nascent field. Although exciting progress has been made, MARL has recently come…

Artificial Intelligence · Computer Science 2024-01-29 Siddarth Singh , Omayma Mahjoub , Ruan de Kock , Wiem Khlifi , Abidine Vall , Kale-ab Tessera , Arnu Pretorius

Market making (MM) has attracted significant attention in financial trading owing to its essential function in ensuring market liquidity. With strong capabilities in sequential decision-making, Reinforcement Learning (RL) technology has…

Machine Learning · Computer Science 2023-08-21 Hui Niu , Siyuan Li , Jiahao Zheng , Zhouchi Lin , Jian Li , Jian Guo , Bo An

This paper presents a novel reinforcement learning (RL) approach called HAAM-RL (Heuristic Algorithm-based Action Masking Reinforcement Learning) for optimizing the color batching re-sequencing problem in automobile painting processes. The…

Machine Learning · Computer Science 2024-03-22 Kyuwon Choi , Cheolkyun Rho , Taeyoun Kim , Daewoo Choi

Multi-Agent Systems (MAS) excel at accomplishing complex objectives through the collaborative efforts of individual agents. Among the methodologies employed in MAS, Multi-Agent Reinforcement Learning (MARL) stands out as one of the most…

Robotics · Computer Science 2025-07-23 Chenhao Yao , Zike Yuan , Xiaoxu Liu , Chi Zhu

Offline reinforcement learning (RL) enables policy learning from static data but often suffers from poor coverage of the state-action space and distributional shift problems. This problem can be addressed by allowing limited online…

Machine Learning · Computer Science 2026-02-03 Soumyadeep Roy , Shashwat Kushwaha , Ambedkar Dukkipati

In reinforcement learning (RL), agents often operate in partially observed and uncertain environments. Model-based RL suggests that this is best achieved by learning and exploiting a probabilistic model of the world. 'Active inference' is…

Machine Learning · Computer Science 2019-11-26 Alexander Tschantz , Manuel Baltieri , Anil. K. Seth , Christopher L. Buckley

Most of the current game-theoretic demand-side management methods focus primarily on the scheduling of home appliances, and the related numerical experiments are analyzed under various scenarios to achieve the corresponding Nash-equilibrium…

Computers and Society · Computer Science 2019-02-26 Jun Hao

Only limited studies and superficial evaluations are available on agents' behaviors and roles within a Multi-Agent System (MAS). We simulate a MAS using Reinforcement Learning (RL) in a pursuit-evasion (a.k.a predator-prey pursuit) game,…

Artificial Intelligence · Computer Science 2022-12-16 Piyush K. Sharma , Erin Zaroukian , Derrik E. Asher , Bryson Howell

Strategic bidding tactics employed by prosumers in local markets, including the Local Electricity Market (LEM) and Local Flexibility Market (LFM), have attracted significant attention due to their potential to enhance economic benefits for…

Systems and Control · Electrical Eng. & Systems 2025-07-23 Haoyang Zhang , Mina Montazeri , Philipp Heer , Koen Kok , Nikolaos G. Paterakis