English
Related papers

Related papers: TaxAI: A Dynamic Economic Simulator and Benchmark …

200 papers

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

The development of AGI threatens to erode government tax bases, lower living standards, and disempower citizens -- risks that make the 40-year stagnation of wages during the first industrial revolution look mild in comparison. While AI…

Computers and Society · Computer Science 2026-03-06 Lucas Irwin , Tung-Yu Wu , Fazl Barez

This paper presents a simple agent-based model of an economic system, populated by agents playing different games according to their different view about social cohesion and tax payment. After a first set of simulations, correctly…

General Finance · Quantitative Finance 2018-09-24 L. S. Di Mauro , A. Pluchino , A. E. Biondo

Agent-based computational economics is a field with a rich academic history, yet one which has struggled to enter mainstream policy design toolboxes, plagued by the challenges associated with representing a complex and dynamic reality. The…

Machine Learning · Computer Science 2023-02-24 Callum Rhys Tilbury

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

Machine Learning · Computer Science 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

In recent years, the application of generative artificial intelligence (GenAI) in financial analysis and investment decision-making has gained significant attention. However, most existing approaches rely on single-agent systems, which fail…

Artificial Intelligence · Computer Science 2024-11-08 Xuewen Han , Neng Wang , Shangkun Che , Hongyang Yang , Kunpeng Zhang , Sean Xin Xu

Multi-Agent Systems (MAS) excel at accomplishing complex objectives through the collaborative efforts of individual agents. Among the methodologies employed in MAS, Multi-Agent Reinforcement Learning (MARL) stands out as one of the most…

Robotics · Computer Science 2025-07-23 Chenhao Yao , Zike Yuan , Xiaoxu Liu , Chi Zhu

Stochastic games are a popular framework for studying multi-agent reinforcement learning (MARL). Recent advances in MARL have focused primarily on games with finitely many states. In this work, we study multi-agent learning in stochastic…

Machine Learning · Computer Science 2024-03-28 Awni Altabaa , Bora Yongacoglu , Serdar Yüksel

Reinforcement Learning (RL) in various decision-making tasks of machine learning provides effective results with an agent learning from a stand-alone reward function. However, it presents unique challenges with large amounts of environment…

Machine Learning · Computer Science 2020-03-10 Neda Navidi

We consider the problem of multi-agent navigation and collision avoidance when observations are limited to the local neighborhood of each agent. We propose InforMARL, a novel architecture for multi-agent reinforcement learning (MARL) which…

Multiagent Systems · Computer Science 2023-05-17 Siddharth Nayak , Kenneth Choi , Wenqi Ding , Sydney Dolan , Karthik Gopalakrishnan , Hamsa Balakrishnan

Deep Reinforcement Learning (DRL) and Deep Multi-agent Reinforcement Learning (MARL) have achieved significant successes across a wide range of domains, including game AI, autonomous vehicles, robotics, and so on. However, DRL and deep MARL…

Artificial Intelligence · Computer Science 2023-02-03 Jianye Hao , Tianpei Yang , Hongyao Tang , Chenjia Bai , Jinyi Liu , Zhaopeng Meng , Peng Liu , Zhen Wang

Uncovering causal structures from observational data is crucial for understanding complex systems and making informed decisions. While reinforcement learning (RL) has shown promise in identifying these structures in the form of a directed…

Machine Learning · Computer Science 2026-03-24 Dong Li , Zhengzhang Chen , Xujiang Zhao , Linlin Yu , Zhong Chen , Yi He , Haifeng Chen , Chen Zhao

Execution algorithms are vital to modern trading, they enable market participants to execute large orders while minimising market impact and transaction costs. As these algorithms grow more sophisticated, optimising them becomes…

Computational Finance · Quantitative Finance 2025-10-28 Ollie Olby , Andreea Bacalum , Rory Baggott , Namid Stillman

Multi-Agent Reinforcement Learning (MARL) has enjoyed significant recent progress thanks, in part, to the integration of deep learning techniques for modeling interactions in complex environments. This is naturally starting to benefit…

Robotics · Computer Science 2023-10-24 Reza Torbati , Shubham Lohiya , Shivika Singh , Meher Shashwat Nigam , Harish Ravichandar

Multi-agent reinforcement learning (MARL) methods, while effective in zero-sum or positive-sum games, often yield suboptimal outcomes in general-sum games where cooperation is essential for achieving globally optimal outcomes. Matrix game…

Computer Science and Game Theory · Computer Science 2024-08-09 Mustafa Yasir , Andrew Howes , Vasilios Mavroudis , Chris Hicks

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

Algorithmic trading relies on machine learning models to make trading decisions. Despite strong in-sample performance, these models often degrade when confronted with evolving real-world market regimes, which can shift dramatically due to…

Machine Learning · Computer Science 2026-01-27 Haochong Xia , Simin Li , Ruixiao Xu , Zhixia Zhang , Hongxiang Wang , Zhiqian Liu , Teng Yao Long , Molei Qin , Chuqiao Zong , Bo An

Making sophisticated, robust, and safe sequential decisions is at the heart of intelligent systems. This is especially critical for planning in complex multi-agent environments, where agents need to anticipate other agents' intentions and…

Robotics · Computer Science 2020-01-29 Yichuan Charlie Tang

This paper derives `Scaling Laws for Economic Impacts' -- empirical relationships between the training compute of Large Language Models (LLMs) and professional productivity. In a preregistered experiment, over 500 consultants, data…

General Economics · Economics 2025-12-25 Ali Merali

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

Robotics · Computer Science 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin