English
Related papers

Related papers: EconoJax: A Fast & Scalable Economic Simulation in…

200 papers

Traditional AI algorithms, such as Genetic Programming and Reinforcement Learning, often require extensive computational resources to simulate real-world physical scenarios effectively. While advancements in multi-core processing have been…

Robotics · Computer Science 2024-11-12 Jörn Fischer , Thomas Ihme

We present an agent-based simulator for economic systems with heterogeneous households, firms, central bank, and government agents. These agents interact to define production, consumption, and monetary flow. Each agent type has distinct…

Multiagent Systems · Computer Science 2024-08-23 Kshama Dwarakanath , Svitlana Vyetrenko , Tucker Balch

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

Machine Learning · Computer Science 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

Robust coordination skills enable agents to operate cohesively in shared environments, together towards a common goal and, ideally, individually without hindering each other's progress. To this end, this paper presents Coordinated QMIX…

Machine Learning · Computer Science 2024-12-25 Giovanni Minelli , Mirco Musolesi

The grand aim of having a single robot that can manipulate arbitrary objects in diverse settings is at odds with the paucity of robotics datasets. Acquiring and growing such datasets is strenuous due to manual efforts, operational costs,…

Robotics · Computer Science 2023-09-06 Homanga Bharadhwaj , Jay Vakil , Mohit Sharma , Abhinav Gupta , Shubham Tulsiani , Vikash Kumar

We consider the learning dynamics of a single reinforcement learning optimal execution trading agent when it interacts with an event driven agent-based financial market model. Trading takes place asynchronously through a matching engine in…

Trading and Market Microstructure · Quantitative Finance 2023-11-23 Matthew Dicks , Andrew Paskaramoorthy , Tim Gebbie

We explore how physical scale and population size shape the emergence of complex behaviors in open-ended ecological environments. In our setting, agents are unsupervised and have no explicit rewards or learning objectives but instead evolve…

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

When deploying autonomous agents in the real world, we need effective ways of communicating objectives to them. Traditional skill learning has revolved around reinforcement and imitation learning, each with rigid constraints on the format…

Artificial Intelligence · Computer Science 2019-11-21 Mark Woodward , Chelsea Finn , Karol Hausman

Due to its high sample complexity, simulation is, as of today, critical for the successful application of reinforcement learning. Many real-world problems, however, exhibit overly complex dynamics, which makes their full-scale simulation…

Machine Learning · Computer Science 2024-03-04 Miguel Suau , Jinke He , Mustafa Mert Çelikok , Matthijs T. J. Spaan , Frans A. Oliehoek

The rapid development of AI-based products and their underlying models has led to constant innovation in deep learning frameworks. Google has been pioneering machine learning usage across dozens of products. Maintaining the multitude of…

Software Engineering · Computer Science 2026-03-31 Stoyan Nikolov , Bernhard Konrad , Moritz Gronbach , Niket Kumar , Ann Yan , Varun Singh , Yaning Liang , Parthasarathy Ranganathan

While reinforcement learning agents can achieve superhuman performance in many complex tasks, they typically do not become more computationally efficient as they improve. In contrast, humans gradually require less cognitive effort as they…

Artificial Intelligence · Computer Science 2025-10-28 Adrian Orenstein , Jessica Chen , Gwyneth Anne Delos Santos , Bayley Sapara , Michael Bowling

Progress in multi-agent reinforcement learning (MARL) requires challenging benchmarks that assess the limits of current methods. However, existing benchmarks often target narrow short-horizon challenges that do not adequately stress the…

Machine Learning · Computer Science 2025-11-10 Bassel Al Omari , Michael Matthews , Alexander Rutherford , Jakob Nicolaus Foerster

Recent advancements in Artificial Intelligence (AI) have largely been propelled by scaling. In Robotics, scaling is hindered by the lack of access to massive robot datasets. We advocate using realistic physical simulation as a means to…

Small LLMs often struggle to match the agentic capabilities of large, costly models. While reinforcement learning can help, progress has been limited by two structural bottlenecks: existing open-source agentic training data are narrow in…

Computation and Language · Computer Science 2026-03-13 Yuanjie Lyu , Chengyu Wang , Lei Shen , Jun Huang , Tong Xu

Generalist robot learning remains constrained by data: large-scale, diverse, and high-quality interaction data are expensive to collect in the real world. While simulation has become a promising way for scaling up data collection, the…

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Interactive imitation learning makes an agent's control policy robust by stepwise supervisions from an expert. The recent algorithms mostly employ expert-agent switching systems to reduce the expert's burden by limitedly selecting the…

Robotics · Computer Science 2026-04-23 Taisuke Kobayashi

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

Machine Learning · Computer Science 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

The development of open benchmarking platforms could greatly accelerate the adoption of AI agents in retail. This paper presents comprehensive simulations of customer shopping behaviors for the purpose of benchmarking reinforcement learning…

Artificial Intelligence · Computer Science 2024-05-20 Yu Xia , Sriram Narayanamoorthy , Zhengyuan Zhou , Joshua Mabry