English
Related papers

Related papers: Approximation Models of Combat in StarCraft 2

200 papers

Basically, in (one-player) war Real Time Strategy (wRTS) games a human player controls, in real time, an army consisting of a number of soldiers and her aim is to destroy the opponent's assets where the opponent is a virtual (i.e.,…

Neural and Evolutionary Computing · Computer Science 2012-01-17 José A. García Gutiérrez , Carlos Cotta , Antonio J. Fernández-Leiva

StarCraft II poses a grand challenge for reinforcement learning. The main difficulties of it include huge state and action space and a long-time horizon. In this paper, we investigate a hierarchical reinforcement learning approach for…

Machine Learning · Computer Science 2019-02-05 Zhen-Jia Pang , Ruo-Ze Liu , Zhou-Yu Meng , Yi Zhang , Yang Yu , Tong Lu

StarCraft II (SC2) is a real-time strategy game in which players produce and control multiple units to fight against opponent's units. Due to its difficulties, such as huge state space, various action space, a long time horizon, and…

Artificial Intelligence · Computer Science 2021-11-18 Ruo-Ze Liu , Wenhai Wang , Yanjie Shen , Zhiqi Li , Yang Yu , Tong Lu

We present a novel modular architecture for StarCraft II AI. The architecture splits responsibilities between multiple modules that each control one aspect of the game, such as build-order selection or tactics. A centralized scheduler…

Artificial Intelligence · Computer Science 2018-11-09 Dennis Lee , Haoran Tang , Jeffrey O Zhang , Huazhe Xu , Trevor Darrell , Pieter Abbeel

StarCraft II is a challenging benchmark for AI agents due to the necessity of both precise micro level operations and strategic macro awareness. Previous works, such as Alphastar and SCC, achieve impressive performance on tackling StarCraft…

Artificial Intelligence · Computer Science 2024-06-19 Weiyu Ma , Qirui Mi , Yongcheng Zeng , Xue Yan , Yuqiao Wu , Runji Lin , Haifeng Zhang , Jun Wang

Remaining competitive in future conflicts with technologically-advanced competitors requires us to accelerate our research and development in artificial intelligence (AI) for wargaming. More importantly, leveraging machine learning for…

Machine Learning · Computer Science 2024-02-13 Scotty Black , Christian Darken

Computer games, as fully controlled simulated environments, have been utilized in significant scientific studies demonstrating the application of Reinforcement Learning (RL). Gaming and esports are key areas influenced by the application of…

Software Engineering · Computer Science 2025-09-24 Andrzej Białecki , Piotr Białecki , Piotr Sowiński , Mateusz Budziak , Jan Gajewski

This paper reviews the field of Game AI, which not only deals with creating agents that can play a certain game, but also with areas as diverse as creating game content automatically, game analytics, or player modelling. While Game AI was…

Artificial Intelligence · Computer Science 2020-02-25 Sebastian Risi , Mike Preuss

In today's rapidly evolving military landscape, advancing artificial intelligence (AI) in support of wargaming becomes essential. Despite reinforcement learning (RL) showing promise for developing intelligent agents, conventional RL faces…

Machine Learning · Computer Science 2024-08-27 Scotty Black

Real-time strategy games have been an important field of game artificial intelligence in recent years. This paper presents a reinforcement learning and curriculum transfer learning method to control multiple units in StarCraft…

Artificial Intelligence · Computer Science 2018-04-04 Kun Shao , Yuanheng Zhu , Dongbin Zhao

Predicting and modeling human behavior and finding trends within human decision-making processes is a major problem of social science. Rock Paper Scissors (RPS) is the fundamental strategic question in many game theory problems and…

Computer Science and Game Theory · Computer Science 2020-11-24 Lei Wang , Wenbin Huang , Yuanpeng Li , Julian Evans , Sailing He

We consider the problem of high-level strategy selection in the adversarial setting of real-time strategy games from a reinforcement learning perspective, where taking an action corresponds to switching to the respective strategy. Here, a…

Machine Learning · Computer Science 2018-11-22 Jonas Gehring , Da Ju , Vegard Mella , Daniel Gant , Nicolas Usunier , Gabriel Synnaeve

The research community lacks a middle ground between StarCraft IIs full game and its mini-games. The full-games sprawling state-action space renders reward signals sparse and noisy, but in mini-games simple agents saturate performance. This…

Artificial Intelligence · Computer Science 2026-03-10 Sourav Panda , Shreyash Kale , Tanmay Ambadkar , Abhinav Verma , Jonathan Dodge

Deep reinforcement learning, and especially the Asynchronous Advantage Actor-Critic algorithm, has been successfully used to achieve super-human performance in a variety of video games. Starcraft II is a new challenge for the reinforcement…

Artificial Intelligence · Computer Science 2018-07-25 Basel Alghanem , Keerthana P G

In recent years, reinforcement learning has been successful in solving video games from Atari to Star Craft II. However, the end-to-end model-free reinforcement learning (RL) is not sample efficient and requires a significant amount of…

Multiagent Systems · Computer Science 2019-06-26 Yunqi Zhao , Igor Borovikov , Jason Rupert , Caedmon Somers , Ahmad Beirami

Starcraft II (SC2) is widely considered as the most challenging Real Time Strategy (RTS) game. The underlying challenges include a large observation space, a huge (continuous and infinite) action space, partial observations, simultaneous…

Artificial Intelligence · Computer Science 2018-12-31 Peng Sun , Xinghai Sun , Lei Han , Jiechao Xiong , Qing Wang , Bo Li , Yang Zheng , Ji Liu , Yongsheng Liu , Han Liu , Tong Zhang

Future warfare will occur in more complex, fast-paced, ill-structured, and demanding conditions that will stress current Command and Control (C2) systems. Without modernization, these C2 systems may fail to maintain overmatch against…

This paper introduces SC2LE (StarCraft II Learning Environment), a reinforcement learning environment based on the StarCraft II game. This domain poses a new grand challenge for reinforcement learning, representing a more difficult class of…

We present Adaptive Command, a novel framework integrating large language models (LLMs) with behavior trees for real-time strategic decision-making in StarCraft II. Our system focuses on enhancing human-AI collaboration in complex, dynamic…

Human-Computer Interaction · Computer Science 2025-12-24 Weiyu Ma , Dongyu Xu , Shu Lin , Haifeng Zhang , Jun Wang

Decision making in modern large-scale and complex systems such as communication networks, smart electricity grids, and cyber-physical systems motivate novel game-theoretic approaches. This paper investigates big strategic (non-cooperative)…

Computer Science and Game Theory · Computer Science 2016-09-22 Tansu Alpcan , Benjamin I. P. Rubinstein , Christopher Leckie