English
Related papers

Related papers: Rapid Skill Capture in a First-Person Shooter

200 papers

Unsupervised skill discovery aims to learn diverse and distinguishable behaviors in open-ended reinforcement learning. For existing methods, they focus on improving diversity through pure exploration, mutual information optimization, and…

Machine Learning · Computer Science 2025-06-27 He Zhang , Ming Zhou , Shaopeng Zhai , Ying Sun , Hui Xiong

Games are often designed to shape player behavior in a desired way; however, it can be unclear how design decisions affect the space of behaviors in a game. Designers usually explore this space through human playtesting, which can be…

Artificial Intelligence · Computer Science 2019-08-06 Alexander Zook , Brent Harrison , Mark O. Riedl

To take the esports scene to the next level, we introduce PandaSkill, a framework for assessing player performance and skill rating. Traditional rating systems like Elo and TrueSkill often overlook individual contributions and face…

Machine Learning · Computer Science 2025-01-23 Maxime De Bois , Flora Parmentier , Raphaël Puget , Matthew Tanti , Jordan Peltier

Surgical skill directly affects surgical procedure outcomes; thus, effective training is needed to ensure satisfactory results. Many objective assessment metrics have been developed and some are widely used in surgical training simulators.…

Robotics · Computer Science 2021-02-23 Marzieh Ershad , Robert Rege , Ann Majewicz Fey

People can evaluate features of problems and their potential solutions well before we can effectively solve them. When considering a game we have never played, for instance, we might infer whether it is likely to be challenging, fair, or…

Computer Science and Game Theory · Computer Science 2025-02-10 Cedegao E. Zhang , Katherine M. Collins , Lionel Wong , Mauricio Barba , Adrian Weller , Joshua B. Tenenbaum

Lifelong agents should expand their competence over time without retraining from scratch or overwriting previously learned behaviors. We investigate this in a challenging real-time control setting (Dark Souls III) by representing combat as…

Artificial Intelligence · Computer Science 2026-03-12 Ali Najar

Most games have, or can be generalised to have, a number of parameters that may be varied in order to provide instances of games that lead to very different player experiences. The space of possible parameter settings can be seen as a…

Artificial Intelligence · Computer Science 2017-03-21 Jialin Liu , Julian Togelius , Diego Perez-Liebana , Simon M. Lucas

Reward-free, unsupervised discovery of skills is an attractive alternative to the bottleneck of hand-designing rewards in environments where task supervision is scarce or expensive. However, current skill pre-training methods, like many RL…

Machine Learning · Computer Science 2022-03-22 Nur Muhammad Shafiullah , Lerrel Pinto

In this paper, we introduce a skill-balancing mechanism for adversarial non-player characters (NPCs), called Skilled Experience Catalogue (SEC). The objective of this mechanism is to approximately match the skill level of an NPC to an…

Artificial Intelligence · Computer Science 2018-11-12 Frank G. Glavin , Michael G. Madden

Capture the Flag games represent a popular method of cybersecurity training. Providing meaningful insight into the training progress is essential for increasing learning impact and supporting participants' motivation, especially in advanced…

Human-Computer Interaction · Computer Science 2020-08-31 Radek Ošlejšek , Vít Rusňák , Karolína Burská , Valdemar Švábenský , Jan Vykopal

Building intelligent agents that can communicate with and learn from humans in natural language is of great value. Supervised language learning is limited by the ability of capturing mainly the statistics of training data, and is hardly…

Computation and Language · Computer Science 2018-05-02 Haichao Zhang , Haonan Yu , Wei Xu

Behavioural cloning, where a computer is taught to perform a task based on demonstrations, has been successfully applied to various video games and robotics tasks, with and without reinforcement learning. This also includes end-to-end…

Artificial Intelligence · Computer Science 2020-05-19 Anssi Kanervisto , Joonas Pussinen , Ville Hautamäki

We aim to ask and answer an essential question "how quickly do we react after observing a displayed visual target?" To this end, we present psychophysical studies that characterize the remarkable disconnect between human saccadic behaviors…

Human-Computer Interaction · Computer Science 2022-05-06 Budmonde Duinkharjav , Praneeth Chakravarthula , Rachel Brown , Anjul Patney , Qi Sun

AI-controlled characters in fighting games are expected to possess reasonably high skills and behave in a believable, human-like manner, exhibiting a diversity of play styles and strategies. Thus, the development of fighting game AI…

Artificial Intelligence · Computer Science 2021-08-10 Kaori Yuda , Shota Kamei , Riku Tanji , Ryoya Ito , Ippo Wakana , Maxim Mozgovoy

Reinforcement learning combined with deep neural networks has performed remarkably well in many genres of games recently. It has surpassed human-level performance in fixed game environments and turn-based two player board games. However, to…

Artificial Intelligence · Computer Science 2020-02-03 Inseok Oh , Seungeun Rho , Sangbin Moon , Seongho Son , Hyoil Lee , Jinyun Chung

Is it possible to predict the affect of a user just by observing her behavioral interaction through a video? How can we, for instance, predict a user's arousal in games by merely looking at the screen during play? In this paper we address…

Human-Computer Interaction · Computer Science 2019-10-16 Konstantinos Makantasis , Antonios Liapis , Georgios N. Yannakakis

In this paper, we present empirical evidence of skills and directed exploration emerging from a simple RL algorithm long before any successful trials are observed. For example, in a manipulation task, the agent is given a single observation…

Machine Learning · Computer Science 2024-08-13 Grace Liu , Michael Tang , Benjamin Eysenbach

A variety of practical problems can be modeled by the decision-making process in multi-player games where a group of self-interested players aim at optimizing their own local objectives, while the objectives depend on the actions taken by…

Optimization and Control · Mathematics 2023-01-09 Yuanhanqing Huang , Jianghai Hu

Many intelligent systems currently interact with others using at least one of fixed communication inputs or preset responses, resulting in rigid interaction experiences and extensive efforts developing a variety of scenarios for the system.…

Artificial Intelligence · Computer Science 2019-09-17 Richard G. Freedman , Yi Ren Fung , Roman Ganchin , Shlomo Zilberstein

The Jump-Jump game, as a simple yet challenging casual game, provides an ideal testing environment for studying LLM decision-making capabilities. The game requires players to precisely control jumping force based on current position and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Juwu Li