English
Related papers

Related papers: Game Agent Driven by Free-Form Text Command: Using…

200 papers

In this work we present a technique to use natural language to help reinforcement learning generalize to unseen environments. This technique uses neural machine translation, specifically the use of encoder-decoder networks, to learn…

Artificial Intelligence · Computer Science 2017-09-15 Brent Harrison , Upol Ehsan , Mark O. Riedl

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Recent advancements in natural language processing, particularly with large language models (LLMs) like GPT-4, have significantly enhanced dialogue systems, enabling them to generate more natural and fluent conversations. Despite these…

Computation and Language · Computer Science 2024-09-05 Zhiyang Qi , Michimasa Inaba

Wargames are simulations of conflicts in which participants' decisions influence future events. While casual wargaming can be used for entertainment or socialization, serious wargaming is used by experts to explore strategic implications of…

Artificial Intelligence · Computer Science 2025-10-24 Glenn Matlin , Parv Mahajan , Isaac Song , Yixiong Hao , Ryan Bard , Stu Topp , Evan Montoya , M. Rehan Parwani , Soham Shetty , Mark Riedl

Existing Large Language Models (LLM) can invoke a variety of tools and APIs to complete complex tasks. The computer, as the most powerful and universal tool, could potentially be controlled directly by a trained LLM agent. Powered by the…

Human-Computer Interaction · Computer Science 2025-05-27 Runliang Niu , Jindong Li , Shiqi Wang , Yali Fu , Xiyu Hu , Xueyuan Leng , He Kong , Yi Chang , Qi Wang

This paper presents a novel approach in autonomous robot control, named LLM-BRAIn, that makes possible robot behavior generation, based on operator's commands. LLM-BRAIn is a transformer-based Large Language Model (LLM) fine-tuned from…

Robotics · Computer Science 2023-06-01 Artem Lykov , Dzmitry Tsetserukou

Natural language (NL) has long been the predominant format for human cognition and communication, and by extension, has been similarly pivotal in the development and application of Large Language Models (LLMs). Yet, besides NL, LLMs have…

Computation and Language · Computer Science 2024-06-21 Weize Chen , Chenfei Yuan , Jiarui Yuan , Yusheng Su , Chen Qian , Cheng Yang , Ruobing Xie , Zhiyuan Liu , Maosong Sun

Large Language Model (LLM) agents have been increasingly adopted as simulation tools to model humans in social science and role-playing applications. However, one fundamental question remains: can LLM agents really simulate human behavior?…

Artificial Intelligence · Computer Science 2024-11-04 Chengxing Xie , Canyu Chen , Feiran Jia , Ziyu Ye , Shiyang Lai , Kai Shu , Jindong Gu , Adel Bibi , Ziniu Hu , David Jurgens , James Evans , Philip Torr , Bernard Ghanem , Guohao Li

The increasing complexity of gameplay mechanisms in modern video games is leading to the emergence of a wider range of ways to play games. The variety of possible play-styles needs to be anticipated by designers, through automated tests.…

Machine Learning · Computer Science 2022-12-01 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

Large Language Models' (LLMs) programming capabilities enable their participation in open-source games: a game-theoretic setting in which players submit computer programs in lieu of actions. These programs offer numerous advantages,…

Computer Science and Game Theory · Computer Science 2025-12-02 Swadesh Sistla , Max Kleiman-Weiner

The Large Language Models (LLM) are increasingly being deployed in robotics to generate robot control programs for specific user tasks, enabling embodied intelligence. Existing methods primarily focus on LLM training and prompt design that…

Robotics · Computer Science 2025-08-27 ZhenDong Chen , ZhanShang Nie , ShiXing Wan , JunYi Li , YongTian Cheng , Shuai Zhao

The final frontier for simulation is the accurate representation of complex, real-world social systems. While agent-based modeling (ABM) seeks to study the behavior and interactions of agents within a larger system, it is unable to…

Artificial Intelligence · Computer Science 2023-08-16 Edward Junprung

Neural video game simulators emerged as powerful tools to generate and edit videos. Their idea is to represent games as the evolution of an environment's state driven by the actions of its agents. While such a paradigm enables users to play…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Willi Menapace , Aliaksandr Siarohin , Stéphane Lathuilière , Panos Achlioptas , Vladislav Golyanik , Sergey Tulyakov , Elisa Ricci

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Autonomous, goal-driven agents powered by LLMs have recently emerged as promising tools for solving challenging problems without the need for task-specific finetuned models that can be expensive to procure. Currently, the design and…

Language is a ubiquitous tool that is foundational to reasoning and collaboration, ranging from everyday interactions to sophisticated problem-solving tasks. The establishment of a common language can serve as a powerful asset in ensuring…

Artificial Intelligence · Computer Science 2025-08-12 Dom Huh , Prasant Mohapatra

Recent advancements in natural language and Large Language Models (LLMs) have enabled AI agents to simulate human-like interactions within virtual worlds. However, these interactions still face limitations in complexity and flexibility,…

Computation and Language · Computer Science 2023-07-25 Yuanzhi Liang , Linchao Zhu , Yi Yang

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

Large Language Models (LLMs) are increasingly used to power autonomous agents for complex, multi-step tasks. However, human-agent interaction remains pointwise and reactive: users approve or correct individual actions to mitigate immediate…

Human-Computer Interaction · Computer Science 2026-03-13 Gaole He , Brian Y. Lim

Evaluating AI agents within complex, interactive environments that mirror real-world challenges is critical for understanding their practical capabilities. While existing agent benchmarks effectively assess skills like tool use or…

Artificial Intelligence · Computer Science 2025-08-15 Long Phan , Mantas Mazeika , Andy Zou , Dan Hendrycks