English
Related papers

Related papers: Game Agent Driven by Free-Form Text Command: Using…

200 papers

In recent years, large language models (LLMs) have shown significant advancements in natural language processing (NLP), with strong capa-bilities in generation, comprehension, and rea-soning. These models have found applications in…

Artificial Intelligence · Computer Science 2025-04-02 Hui Wang

Large language models (LLMs) are bringing richer dialogue and social behavior into games, but they also expose a control problem that existing game interfaces do not directly address: how should LLM characters participate in live…

Human-Computer Interaction · Computer Science 2026-04-07 Yunjia Guo , Jinghan Zhu , Siyu Wang , Haixin Qiao

By formally defining the training processes of large language models (LLMs), which usually encompasses pre-training, supervised fine-tuning, and reinforcement learning with human feedback, within a single and unified machine learning…

Computation and Language · Computer Science 2024-02-14 Yang Liu , Peng Sun , Hang Li

We explore the use of GPT-4 on a humanoid robot in simulation and the real world as proof of concept of a novel large language model (LLM) driven behaviour method. LLMs have shown the ability to perform various tasks, including robotic…

Robotics · Computer Science 2025-04-01 Thomas O'Brien , Ysobel Sims

Large Language Models (LLMs) have demonstrated superior performance in language understanding benchmarks. CALM, a popular approach, leverages linguistic priors of LLMs -- GPT-2 -- for action candidate recommendations to improve the…

Computation and Language · Computer Science 2023-11-15 Arjun Vaithilingam Sudhakar , Prasanna Parthasarathi , Janarthanan Rajendran , Sarath Chandar

The potential of automatic task-solving through Large Language Model (LLM)-based multi-agent collaboration has recently garnered widespread attention from both the research community and industry. While utilizing natural language to…

Human-Computer Interaction · Computer Science 2024-04-19 Bo Pan , Jiaying Lu , Ke Wang , Li Zheng , Zhen Wen , Yingchaojie Feng , Minfeng Zhu , Wei Chen

AI agents powered by Large Language Models (LLMs) have made significant advances, enabling them to assist humans in diverse complex tasks and leading to a revolution in human-AI coordination. LLM-powered agents typically require invoking…

Artificial Intelligence · Computer Science 2024-01-10 Jijia Liu , Chao Yu , Jiaxuan Gao , Yuqing Xie , Qingmin Liao , Yi Wu , Yu Wang

Multi-agent collaboration with Large Language Models (LLMs) demonstrates proficiency in basic tasks, yet its efficiency in more complex scenarios remains unexplored. In gaming environments, these agents often face situations without…

Computation and Language · Computer Science 2024-01-01 Zijing Shi , Meng Fang , Shunfeng Zheng , Shilong Deng , Ling Chen , Yali Du

It has been established in recent work that Large Language Models (LLMs) can be prompted to "self-play" conversational games that probe certain capabilities (general instruction following, strategic goal orientation, language understanding…

Computation and Language · Computer Science 2024-06-03 Anne Beyer , Kranti Chalamalasetti , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

The paper describes a system that uses large language model (LLM) technology to support the automatic learning of new entries in an intelligent agent's semantic lexicon. The process is bootstrapped by an existing non-toy lexicon and a…

Computation and Language · Computer Science 2023-12-29 Sanjay Oruganti , Sergei Nirenburg , Jesse English , Marjorie McShane

Werewolf is an incomplete information game, which has several challenges when creating a computer agent as a player given the lack of understanding of the situation and individuality of utterance (e.g., computer agents are not capable of…

Computation and Language · Computer Science 2024-09-04 Takehiro Sato , Shintaro Ozaki , Daisaku Yokoyama

This pilot study explores the application of language models (LMs) to model game event sequences, treating them as a customized natural language. We investigate a popular mobile game, transforming raw event data into textual sequences and…

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Large Language Model (LLM) Agents have recently garnered increasing interest yet they are limited in their ability to learn from trial and error, a key element of intelligent behavior. In this work, we argue that the capacity to learn new…

Artificial Intelligence · Computer Science 2024-08-09 Haiteng Zhao , Chang Ma , Guoyin Wang , Jing Su , Lingpeng Kong , Jingjing Xu , Zhi-Hong Deng , Hongxia Yang

Text-based games (TGs) are language-based interactive environments for reinforcement learning. While language models (LMs) and knowledge graphs (KGs) are commonly used for handling large action space in TGs, it is unclear whether these…

Machine Learning · Computer Science 2023-12-01 Dongwon Kelvin Ryu , Meng Fang , Shirui Pan , Gholamreza Haffari , Ehsan Shareghi

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Advancements in large language models (LLMs) are revolutionizing interactive game design, enabling dynamic plotlines and interactions between players and non-player characters (NPCs). However, LLMs may exhibit flaws such as hallucinations,…

Computation and Language · Computer Science 2025-02-25 Claire Jin , Sudha Rao , Xiangyu Peng , Portia Botchway , Jessica Quaye , Chris Brockett , Bill Dolan

Multi-agent simulations are versatile tools for exploring interactions among natural and artificial agents, but their development typically demands domain expertise and manual effort. This work introduces the Generative Agents for…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi

Design patterns have been used in various fields of inquiry and endeavour to externalize procedural knowledge in a form that supports human reasoning and coordination. In this paper, we show that contemporary Large Language Model…

Human-Computer Interaction · Computer Science 2026-02-05 Joseph Corneli , Charles J. Danoff , Raymond S. Puzio , Sridevi Ayloo , Sergio Belich , Andre Wilkinson , Mary Tedeschi , Pauline Mosley