English
Related papers

Related papers: LLM-Driven NPCs: Cross-Platform Dialogue System fo…

200 papers

Large Language Models (LLMs) have demonstrated remarkable capabilities in generating human-like text, yet their applicability to dialogue systems in computer games remains limited. This limitation arises from their substantial hardware…

Artificial Intelligence · Computer Science 2025-11-14 Martin Braas , Lukas Esterle

We present an approach for enhancing non-playable characters (NPCs) in games by combining large language models (LLMs) with computer vision to provide contextual awareness of their surroundings. Conventional NPCs typically rely on…

Graphics · Computer Science 2026-04-24 Grega Radež , Ciril Bohak

Conversational agents show the promise to allow users to interact with mobile devices using language. However, to perform diverse UI tasks with natural language, developers typically need to create separate datasets and models for each…

Human-Computer Interaction · Computer Science 2023-02-21 Bryan Wang , Gang Li , Yang Li

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Large language models (LLMs) are increasingly integrated into daily life through conversational interfaces, processing user data via natural language inputs and exhibiting advanced reasoning capabilities, which raises new concerns about…

Human-Computer Interaction · Computer Science 2026-02-12 Zhuoyang Li , Yanlai Wu , Yao Li , Xinning Gui , Yuhan Luo

We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate between the surface…

Computation and Language · Computer Science 2024-02-20 Tom Bocklisch , Thomas Werkmeister , Daksh Varshneya , Alan Nichol

The rapid advancement of Artificial Intelligence has resulted in the advent of Large Language Models (LLMs) with the capacity to produce text that closely resembles human communication. These models have been seamlessly integrated into…

Machine Learning · Computer Science 2025-02-04 Zenon Lamprou , Yashar Moshfeghi

The evolution of Large Language Models (LLMs) has showcased remarkable capacities for logical reasoning and natural language comprehension. These capabilities can be leveraged in solutions that semantically and textually model complex…

Human-Computer Interaction · Computer Science 2024-04-17 Syed Mekael Wasti , Ken Q. Pu , Ali Neshati

Role-playing games (RPGs) provide players with a rich, interactive world to explore. Dialogue serves as the primary means of communication between developers and players, manifesting in various forms such as guides, NPC interactions, and…

Computation and Language · Computer Science 2024-07-31 Navapat Nananukul , Wichayaporn Wongkamjan

Large language models (LLMs) are bringing richer dialogue and social behavior into games, but they also expose a control problem that existing game interfaces do not directly address: how should LLM characters participate in live…

Human-Computer Interaction · Computer Science 2026-04-07 Yunjia Guo , Jinghan Zhu , Siyu Wang , Haixin Qiao

As large language models (LLMs) increasingly permeate daily lives, there is a growing demand for real-time interactions that mirror human conversations. Traditional turn-based chat systems driven by LLMs prevent users from verbally…

Computation and Language · Computer Science 2026-01-14 Xinrong Zhang , Yingfa Chen , Shengding Hu , Xu Han , Zihang Xu , Yuanwei Xu , Weilin Zhao , Maosong Sun , Zhiyuan Liu

We have reached a practical and realistic phase in human-support dialogue agents by developing a large language model (LLM). However, when requiring expert knowledge or anticipating the utterance content using the massive size of the…

Human-Computer Interaction · Computer Science 2023-12-22 Naoki Yoshimaru , Motoharu Okuma , Takamasa Iio , Kenji Hatano

In this paper, we propose MPC (Modular Prompted Chatbot), a new approach for creating high-quality conversational agents without the need for fine-tuning. Our method utilizes pre-trained large language models (LLMs) as individual modules…

Computation and Language · Computer Science 2023-08-17 Gibbeum Lee , Volker Hartmann , Jongho Park , Dimitris Papailiopoulos , Kangwook Lee

One major challenge in reinforcement learning (RL) is the large amount of steps for the RL agent needs to converge in the training process and learn the optimal policy, especially in text-based game environments where the action space is…

Computation and Language · Computer Science 2023-08-01 Wei Zhou , Xiangyu Peng , Mark Riedl

As Large Language Models (LLMs) evolve from static dialogue interfaces to autonomous general agents, effective memory is paramount to ensuring long-term consistency. However, existing benchmarks primarily focus on casual conversation or…

Computation and Language · Computer Science 2026-01-13 Haonan Bian , Zhiyuan Yao , Sen Hu , Zishan Xu , Shaolei Zhang , Yifu Guo , Ziliang Yang , Xueran Han , Huacan Wang , Ronghao Chen

The integration of Large Language Models (LLMs) into Virtual Reality (VR) games marks a paradigm shift in the design of immersive, adaptive, and intelligent digital experiences. This paper presents a comprehensive review of recent research…

Human-Computer Interaction · Computer Science 2025-11-24 Süeda Özkaya , Santiago Berrezueta-Guzman , Stefan Wagner

This paper investigates integrating large language models (LLMs) with advanced hardware, focusing on developing a general-purpose device designed for enhanced interaction with LLMs. Initially, we analyze the current landscape, where virtual…

Hardware Architecture · Computer Science 2024-08-21 Jiajun Xu , Qun Wang , Yuhang Cao , Baitao Zeng , Sicheng Liu

Large Language Models(LLMs) have dramatically revolutionized the field of Natural Language Processing(NLP), offering remarkable capabilities that have garnered widespread usage. However, existing interaction paradigms between LLMs and users…

Computation and Language · Computer Science 2024-03-11 Juhao Liang , Ziwei Wang , Zhuoheng Ma , Jianquan Li , Zhiyi Zhang , Xiangbo Wu , Benyou Wang

We propose a novel approach that uses large language models (LLMs) to generate persona-driven conversations between Players and Non-Player Characters (NPC) in games. Showcasing the application of our methodology, we introduce the Minecraft…

Developing chatbots as personal companions has long been a goal of artificial intelligence researchers. Recent advances in Large Language Models (LLMs) have delivered a practical solution for endowing chatbots with anthropomorphic language…

Human-Computer Interaction · Computer Science 2023-12-01 Zhenyu Xu , Hailin Xu , Zhouyang Lu , Yingying Zhao , Rui Zhu , Yujiang Wang , Mingzhi Dong , Yuhu Chang , Qin Lv , Robert P. Dick , Fan Yang , Tun Lu , Ning Gu , Li Shang
‹ Prev 1 2 3 10 Next ›