English
Related papers

Related papers: Leveraging User Simulation to Develop and Evaluate…

200 papers

In this project, we designed an intelligent assistant player for the single-player game Space Invaders with the aim to provide a satisfying co-op experience. The agent behaviour was designed using reinforcement learning techniques and…

Artificial Intelligence · Computer Science 2021-05-10 Ajay Krishnan , Niranj Jyothish , Xun Jia

Amid the rapid rise of agentic dialogue models, realistic user-simulator studies are essential for tuning effective conversation strategies. This work investigates a sales-oriented agent that adapts its dialogue based on user profiles…

Computation and Language · Computer Science 2025-12-08 Wen-Yu Chang , Tzu-Hung Huang , Chih-Ho Chen , Yun-Nung Chen

As AI Agents based on Large Language Models (LLMs) have shown potential in practical applications across various fields, how to quickly deploy an AI agent and how to conveniently expand the application scenario of AI agents has become a…

Artificial Intelligence · Computer Science 2024-03-25 Peng Xu , Haoran Wang , Chuang Wang , Xu Liu

The traditional user-centered design process can hardly keep up with the ever faster technical development and increasingly diverse user preferences. As a solution, we propose to augment the tried-and-tested approach of conducting user…

Human-Computer Interaction · Computer Science 2023-02-23 Florian Fischer , Arthur Fleig , Markus Klar , Viktorija Paneva , Jörg Müller

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can (1) learn by themselves continually in a self-motivated and self-initiated manner rather than being…

Artificial Intelligence · Computer Science 2023-04-21 Bing Liu , Sahisnu Mazumder , Eric Robertson , Scott Grigsby

User studies are central to user experience research, yet recruiting participant is expensive, slow, and limited in diversity. Recent work has explored using Large Language Models as simulated users, but doubts about fidelity have hindered…

Human-Computer Interaction · Computer Science 2025-10-20 Siyang Liu , Sahand Sabour , Xiaoyang Wang , Rada Mihalcea

Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. One common alternative is to use a user simulator. However, a user simulator usually lacks the…

Computation and Language · Computer Science 2018-05-24 Baolin Peng , Xiujun Li , Jianfeng Gao , Jingjing Liu , Kam-Fai Wong , Shang-Yu Su

Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research…

Despite the intricacies involved in designing a computer as a teampartner, we can observe patterns in team behavior which allow us to describe at a general level how AI systems are to collaborate with humans. Whereas most work on…

Human-Computer Interaction · Computer Science 2021-01-18 Jurriaan van Diggelen , Wiard Jorritsma , Bob van der Vecht

User simulation has been a cost-effective technique for evaluating conversational recommender systems. However, building a human-like simulator is still an open challenge. In this work, we focus on how users reformulate their utterances…

Information Retrieval · Computer Science 2022-05-05 Shuo Zhang , Mu-Chun Wang , Krisztian Balog

Simulating nuanced user experiences within complex interactive search systems poses distinct challenge for traditional methodologies, which often rely on static user proxies or, more recently, on standalone large language model (LLM) agents…

Information Retrieval · Computer Science 2026-03-02 Saber Zerhoudi , Michael Granitzer

Games and simulators can be a valuable platform to execute complex multi-agent, multiplayer, imperfect information scenarios with significant parallels to military applications: multiple participants manage resources and make decisions that…

Computer use agents (CUA) are systems that automatically interact with graphical user interfaces (GUIs) to complete tasks. CUA have made significant progress with the advent of large vision-language models (VLMs). However, these agents…

Artificial Intelligence · Computer Science 2025-06-04 Man Luo , David Cobbley , Xin Su , Shachar Rosenman , Vasudev Lal , Shao-Yen Tseng , Phillip Howard

AI agents are being developed to support high stakes decision-making processes from driving cars to prescribing drugs, making it increasingly important for human users to understand their behavior. Policy summarization methods aim to convey…

Machine Learning · Computer Science 2019-06-03 Isaac Lage , Daphna Lifschitz , Finale Doshi-Velez , Ofra Amir

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

Cryptography and Security · Computer Science 2026-05-11 Yanzhe Zhang , Diyi Yang

In the domain of combat simulations in support of wargaming, the development of intelligent agents has predominantly been characterized by rule-based, scripted methodologies with deep reinforcement learning (RL) approaches only recently…

Machine Learning · Computer Science 2025-12-02 Scotty Black , Christian Darken

Generating user activity is a key capability for both evaluating security monitoring tools as well as improving the credibility of attacker analysis platforms (e.g., honeynets). In this paper, to generate this activity, we instrument each…

Artificial Intelligence · Computer Science 2021-11-24 Alexandre Dey , Benjamin Costé , Éric Totel , Adrien Bécue

Task-oriented dialogue systems can efficiently serve a large number of customers and relieve people from tedious works. However, existing task-oriented dialogue systems depend on handcrafted actions and states or extra semantic labels,…

Computation and Language · Computer Science 2017-11-13 Weiyan Wang , Yuxiang WU , Yu Zhang , Zhongqi Lu , Kaixiang Mo , Qiang Yang

User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user…

Information Retrieval · Computer Science 2024-12-24 Zijian Zhang , Shuchang Liu , Ziru Liu , Rui Zhong , Qingpeng Cai , Xiangyu Zhao , Chunxu Zhang , Qidong Liu , Peng Jiang

Intelligent Process Automation (IPA) is an emerging technology with a primary goal to assist the knowledge worker by taking care of repetitive, routine and low-cognitive tasks. Conversational agents that can interact with users in a natural…

Computation and Language · Computer Science 2020-05-22 Alena Moiseeva , Dietrich Trautmann , Michael Heimann , Hinrich Schütze