English
Related papers

Related papers: Leveraging User Simulation to Develop and Evaluate…

200 papers

Computer-Using Agents (CUA) enable users to automate increasingly-complex tasks using graphical interfaces such as browsers. As many potential tasks require personal data, we propose Computer-Using Personal Agents (CUPAs) that have access…

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

This research aims to explore various methods for assessing user feedback in mixed-initiative conversational search (CS) systems. While CS systems enjoy profuse advancements across multiple aspects, recent research fails to successfully…

Information Retrieval · Computer Science 2023-05-09 Paul Owoicho , Ivan Sekulić , Mohammad Aliannejadi , Jeffrey Dalton , Fabio Crestani

Computer-Using Agents (CUAs) aim to autonomously operate computer systems to complete real-world tasks. However, existing agentic systems remain difficult to scale and lag behind human performance. A key limitation is the absence of…

We develop a reinforcement learning based search assistant which can assist users through a set of actions and sequence of interactions to enable them realize their intent. Our approach caters to subjective search where the user is seeking…

Artificial Intelligence · Computer Science 2018-08-21 Milan Aggarwal , Aarushi Arora , Shagun Sodhani , Balaji Krishnamurthy

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…

User simulators serve as the critical interactive environment for agent post-training, and an ideal user simulator generalizes across domains and proactively engages in negotiation by challenging or bargaining. However, current methods…

Computation and Language · Computer Science 2026-01-15 Feng Zhang , Shijia Li , Chunmao Zhang , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu , Han Liu

Training dialog policies for speech-based virtual assistants requires a plethora of conversational data. The data collection phase is often expensive and time consuming due to human involvement. To address this issue, a common solution is…

Computation and Language · Computer Science 2019-11-11 Maryam Fazel-Zarandi , Longshaokan Wang , Aditya Tiwari , Spyros Matsoukas

We present a methodology to systematically test conversational recommender systems with regards to conversational breakdowns. It involves examining conversations generated between the system and simulated users for a set of pre-defined…

Information Retrieval · Computer Science 2024-05-24 Nolwenn Bernard , Krisztian Balog

Computer Use Agents (CUAs), autonomous systems that interact with software interfaces via browsers or virtual machines, are rapidly being deployed in consumer and enterprise environments. These agents introduce novel attack surfaces and…

Building embodied AI systems that can follow arbitrary language instructions in any 3D environment is a key challenge for creating general AI. Accomplishing this goal requires learning to ground language in perception and embodied actions,…

Robotics · Computer Science 2024-10-14 SIMA Team , Maria Abi Raad , Arun Ahuja , Catarina Barros , Frederic Besse , Andrew Bolt , Adrian Bolton , Bethanie Brownfield , Gavin Buttimore , Max Cant , Sarah Chakera , Stephanie C. Y. Chan , Jeff Clune , Adrian Collister , Vikki Copeman , Alex Cullum , Ishita Dasgupta , Dario de Cesare , Julia Di Trapani , Yani Donchev , Emma Dunleavy , Martin Engelcke , Ryan Faulkner , Frankie Garcia , Charles Gbadamosi , Zhitao Gong , Lucy Gonzales , Kshitij Gupta , Karol Gregor , Arne Olav Hallingstad , Tim Harley , Sam Haves , Felix Hill , Ed Hirst , Drew A. Hudson , Jony Hudson , Steph Hughes-Fitt , Danilo J. Rezende , Mimi Jasarevic , Laura Kampis , Rosemary Ke , Thomas Keck , Junkyung Kim , Oscar Knagg , Kavya Kopparapu , Rory Lawton , Andrew Lampinen , Shane Legg , Alexander Lerchner , Marjorie Limont , Yulan Liu , Maria Loks-Thompson , Joseph Marino , Kathryn Martin Cussons , Loic Matthey , Siobhan Mcloughlin , Piermaria Mendolicchio , Hamza Merzic , Anna Mitenkova , Alexandre Moufarek , Valeria Oliveira , Yanko Oliveira , Hannah Openshaw , Renke Pan , Aneesh Pappu , Alex Platonov , Ollie Purkiss , David Reichert , John Reid , Pierre Harvey Richemond , Tyson Roberts , Giles Ruscoe , Jaume Sanchez Elias , Tasha Sandars , Daniel P. Sawyer , Tim Scholtes , Guy Simmons , Daniel Slater , Hubert Soyer , Heiko Strathmann , Peter Stys , Allison C. Tam , Denis Teplyashin , Tayfun Terzi , Davide Vercelli , Bojan Vujatovic , Marcus Wainwright , Jane X. Wang , Zhengdong Wang , Daan Wierstra , Duncan Williams , Nathaniel Wong , Sarah York , Nick Young

Many studies have applied reinforcement learning to train a dialog policy and show great promise these years. One common approach is to employ a user simulator to obtain a large number of simulated user experiences for reinforcement…

Computation and Language · Computer Science 2020-04-24 Ryuichi Takanobu , Runze Liang , Minlie Huang

Given that experience is a pivotal dimension of learning processes in the field of leadership, the ongoing and unresolved issue is how such experiential moments could be provided when developing leadership skills and competencies.…

Human-Computer Interaction · Computer Science 2024-03-18 Francesco Vona , Miladin Ćeranić , Irma Rybnikova , Jan-Niklas Voigt-Antons

Creating personalized and adaptable conversational AI remains a key challenge. This paper introduces a Continuous Learning Conversational AI (CLCA) approach, implemented using A2C reinforcement learning, to move beyond static Large Language…

Artificial Intelligence · Computer Science 2025-02-19 Nandakishor M , Anjali M

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida

Recommender systems play a central role in numerous real-life applications, yet evaluating their performance remains a significant challenge due to the gap between offline metrics and online behaviors. Given the scarcity and limits (e.g.,…

Information Retrieval · Computer Science 2025-04-18 Nicolas Bougie , Narimasa Watanabe

Conversational search has seen increased recent attention in both the IR and NLP communities. It seeks to clarify and solve users' search needs through multi-turn natural language interactions. However, most existing systems are trained and…

Information Retrieval · Computer Science 2024-02-12 Zhenduo Wang , Zhichao Xu , Qingyao Ai , Vivek Srikumar

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah

In order to increase productivity, capability, and data exploitation, numerous defense applications are experiencing an integration of state-of-the-art machine learning and AI into their architectures. Especially for defense applications,…

Human-Computer Interaction · Computer Science 2020-03-24 Chris J. Michael , Dina Acklin , Jaelle Scheuerman

With growing capabilities of large language models (LLMs) comes growing affordances for human-like and context-aware conversational partners. On from this, some recent work has investigated the use of LLMs to simulate multiple…

Human-Computer Interaction · Computer Science 2023-12-29 Samuel Rhys Cox