English
Related papers

Related papers: User Simulation for Evaluating Information Access …

200 papers

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system,…

Information Retrieval · Computer Science 2024-04-01 Yue Zheng , Lei Yu , Junmian Chen , Tianyu Xia , Yuanyuan Yin , Shan Wang , Haiming Liu

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search terms and return a…

Computation and Language · Computer Science 2021-04-15 Victor S. Bursztyn , Jennifer Healey , Eunyee Koh , Nedim Lipka , Larry Birnbaum

Due to the advantages in the cost-efficiency and reproducibility, user simulation has become a promising solution to the user-centric evaluation of information retrieval systems. Nonetheless, accurately simulating user search behaviors has…

Information Retrieval · Computer Science 2024-10-30 Erhan Zhang , Xingzhu Wang , Peiyuan Gong , Yankai Lin , Jiaxin Mao

Recommender systems engage user profiles and appropriate filtering techniques to assist users in finding more relevant information over the large volume of information. User profiles play an important role in the success of recommendation…

Information Retrieval · Computer Science 2011-09-02 Bahram Amini , Roliana Ibrahim , Mohd Shahizan Othman

Understanding user behaviors on social media has garnered significant scholarly attention, enhancing our comprehension of how virtual platforms impact society and empowering decision-makers. Simulating social media behaviors provides a…

Human-Computer Interaction · Computer Science 2025-06-18 Ziyue Lin , Yi Shan , Lin Gao , Xinghua Jia , Siming Chen

User simulation has been a cost-effective technique for evaluating conversational recommender systems. However, building a human-like simulator is still an open challenge. In this work, we focus on how users reformulate their utterances…

Information Retrieval · Computer Science 2022-05-05 Shuo Zhang , Mu-Chun Wang , Krisztian Balog

Conversational search systems enable information retrieval via natural language interactions, with the goal of maximizing users' information gain over multiple dialogue turns. The increasing prevalence of conversational interfaces adopting…

Computation and Language · Computer Science 2024-07-02 Phillip Schneider , Wessel Poelman , Michael Rovatsos , Florian Matthes

Recommender systems can be characterized as software solutions that provide users convenient access to relevant content. Traditionally, recommender systems research predominantly focuses on developing machine learning algorithms that aim to…

Information Retrieval · Computer Science 2022-10-20 Dietmar Jannach

Usability issues can hinder the effective use of software. Therefore, various techniques are deployed to diagnose and mitigate them. However, these techniques are costly and time-consuming, particularly in iterative design and development.…

Human-Computer Interaction · Computer Science 2025-04-03 Eduard Kuric , Peter Demcak , Matus Krajcovic , Jan Lang

Many interactive data systems combine visual representations of data with embedded algorithmic support for automation and data exploration. To effectively support transparent and explainable data systems, it is important for researchers and…

Human-Computer Interaction · Computer Science 2022-11-10 Jeremy E. Block , Eric D. Ragan

Conversational Recommender Systems (CRSs)aim to engage users in dialogue to provide tailored recommendations. While traditional CRSs focus on eliciting preferences and retrieving items, real-world e-commerce interactions involve more…

Information Retrieval · Computer Science 2025-08-08 Tongyoung Kim , Jeongeun Lee , Soojin Yoon , Sunghwan Kim , Dongha Lee

Adding explanations to recommender systems is said to have multiple benefits, such as increasing user trust or system transparency. Previous work from other application areas suggests that specific user characteristics impact the users'…

Human-Computer Interaction · Computer Science 2025-02-04 Kathrin Wardatzky , Oana Inel , Luca Rossetto , Abraham Bernstein

Conversational recommender systems (CRS) enhance user experience through multi-turn interactions, yet evaluating CRS remains challenging. User simulators can provide comprehensive evaluations through interactions with CRS, but building…

Human-Computer Interaction · Computer Science 2025-08-01 Luyu Chen , Quanyu Dai , Zeyu Zhang , Xueyang Feng , Mingyu Zhang , Pengcheng Tang , Xu Chen , Yue Zhu , Zhenhua Dong

User simulation has long played a vital role in computer science due to its potential to support a wide range of applications. Language, as the primary medium of human communication, forms the foundation of social interaction and behavior.…

Simulators can provide valuable insights for researchers and practitioners who wish to improve recommender systems, because they allow one to easily tweak the experimental setup in which recommender systems operate, and as a result lower…

Information Retrieval · Computer Science 2024-04-09 Romain Deffayet , Thibaut Thonet , Dongyoon Hwang , Vassilissa Lehoux , Jean-Michel Renders , Maarten de Rijke

The conversational search task aims to enable a user to resolve information needs via natural language dialogue with an agent. In this paper, we aim to develop a conceptual framework of the actions and intents of users and agents explaining…

Information Retrieval · Computer Science 2024-04-15 Leif Azzopardi , Mateusz Dubiel , Martin Halvey , Jeffery Dalton

Recommender systems are one of the most successful applications of data mining and machine learning technology in practice. Academic research in the field is historically often based on the matrix completion problem formulation, where for…

Information Retrieval · Computer Science 2018-02-26 Massimo Quadrana , Paolo Cremonesi , Dietmar Jannach

While user-modeling and recommender systems successfully utilize items like emails, news, and movies, they widely neglect mind-maps as a source for user modeling. We consider this a serious shortcoming since we assume user modeling based on…

Information Retrieval · Computer Science 2017-03-28 Joeran Beel

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

Human-Computer Interaction · Computer Science 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

Simulations in information access (IA) have recently gained interest, as shown by various tutorials and workshops around that topic. Simulations can be key contributors to central IA research and evaluation questions, especially around…

Information Retrieval · Computer Science 2025-05-20 Philipp Schaer , Christin Katharina Kreutz , Krisztian Balog , Timo Breuer , Andreas Konstantin Kruff