English
Related papers

Related papers: A Conceptual Framework for Implicit Evaluation of …

200 papers

Conversational recommender systems (CRS) generate recommendations through an interactive process. However, not all CRS approaches use human conversations as their source of interaction data; the majority of prior CRS work simulates…

Computation and Language · Computer Science 2023-09-15 Chuang Li , Hengchang Hu , Yan Zhang , Min-Yen Kan , Haizhou Li

User-centric evaluation has become a key paradigm for assessing Conversational Recommender Systems (CRS), aiming to capture subjective qualities such as satisfaction, trust, and rapport. To enable scalable evaluation, recent work…

Information Retrieval · Computer Science 2026-02-20 Michael Müller , Amir Reza Mohammadi , Andreas Peintner , Beatriz Barroso Gstrein , Günther Specht , Eva Zangerle

Conversational recommenders are emerging as a powerful tool to personalize a user's recommendation experience. Through a back-and-forth dialogue, users can quickly hone in on just the right items. Many approaches to conversational…

Information Retrieval · Computer Science 2023-02-15 Allen Lin , Ziwei Zhu , Jianling Wang , James Caverlee

The development of conversational agents (CAs) has shown strong potential in supporting mental health through dialogue. While many studies focus on CAs for individual psychological care, research on agents designed for couples facing…

Human-Computer Interaction · Computer Science 2025-10-21 Soyoung Jung , Sung Park

Explainable Information Retrieval (XIR) is a growing research area focused on enhancing transparency and trustworthiness of the complex decision-making processes taking place in modern information retrieval systems. While there has been…

Information Retrieval · Computer Science 2024-05-07 Catherine Chen , Carsten Eickhoff

Rather than using (proxies of) end user or expert judgment to decide on the ranking of information, this paper asks whether conversations about information quality might offer a feasible and valuable addition for ranking information. We…

Information Retrieval · Computer Science 2022-10-17 Frans van der Sluis

The importance of tasks in information retrieval (IR) has been long argued for, addressed in different ways, often ignored, and frequently revisited. For decades, scholars made a case for the role that a user's task plays in how and why…

Information Retrieval · Computer Science 2023-01-13 Chirag Shah , Ryen W. White , Paul Thomas , Bhaskar Mitra , Shawon Sarkar , Nicholas Belkin

The crucial role of the evaluation in the development of the information retrieval tools is useful evidence to improve the performance of these tools and the quality of results that they return. However, the classic evaluation approaches…

Information Retrieval · Computer Science 2011-06-01 Abdelkrim Bouramoul , Mohamed-Khireddine Kholladi , Bich-Lien Doan

Conversational search is an approach to information retrieval (IR), where users engage in a dialogue with an agent in order to satisfy their information needs. Previous conceptual work described properties and actions a good agent should…

Computation and Language · Computer Science 2019-12-11 Gustavo Penha , Alexandru Balan , Claudia Hauff

Conversational recommender systems (CRS) aim to capture user's current intentions and provide recommendations through real-time multi-turn conversational interactions. As a human-machine interactive system, it is essential for CRS to…

Information Retrieval · Computer Science 2022-07-05 Shuokai Li , Yongchun Zhu , Ruobing Xie , Zhenwei Tang , Zhao Zhang , Fuzhen Zhuang , Qing He , Hui Xiong

Conversational AI systems combine AI-based solutions with the flexibility of conversational interfaces. However, most existing testing solutions do not straightforwardly adapt to the characteristics of conversational interaction or to the…

Software Engineering · Computer Science 2026-02-04 Elena Masserini

It is natural for humans to collaborate while dealing with complex problems. In this article I consider this process of collaboration in the context of information seeking. The study and discussion presented here are driven by two…

Information Retrieval · Computer Science 2009-08-06 Chirag Shah

Conversational search systems, such as Google Assistant and Microsoft Cortana, provide a new search paradigm where users are allowed, via natural language dialogues, to communicate with search systems. Evaluating such systems is very…

Information Retrieval · Computer Science 2021-09-08 Zeyang Liu , Ke Zhou , Jiaxin Mao , Max L. Wilson

Conversational recommender systems have attracted immense attention recently. The most recent approaches rely on neural models trained on recorded dialogs between humans, implementing an end-to-end learning process. These systems are…

Information Retrieval · Computer Science 2022-05-26 Ahtsham Manzoor , Dietmar Jannach

Traditional recommender systems present a relatively static list of recommendations to a user where the feedback is typically limited to an accept/reject or a rating model. However, these simple modes of feedback may only provide limited…

Information Retrieval · Computer Science 2019-04-17 Oznur Alkan , Elizabeth M. Daly , Adi Botea

Conversational Recommender Systems (CRSs) have garnered attention as a novel approach to delivering personalized recommendations through multi-turn dialogues. This review developed a taxonomy framework to systematically categorize relevant…

Human-Computer Interaction · Computer Science 2025-06-26 Haoran Zhang , Xin Zhao , Jinze Chen , Junpeng Guo

Empathy is a vital factor that contributes to mutual understanding, and joint problem-solving. In recent years, a growing number of studies have recognized the benefits of empathy and started to incorporate empathy in conversational…

Computation and Language · Computer Science 2023-10-13 Aravind Sesagiri Raamkumar , Yinping Yang

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

Two key, but usually ignored, issues for the evaluation of methods of personalization for information retrieval are: that such evaluation must be of a search session as a whole; and, that people, during the course of an information search…

Information Retrieval · Computer Science 2018-09-10 Nicholas J. Belkin , Daniel Hienert , Philipp Mayr , Chirag Shah

Context: User intent modeling is a crucial process in Natural Language Processing that aims to identify the underlying purpose behind a user's request, enabling personalized responses. With a vast array of approaches introduced in the…