English
Related papers

Related papers: A Conceptual Framework for Implicit Evaluation of …

200 papers

Conversational Recommender Systems (CRSs) deliver personalised recommendations through multi-turn natural language dialogue and increasingly support both task-oriented and exploratory interactions. Yet, the factors shaping user interaction…

Human-Computer Interaction · Computer Science 2025-08-05 Raj Mahmud , Shlomo Berkovsky , Mukesh Prasad , A. Baki Kocaballi

Conversational recommendation systems (CRS) aim to recommend suitable items to users through natural language conversation. However, most CRS approaches do not effectively utilize the signal provided by these conversations. They rely…

Computation and Language · Computer Science 2023-05-24 Raghav Gupta , Renat Aksitov , Samrat Phatale , Simral Chaudhary , Harrison Lee , Abhinav Rastogi

How can we better understand the mechanisms behind multi-turn information seeking dialogues? How can we use these insights to design a dialogue system that does not require explicit query formulation upfront as in question answering? To…

Information Retrieval · Computer Science 2020-12-08 Svitlana Vakulenko , Vadim Savenkov , Maarten de Rijke

While previous conversational information-seeking (CIS) research has focused on passage retrieval, reranking, and query rewriting, the challenge of synthesizing retrieved information into coherent responses remains. The proposed research…

Information Retrieval · Computer Science 2024-06-28 Weronika Łajewska

Even the best information retrieval model cannot always identify the most useful answers to a user query. This is in particular the case with web search systems, where it is known that users tend to minimise their effort to access relevant…

Information Retrieval · Computer Science 2009-06-23 B. Piwowarski , M. Lalmas

Conversational information seeking (CIS) systems aim to model the user's information need within the conversational context and retrieve the relevant information. One major approach to modeling the conversational context aims to rewrite the…

Information Retrieval · Computer Science 2024-11-04 Zahra Abbasiantaeb , Simon Lupart , Mohammad Aliannejadi

Conversational AI chatbots are transforming industries by streamlining customer service, automating transactions, and enhancing user engagement. However, evaluating these systems remains a challenge, particularly in financial services,…

Computers and Society · Computer Science 2025-02-11 Shailja Gupta , Rajesh Ranjan , Surya Narayan Singh

Allowing users to interact with multi-document summarizers is a promising direction towards improving and customizing summary results. Different ideas for interactive summarization have been proposed in previous work but these solutions are…

Computation and Language · Computer Science 2020-09-18 Ori Shapira , Ramakanth Pasunuru , Hadar Ronen , Mohit Bansal , Yael Amsterdamer , Ido Dagan

As information retrieval (IR) systems, such as search engines and conversational agents, become ubiquitous in various domains, the need for transparent and explainable systems grows to ensure accountability, fairness, and unbiased results.…

Information Retrieval · Computer Science 2024-05-07 Catherine Chen , Carsten Eickhoff

Recommender systems are software applications that help users find items of interest in situations of information overload in a personalized way, using knowledge about the needs and preferences of individual users. In conversational…

Artificial Intelligence · Computer Science 2022-02-10 Tommaso Di Noia , Francesco Donini , Dietmar Jannach , Fedelucio Narducci , Claudio Pomo

Conversational interfaces are currently on the rise: more and more applications rely on a chat-like interaction pattern to increase their acceptability and to improve user experience. Also in the area of questionnaire design and…

Human-Computer Interaction · Computer Science 2020-03-06 Irene Celino , Gloria Re Calegari

Conversational interfaces provide a flexible and easy way for users to seek information that may otherwise be difficult or inconvenient to obtain. However, existing interfaces generally fall into one of two categories: FAQs, where users…

Computation and Language · Computer Science 2024-03-27 Dirk Väth , Lindsey Vanderlyn , Ngoc Thang Vu

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Information access systems, such as search engines, recommender systems, and conversational assistants, have become integral to our daily lives as they help us satisfy our information needs. However, evaluating the effectiveness of these…

Human-Computer Interaction · Computer Science 2026-04-21 Krisztian Balog , ChengXiang Zhai

Conversational information access is an emerging research area. Currently, human evaluation is used for end-to-end system evaluation, which is both very time and resource intensive at scale, and thus becomes a bottleneck of progress. As an…

Information Retrieval · Computer Science 2020-06-17 Shuo Zhang , Krisztian Balog

The conversational recommendation system (CRS) has been criticized regarding its user experience in real-world scenarios, despite recent significant progress achieved in academia. Existing evaluation protocols for CRS may prioritize…

Computation and Language · Computer Science 2024-05-07 Chen Huang , Peixin Qin , Yang Deng , Wenqiang Lei , Jiancheng Lv , Tat-Seng Chua

Traditional search methods primarily depend on string matches, while semantic search targets concept-based matches by recognizing underlying intents and contextual meanings of search terms. Semantic search is particularly beneficial for…

Computation and Language · Computer Science 2024-10-02 Phillip Schneider , Florian Matthes

One of the main challenges in Interactive Information Retrieval (IIR) evaluation is the development and application of re-usable tools that allow researchers to analyze search behavior of real users in different environments and different…

Information Retrieval · Computer Science 2015-04-28 Daniel Hienert , Wilko van Hoek , Alina Weber , Dagmar Kern

Conversational information seeking (CIS) is playing an increasingly important role in connecting people to information. Due to the lack of suitable resource, previous studies on CIS are limited to the study of theoretical/conceptual…

Information Retrieval · Computer Science 2021-05-19 Pengjie Ren , Zhongkun Liu , Xiaomeng Song , Hongtao Tian , Zhumin Chen , Zhaochun Ren , Maarten de Rijke

Conversational Recommender Systems (CRSs)aim to engage users in dialogue to provide tailored recommendations. While traditional CRSs focus on eliciting preferences and retrieving items, real-world e-commerce interactions involve more…

Information Retrieval · Computer Science 2025-08-08 Tongyoung Kim , Jeongeun Lee , Soojin Yoon , Sunghwan Kim , Dongha Lee