English
Related papers

Related papers: A Conceptual Framework for Implicit Evaluation of …

200 papers

Conversational search applications offer the prospect of improved user experience in information seeking via agent support. However, it is not clear how searchers will respond to this mode of engagement, in comparison to a conventional…

Human-Computer Interaction · Computer Science 2023-03-21 Abhishek Kaushik , Gareth J. F. Jones

Various conceptual and descriptive models of conversational search have been proposed in the literature -- while useful, they do not provide insights into how interaction between the agent and user would change in response to the costs and…

Information Retrieval · Computer Science 2022-01-24 Leif Azzopardi , Mohammad Aliannejadi , Evangelos Kanoulas

A conversational information retrieval (CIR) system is an information retrieval (IR) system with a conversational interface which allows users to interact with the system to seek information via multi-turn conversations of natural language,…

Information Retrieval · Computer Science 2022-01-17 Jianfeng Gao , Chenyan Xiong , Paul Bennett , Nick Craswell

Information seeking conversations between users and Conversational Search Agents (CSAs) consist of multiple turns of interaction. While users initiate a search session, ideally a CSA should sometimes take the lead in the conversation by…

Information Retrieval · Computer Science 2021-09-14 Mohammad Aliannejadi , Leif Azzopardi , Hamed Zamani , Evangelos Kanoulas , Paul Thomas , Nick Craswel

Conversational search enables multi-turn interactions between users and systems to fulfill users' complex information needs. During this interaction, the system should understand the users' search intent within the conversational context…

Information Retrieval · Computer Science 2025-06-13 Fengran Mo , Chuan Meng , Mohammad Aliannejadi , Jian-Yun Nie

With the increasing popularity of conversational search, how to evaluate the performance of conversational search systems has become an important question in the IR community. Existing works on conversational search evaluation can mainly be…

Information Retrieval · Computer Science 2024-01-25 Zhumin Chu , Qingyao Ai , Zhihong Wang , Yiqun Liu , Yingye Huang , Rui Zhang , Min Zhang , Shaoping Ma

Conversational search has seen increased recent attention in both the IR and NLP communities. It seeks to clarify and solve users' search needs through multi-turn natural language interactions. However, most existing systems are trained and…

Information Retrieval · Computer Science 2024-02-12 Zhenduo Wang , Zhichao Xu , Qingyao Ai , Vivek Srikumar

Research and development on conversational recommender systems (CRSs) critically depends on sound and reliable evaluation methodologies. However, the interactive nature of these systems poses significant challenges for automatic evaluation.…

Information Retrieval · Computer Science 2025-10-08 Nolwenn Bernard , Krisztian Balog

Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any…

Information Retrieval · Computer Science 2021-04-29 Zeyang Liu , Ke Zhou , Max L. Wilson

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system,…

Information Retrieval · Computer Science 2024-04-01 Yue Zheng , Lei Yu , Junmian Chen , Tianyu Xia , Yuanyuan Yin , Shan Wang , Haiming Liu

Empathetic Conversational Systems (ECS) are built to respond empathetically to the user's emotions and sentiments, regardless of the application domain. Current ECS studies evaluation approaches are restricted to offline evaluation…

Computation and Language · Computer Science 2024-07-29 Aravind Sesagiri Raamkumar , Siyuan Brandon Loh

Conversational search presents opportunities to support users in their search activities to improve the effectiveness and efficiency of search while reducing their cognitive load. Limitations of the potential competency of conversational…

Human-Computer Interaction · Computer Science 2021-04-12 Abhishek Kaushik , Gareth J. F. Jones

Conversational Recommender Systems (CRSs) are receiving growing research attention across domains, yet their user experience (UX) evaluation remains limited. Existing reviews largely overlook empirical UX studies, particularly in adaptive…

Information Retrieval · Computer Science 2025-08-07 Raj Mahmud , Yufeng Wu , Abdullah Bin Sawad , Shlomo Berkovsky , Mukesh Prasad , A. Baki Kocaballi

This paper discusses the potential for creating academic resources (tools, data, and evaluation approaches) to support research in conversational search, by focusing on realistic information needs and conversational interactions.…

Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show…

Information Retrieval · Computer Science 2023-10-23 Kelong Mao , Zhicheng Dou , Fengran Mo , Jiewen Hou , Haonan Chen , Hongjin Qian

Conversational recommender systems (CRSs) integrate both recommendation and dialogue tasks, making their evaluation uniquely challenging. Existing approaches primarily assess CRS performance by separately evaluating item recommendation and…

Information Retrieval · Computer Science 2026-01-27 Nuo Chen , Quanyu Dai , Xiaoyu Dong , Piaohong Wang , Qinglin Jia , Zhaocheng Du , Zhenhua Dong , Xiao-Ming Wu

Information access systems such as search engines and generative AI are central to how people seek, evaluate, and interpret information. Yet most systems are designed to optimise retrieval rather than to help users develop better search…

Human-Computer Interaction · Computer Science 2026-01-14 David Elsweiler

Conversational Information Retrieval (CIR) is an emerging field of Information Retrieval (IR) at the intersection of interactive IR and dialogue systems for open domain information needs. In order to optimize these interactions and enhance…

Information Retrieval · Computer Science 2022-01-11 Pierre Erbacher , Laure Soulier , Ludovic Denoyer

Search engines are the most commonly used type of tool for finding relevant information on the Internet. However, today's search engines are far from perfect. Typical search queries are short, often one or two words, and can be ambiguous…

Information Retrieval · Computer Science 2014-07-24 Dilip K. Limbu , Andy M. Connor , Stephen G. MacDonell

We propose a unified Implicit Dialog framework for goal-oriented, information seeking tasks of Conversational Search applications. It aims to enable dialog interactions with domain data without replying on explicitly encoded the rules but…

Computation and Language · Computer Science 2018-02-14 Song Feng , R. Chulaka Gunasekara , Sunil Shashidhara , Kshitij P. Fadnis , Lazaros C. Polymenakos