English
Related papers

Related papers: A Conceptual Framework for Implicit Evaluation of …

200 papers

As a primary means of information acquisition, information retrieval (IR) systems, such as search engines, have integrated themselves into our daily lives. These systems also serve as components of dialogue, question-answering, and…

Computation and Language · Computer Science 2025-09-18 Yutao Zhu , Huaying Yuan , Shuting Wang , Jiongnan Liu , Wenhan Liu , Chenlong Deng , Haonan Chen , Zheng Liu , Zhicheng Dou , Ji-Rong Wen

Interactive communication (IC), i.e., the reciprocal exchange of information between two or more interactive partners, is a fundamental part of human nature. As such, it has been studied across multiple scientific disciplines with different…

Exploratory search is an open-ended information retrieval process that aims at discovering knowledge about a topic or domain rather than searching for a specific answer or piece of information. Conversational interfaces are particularly…

Computation and Language · Computer Science 2023-10-10 Phillip Schneider , Nils Rehtanz , Kristiina Jokinen , Florian Matthes

Usability testing is an essential part of product design, particularly for user interfaces. To enhance the reliability of usability evaluations, employing cognitive load measurement methods can be highly effective in assessing the mental…

Human-Computer Interaction · Computer Science 2024-02-20 Ali Darejeh , Nadine Marcusa , Gelareh Mohammadi , John Sweller

Conversational Machine Comprehension (CMC), a research track in conversational AI, expects the machine to understand an open-domain natural language text and thereafter engage in a multi-turn conversation to answer questions related to the…

Computation and Language · Computer Science 2021-02-09 Somil Gupta , Bhanu Pratap Singh Rawat , Hong Yu

Conversational recommender systems (CRSs) have become crucial emerging research topics in the field of RSs, thanks to their natural advantages of explicitly acquiring user preferences via interactive conversations and revealing the reasons…

Information Retrieval · Computer Science 2023-06-16 Xinghua Qu , Hongyang Liu , Zhu Sun , Xiang Yin , Yew Soon Ong , Lu Lu , Zejun Ma

API search involves finding components in an API that are relevant to a programming task. For example, a programmer may need a function in a C library that opens a new network connection, then another function that sends data across that…

Software Engineering · Computer Science 2021-07-27 Zachary Eberhart , Collin McMillan

We present a low-compute non-generative system for implementing interview-style conversational agents which can be used to facilitate qualitative data collection through controlled interactions and quantitative analysis. Use cases include…

Computation and Language · Computer Science 2025-08-21 Charles Welch , Allison Lahnala , Vasudha Varadarajan , Lucie Flek , Rada Mihalcea , J. Lomax Boyd , João Sedoc

This work falls in the areas of information retrieval and semantic web, and aims to improve the evaluation of web search tools. Indeed, the huge number of information on the web as well as the growth of new inexperienced users creates new…

Information Retrieval · Computer Science 2012-12-12 Abdelkrim Bouramoul , Mohamed-Khireddine Kholladi , Bich-Liên Doan

Many people browse online communities to learn from others' experiences and opinions, e.g., for constructing travel plans. Conversational search powered by large language models (LLMs) could ease this information-seeking task, but it…

Human-Computer Interaction · Computer Science 2026-05-05 Shiwei Wu , Xinyue Chen , Yuheng Liu , Xingbo Wang , Qingyu Guo , Longfei Chen , Chuhan Shi , Zhenhui Peng

Textual queries are largely employed in information retrieval to let users specify search goals in a natural way. However, differences in user and system terminologies can challenge the identification of the user's information needs, and…

Information Retrieval · Computer Science 2020-03-31 Noemi Mauro , Liliana Ardissono , Adriano Savoca

Conversational Recommender Systems (CRS) has become an emerging research topic seeking to perform recommendations through interactive conversations, which generally consist of generation and recommendation modules. Prior work on CRS tends…

Computation and Language · Computer Science 2022-09-26 Lingzhi Wang , Shafiq Joty , Wei Gao , Xingshan Zeng , Kam-Fai Wong

Conversational information-seeking (CIS) is an emerging paradigm for knowledge acquisition and exploratory search. Traditional web search interfaces enable easy exploration of entities, but this is limited in conversational settings due to…

Information Retrieval · Computer Science 2024-03-05 Ivan Sekulić , Krisztian Balog , Fabio Crestani

How can we enable users to heavily specify criteria for database queries in a user-friendly way? This paper describes a general framework of a conversational bot that extracts meaningful information from user's sentences, that asks…

Computation and Language · Computer Science 2018-08-30 Isak Czeresnia Etinger

Conversational agents ("bots") are beginning to be widely used in conversational interfaces. To design a system that is capable of emulating human-like interactions, a conversational layer that can serve as a fabric for chat-like…

Artificial Intelligence · Computer Science 2016-06-23 Abhay Prakash , Chris Brockett , Puneet Agrawal

Users increasingly expect modern search systems to offer a unified interface that seamlessly retrieves information from diverse data sources and formats. However, current information retrieval (IR) evaluation benchmarks have not kept pace…

Information Retrieval · Computer Science 2026-05-13 Mehmet Deniz Türkmen , Suchana Datta , Dwaipayan Roy , Daniel Hienert , Philipp Mayr , Derek Greene

The rise of intelligent assistant systems like Siri and Alexa have led to the emergence of Conversational Search, a research track of Information Retrieval (IR) that involves interactive and iterative information-seeking user-system dialog.…

Information Retrieval · Computer Science 2021-02-09 Somil Gupta , Neeraj Sharma

We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO). BIRCO evaluates the ability of IR systems to retrieve documents given multi-faceted user objectives. The benchmark's complexity and compact size…

Information Retrieval · Computer Science 2024-04-05 Xiaoyue Wang , Jianyou Wang , Weili Cao , Kaicheng Wang , Ramamohan Paturi , Leon Bergen

The modern information environment (MIE) is increasingly complex, shaped by a wide range of techniques designed to satisfy users' information needs. Information seeking (IS) models are effective mechanisms for characterizing user-system…

Information Retrieval · Computer Science 2025-10-10 Shuoqi Sun , Danula Hettiachchi , Damiano Spina

Child Forensic Interviewing (FI) presents a challenge for effective information retrieval and decision making. The high stakes associated with the process demand that expert legal interviewers are able to effectively establish a channel of…

Computation and Language · Computer Science 2018-06-13 Victor Ardulov , Manoj Kumar , Shanna Williams , Thomas Lyon , Shrikanth Narayanan