English
Related papers

Related papers: CIRCLE: Multi-Turn Query Clarifications with Reinf…

200 papers

In conversational search, the user's real search intent for the current turn is dependent on the previous conversation history. It is challenging to determine a good search query from the whole conversation context. To avoid the expensive…

Information Retrieval · Computer Science 2024-01-30 Fengran Mo , Kelong Mao , Yutao Zhu , Yihong Wu , Kaiyu Huang , Jian-Yun Nie

Large language models (LLMs) are increasingly deployed as conversational assistants in open-domain, multi-turn settings, where users often provide incomplete or ambiguous information. However, existing LLM-focused clarification benchmarks…

Computation and Language · Computer Science 2025-12-25 Sichun Luo , Yi Huang , Mukai Li , Shichang Meng , Fengyuan Liu , Zefa Hu , Junlan Feng , Qi Liu

Context modeling plays a critical role in building multi-turn dialogue systems. Conversational Query Rewriting (CQR) aims to simplify the multi-turn dialogue modeling into a single-turn problem by explicitly rewriting the conversational…

Computation and Language · Computer Science 2021-02-22 Hang Liu , Meng Chen , Youzheng Wu , Xiaodong He , Bowen Zhou

Recent studies have proposed leveraging Large Language Models (LLMs) as information retrievers through query rewriting. However, for challenging corpora, we argue that enhancing queries alone is insufficient for robust semantic matching;…

Information Retrieval · Computer Science 2025-06-24 Jingming Liu , Yumeng Li , Wei Shi , Yao-Xiang Ding , Hui Su , Kun Zhou

Conversational information seeking (CIS) systems aim to model the user's information need within the conversational context and retrieve the relevant information. One major approach to modeling the conversational context aims to rewrite the…

Information Retrieval · Computer Science 2024-11-04 Zahra Abbasiantaeb , Simon Lupart , Mohammad Aliannejadi

Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This…

Computation and Language · Computer Science 2023-12-01 Marwa Abdulhai , Isadora White , Charlie Snell , Charles Sun , Joey Hong , Yuexiang Zhai , Kelvin Xu , Sergey Levine

Despite widespread interests in reinforcement-learning for task-oriented dialogue systems, several obstacles can frustrate research and development progress. First, reinforcement learners typically require interaction with the environment,…

Machine Learning · Computer Science 2017-11-15 Xiujun Li , Zachary C. Lipton , Bhuwan Dhingra , Lihong Li , Jianfeng Gao , Yun-Nung Chen

Query optimization is a crucial component for the efficacy of Retrieval-Augmented Generation (RAG) systems. While reinforcement learning (RL)-based agentic and reasoning methods have recently emerged as a promising direction on query…

Artificial Intelligence · Computer Science 2026-01-30 Wei Wen , Sihang Deng , Tianjun Wei , Keyu Chen , Ruizhi Qiao , Xing Sun

Understanding a Reinforcement Learning (RL) policy is crucial for ensuring that autonomous agents behave according to human expectations. This goal can be achieved using Explainable Reinforcement Learning (XRL) techniques. Although textual…

Artificial Intelligence · Computer Science 2026-01-07 Ahmad Terra , Mohit Ahmed , Rafia Inam , Elena Fersman , Martin Törngren

Clarification resolution plays an important role in various information retrieval tasks such as interactive question answering and conversational search. In such context, the user often formulates their information needs as short and…

Computation and Language · Computer Science 2021-10-29 Hadrien Lautraite , Nada Naji , Louis Marceau , Marc Queudot , Eric Charton

Reinforcement learning (RL) has experienced a second wind in the past decade. While incredibly successful in images and videos, these systems still operate within the realm of propositional tasks ignoring the inherent structure that exists…

Machine Learning · Computer Science 2025-10-21 Fateme Golivand Darvishvand , Hikaru Shindo , Sahil Sidheekh , Kristian Kersting , Sriraam Natarajan

Key to any research involving session search is the understanding of how a user's queries evolve throughout the session. When a user creates a query reformulation, he or she is consciously retaining terms from their original query, removing…

Information Retrieval · Computer Science 2016-01-21 Marc Sloan , Hui Yang , Jun Wang

The query suggestion or auto-completion mechanisms help users to type less while interacting with a search engine. A basic approach that ranks suggestions according to their frequency in the query logs is suboptimal. Firstly, many candidate…

Information Retrieval · Computer Science 2013-12-06 Eugene Kharitonov , Craig Macdonald , Pavel Serdyukov , Iadh Ounis

Search and recommender systems that take the initiative to ask clarifying questions to better understand users' information needs are receiving increasing attention from the research community. However, to the best of our knowledge, there…

Information Retrieval · Computer Science 2020-08-04 Jie Zou , Evangelos Kanoulas , Yiqun Liu

This paper describes the solutions of the Dianping-Trust-Safety team for the META CRAG-MM challenge. The challenge requires building a comprehensive retrieval-augmented generation system capable for multi-modal multi-turn question…

Artificial Intelligence · Computer Science 2026-01-15 Chenliang Zhang , Lin Wang , Yuanyuan Lu , Yusheng Qi , Kexin Wang , Peixu Hou , Wenshi Chen

Many users turn to document retrieval systems (e.g. search engines) to seek answers to controversial questions. Answering such user queries usually require identifying responses within web documents, and aggregating the responses based on…

Computation and Language · Computer Science 2022-06-14 Sihao Chen , Siyi Liu , Xander Uyttendaele , Yi Zhang , William Bruno , Dan Roth

Retrieving keywords (bidwords) with the same intent as query, referred to as close variant keywords, is of prime importance for effective targeted search advertising. For head and torso search queries, sponsored search engines use a huge…

Computation and Language · Computer Science 2021-06-08 Akash Kumar Mohankumar , Nikit Begwani , Amit Singh

In real-world recommendation systems, users would engage in variety scenarios, such as homepages, search pages, and related recommendation pages. Each of these scenarios would reflect different aspects users focus on. However, the user…

Information Retrieval · Computer Science 2025-06-24 Zhijian Feng , Wenhao Zheng , Xuanji Xiao

Context: Recent research indicates that Web queries written by software developers are not very successful in retrieving relevant results, performing measurably worse compared to general purpose Web queries. Most approaches up to this point…

Software Engineering · Computer Science 2022-07-27 Mia Mohammad Imran , Kostadin Damevski

Retrieval-Augmented Generation (RAG) has become a powerful paradigm for enhancing large language models (LLMs) through external knowledge retrieval. Despite its widespread attention, existing academic research predominantly focuses on…

Information Retrieval · Computer Science 2024-10-31 Yiruo Cheng , Kelong Mao , Ziliang Zhao , Guanting Dong , Hongjin Qian , Yongkang Wu , Tetsuya Sakai , Ji-Rong Wen , Zhicheng Dou