English
Related papers

Related papers: McQueen: a Benchmark for Multimodal Conversational…

200 papers

In this work we focus on multi-turn passage retrieval as a crucial component of conversational search. One of the key challenges in multi-turn passage retrieval comes from the fact that the current turn query is often underspecified due to…

Information Retrieval · Computer Science 2020-05-26 Nikos Voskarides , Dan Li , Pengjie Ren , Evangelos Kanoulas , Maarten de Rijke

Reference resolution, which aims to identify entities being referred to by a speaker, is more complex in real world settings: new referents may be created by processes the agents engage in and/or be salient only because they belong to the…

Computation and Language · Computer Science 2022-09-07 Abhinav Kumar , Barbara Di Eugenio , Abari Bhattacharya , Jillian Aurisano , Andrew Johnson

Query rewriting plays a vital role in enhancing conversational search by transforming context-dependent user queries into standalone forms. Existing approaches primarily leverage human-rewritten queries as labels to train query rewriting…

Human-Computer Interaction · Computer Science 2023-10-19 Fanghua Ye , Meng Fang , Shenghui Li , Emine Yilmaz

Context-dependent text-to-SQL is the task of translating multi-turn questions into database-related SQL queries. Existing methods typically focus on making full use of history context or previously predicted SQL for currently SQL parsing,…

Computation and Language · Computer Science 2023-01-31 Dongling Xiao , Linzheng Chai , Qian-Wen Zhang , Zhao Yan , Zhoujun Li , Yunbo Cao

The essence of modern e-Commercial search system lies in matching user's intent and available candidates depending on user's query, providing personalized and precise service. However, user's query may be incorrect due to ambiguous input…

Information Retrieval · Computer Science 2025-04-09 Shangyu Chen , Xinyu Jia , Yingfei Zhang , Shuai Zhang , Xiang Li , Wei Lin

Multimodal large language models (MLLMs) have garnered widespread attention due to their ability to understand multimodal input. However, their large parameter sizes and substantial computational demands severely hinder their practical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 JiangYong Yu , Sifan Zhou , Dawei Yang , Shuo Wang , Shuoyu Li , Xing Hu , Chen Xu , Zukang Xu , Changyong Shu , Zhihang Yuan

Compared to single-turn dialogue, multi-turn dialogue involving multiple images better aligns with the needs of real-world human-AI interactions. Additionally, as training data, it provides richer contextual reasoning information, thereby…

Artificial Intelligence · Computer Science 2025-03-25 Dawei Yan , Yang Li , Qing-Guo Chen , Weihua Luo , Peng Wang , Haokui Zhang , Chunhua Shen

We introduce a new dataset for Question Rewriting in Conversational Context (QReCC), which contains 14K conversations with 80K question-answer pairs. The task in QReCC is to find answers to conversational questions within a collection of…

Information Retrieval · Computer Science 2021-04-16 Raviteja Anantha , Svitlana Vakulenko , Zhucheng Tu , Shayne Longpre , Stephen Pulman , Srinivas Chappidi

Providing voice assistants the ability to navigate multi-turn conversations is a challenging problem. Handling multi-turn interactions requires the system to understand various conversational use-cases, such as steering, intent carryover,…

Computation and Language · Computer Science 2023-10-30 Jiarui Lu , Bo-Hsiang Tseng , Joel Ruben Antony Moniz , Site Li , Xueyun Zhu , Hong Yu , Murat Akbacak

Conversational query reformulation (CQR) has become indispensable for improving retrieval in dialogue-based applications. However, existing approaches typically rely on reference passages for optimization, which are impractical to acquire…

Computation and Language · Computer Science 2025-10-14 Doyoung Kim , Youngjun Lee , Joeun Kim , Jihwan Bang , Hwanjun Song , Susik Yoon , Jae-Gil Lee

Multiple-choice question answering (MCQA) has been a popular format for evaluating and reinforcement fine-tuning (RFT) of modern multimodal language models. Its constrained output format allows for simplified, deterministic automatic…

Computation and Language · Computer Science 2025-11-25 Yesheng Liu , Hao Li , Haiyu Xu , Baoqi Pei , Jiahao Wang , Mingxuan Zhao , Jingshu Zheng , Zheqi He , JG Yao , Bowen Qin , Xi Yang , Jiajun Zhang

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

Computation and Language · Computer Science 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

In this paper, we study how open-source large language models (LLMs) can be effectively deployed for improving query rewriting in conversational search, especially for ambiguous queries. We introduce CHIQ, a two-step method that leverages…

Information Retrieval · Computer Science 2024-09-27 Fengran Mo , Abbas Ghaddar , Kelong Mao , Mehdi Rezagholizadeh , Boxing Chen , Qun Liu , Jian-Yun Nie

In the rapidly evolving landscape of information retrieval, search engines strive to provide more personalized and relevant results to users. Query suggestion systems play a crucial role in achieving this goal by assisting users in…

Information Retrieval · Computer Science 2024-02-12 Zheng Wang , Bingzheng Gan , Wei Shi

Conversational Query Reformulation (CQR) has significantly advanced in addressing the challenges of conversational search, particularly those stemming from the latent user intent and the need for historical context. Recent works aimed to…

Computation and Language · Computer Science 2025-01-06 Yilong Lai , Jialong Wu , Congzhi Zhang , Haowen Sun , Deyu Zhou

Understanding real-world videos such as movies requires integrating visual and dialogue cues. Yet existing VideoQA benchmarks struggle to capture this multimodal reasoning and, given the difficulty of evaluating free-form answers, largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Shaden Shaar , Bradon Thymes , Sirawut Chaixanien , Claire Cardie , Bharath Hariharan

The dependency between an adequate question formulation and correct answer selection is a very intriguing but still underexplored area. In this paper, we show that question rewriting (QR) of the conversational context allows to shed more…

Computation and Language · Computer Science 2022-02-04 Svitlana Vakulenko , Shayne Longpre , Zhucheng Tu , Raviteja Anantha

Conversational text-to-SQL aims at converting multi-turn natural language queries into their corresponding SQL (Structured Query Language) representations. One of the most intractable problems of conversational text-to-SQL is modelling the…

Computation and Language · Computer Science 2022-07-27 Yuntao Li , Hanchu Zhang , Yutian Li , Sirui Wang , Wei Wu , Yan Zhang

While most task-oriented dialogues assume conversations between the agent and one user at a time, dialogue systems are increasingly expected to communicate with multiple users simultaneously who make decisions collaboratively. To facilitate…

This paper tackles a recently proposed Video Corpus Moment Retrieval task. This task is essential because advanced video retrieval applications should enable users to retrieve a precise moment from a large video corpus. We propose a novel…

Multimedia · Computer Science 2021-09-22 Zhijian Hou , Chong-Wah Ngo , Wing Kwong Chan