English
Related papers

Related papers: Quality Over Clicks: Intrinsic Quality-Driven Iter…

200 papers

Care coordination and population health management programs serve large Medicaid and safety-net populations and must be auditable, efficient, and adaptable. While clinical risk for outreach modalities is typically low, time and opportunity…

Computers and Society · Computer Science 2025-09-23 Sanjay Basu , Sadiq Y. Patel , Parth Sheth , Bhairavi Muralidharan , Namrata Elamaran , Aakriti Kinra , Rajaie Batniji

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Existing Conversational Recommender Systems (CRS) predominantly utilize user simulators for training and evaluating recommendation policies. These simulators often oversimplify the complexity of user interactions by focusing solely on…

Information Retrieval · Computer Science 2024-09-10 Gangyi Zhang , Chongming Gao , Hang Pan , Runzhe Teng , Ruizhe Li

The emergence of structured databases for Question Answering (QA) systems has led to developing methods, in which the problem of learning the correct answer efficiently is based on a linking task between the constituents of the question and…

Machine Learning · Computer Science 2020-03-05 Hamid Zafar , Maryam Tavakol , Jens Lehmann

Query optimization is a crucial component for the efficacy of Retrieval-Augmented Generation (RAG) systems. While reinforcement learning (RL)-based agentic and reasoning methods have recently emerged as a promising direction on query…

Artificial Intelligence · Computer Science 2026-01-30 Wei Wen , Sihang Deng , Tianjun Wei , Keyu Chen , Ruizhi Qiao , Xing Sun

Conversational Recommender Systems (CRS) provide personalized services through multi-turn interactions, yet most existing methods overlook users' heterogeneous decision-making styles and knowledge levels, which constrains both accuracy and…

Information Retrieval · Computer Science 2025-09-10 Yaying Luo , Hui Fang , Zhu Sun

In this paper, we propose a robust sequential learning strategy for training large-scale Recommender Systems (RS) over implicit feedback mainly in the form of clicks. Our approach relies on the minimization of a pairwise ranking loss over…

Information Retrieval · Computer Science 2021-09-15 Alexandra Burashnikova , Yury Maximov , Massih-Reza Amini

Coping with ambiguous questions has been a perennial problem in real-world dialogue systems. Although clarification by asking questions is a common form of human interaction, it is hard to define appropriate questions to elicit more…

Computation and Language · Computer Science 2020-12-18 Xiang Hu , Zujie Wen , Yafang Wang , Xiaolong Li , Gerard de Melo

Generalization to out of distribution tasks in reinforcement learning is a challenging problem. One successful approach improves generalization by conditioning policies on task or environment descriptions that provide information about the…

Machine Learning · Computer Science 2022-05-27 Kolby Nottingham , Alekhya Pyla , Sameer Singh , Roy Fox

Query suggestion plays a crucial role in enhancing user experience in e-commerce search systems by providing relevant query recommendations that align with users' initial input. This module helps users navigate towards personalized…

Information Retrieval · Computer Science 2025-06-10 Xian Guo , Ben Chen , Siyuan Wang , Ying Yang , Chenyi Lei , Yuqing Ding , Han Li

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

Machine Learning · Computer Science 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

Context modeling plays a critical role in building multi-turn dialogue systems. Conversational Query Rewriting (CQR) aims to simplify the multi-turn dialogue modeling into a single-turn problem by explicitly rewriting the conversational…

Computation and Language · Computer Science 2021-02-22 Hang Liu , Meng Chen , Youzheng Wu , Xiaodong He , Bowen Zhou

The rise of personal assistants has made conversational question answering (ConvQA) a very popular mechanism for user-system interaction. State-of-the-art methods for ConvQA over knowledge graphs (KGs) can only learn from crisp…

Information Retrieval · Computer Science 2021-08-23 Magdalena Kaiser , Rishiraj Saha Roy , Gerhard Weikum

Conversational recommender systems (CRS) aim to recommend high-quality items to users through interactive conversations. Although several efforts have been made for CRS, two major issues still remain to be solved. First, the conversation…

Computation and Language · Computer Science 2020-07-09 Kun Zhou , Wayne Xin Zhao , Shuqing Bian , Yuanhang Zhou , Ji-Rong Wen , Jingsong Yu

Training and refreshing a web-scale Question Answering (QA) system for a multi-lingual commercial search engine often requires a huge amount of training examples. One principled idea is to mine implicit relevance feedback from user behavior…

Information Retrieval · Computer Science 2020-06-17 Linjun Shou , Shining Bo , Feixiang Cheng , Ming Gong , Jian Pei , Daxin Jiang

We present Q-chunking, a simple yet effective recipe for improving reinforcement learning (RL) algorithms for long-horizon, sparse-reward tasks. Our recipe is designed for the offline-to-online RL setting, where the goal is to leverage an…

Machine Learning · Computer Science 2026-05-12 Qiyang Li , Zhiyuan Zhou , Sergey Levine

Conversational AI has made significant progress, yet generating expressive and controllable text-to-speech (TTS) remains challenging. Specifically, controlling fine-grained voice styles and emotions is notoriously difficult and typically…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-13 Zhicheng Ouyang , Seong-Gyun Leem , Bach Viet Do , Haibin Wu , Ariya Rastrow , Yuzong Liu , Florian Metze

Generative sequence models have shown strong results in recommendation. Applying them to search ranking is more challenging. Search behavior is inherently query-driven. Each query switch introduces a sharp topic shift in the user's…

Information Retrieval · Computer Science 2026-05-26 Yanglong Song , Zihao Yang , Shuo Meng , Rujun Guo , Jin Zhang , Bin Wang , Shaoyu Liu , Xiaozhao Wang , Guanjun Jiang

With the development of new system solutions that integrate traditional cloud computing with the edge/fog computing paradigm, dynamic optimization of service execution has become a challenge due to the edge computing resources being more…

Networking and Internet Architecture · Computer Science 2020-07-07 Francisco Carpio , Admela Jukan , Roman Sosa , Ana Juan Ferrer

Customer services are critical to all companies, as they may directly connect to the brand reputation. Due to a great number of customers, e-commerce companies often employ multiple communication channels to answer customers' questions, for…

Machine Learning · Computer Science 2019-12-03 Zining Liu , Chong Long , Xiaolu Lu , Zehong Hu , Jie Zhang , Yafang Wang