English
Related papers

Related papers: Quality Over Clicks: Intrinsic Quality-Driven Iter…

200 papers

Session-level dynamic ad load optimization aims to personalize the density and types of delivered advertisements in real time during a user's online session by dynamically balancing user experience quality and ad monetization. Traditional…

Machine Learning · Computer Science 2025-01-13 Tao Liu , Qi Xu , Wei Shi , Zhigang Hua , Shuang Yang

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

Most recent paradigms of generative model-based recommendation still face challenges related to the cold-start problem. Existing models addressing cold item recommendations mainly focus on acquiring more knowledge to enrich embeddings or…

Information Retrieval · Computer Science 2025-11-11 Yang Xiang , Li Fan , Chenke Yin , Menglin Kong , Chengtao Ji

Click-through rate (CTR) prediction plays an indispensable role in online platforms. Numerous models have been proposed to capture users' shifting preferences by leveraging user behavior sequences. However, these historical sequences often…

Information Retrieval · Computer Science 2024-04-16 Junjie Huang , Guohao Cai , Jieming Zhu , Zhenhua Dong , Ruiming Tang , Weinan Zhang , Yong Yu

There are great interests as well as many challenges in applying reinforcement learning (RL) to recommendation systems. In this setting, an online user is the environment; neither the reward function nor the environment dynamics are clearly…

Machine Learning · Computer Science 2020-01-03 Xinshi Chen , Shuang Li , Hui Li , Shaohua Jiang , Yuan Qi , Le Song

Clinical decision support must adapt online under safety constraints. We present an online adaptive tool where reinforcement learning provides the policy, a patient digital twin provides the environment, and treatment effect defines the…

Artificial Intelligence · Computer Science 2025-08-26 Xinyu Qin , Ruiheng Yu , Lu Wang

Session-based recommendation techniques aim to capture dynamic user behavior by analyzing past interactions. However, existing methods heavily rely on historical item ID sequences to extract user preferences, leading to challenges such as…

Information Retrieval · Computer Science 2023-07-21 Zhipeng Zhang , Piao Tong , Yingwei Ma , Qiao Liu , Xujiang Liu , Xu Luo

We present ChatR1, a reasoning framework based on reinforcement learning (RL) for conversational question answering (CQA). Reasoning plays an important role in CQA, where user intent evolves across dialogue turns, and utterances are often…

Computation and Language · Computer Science 2026-04-28 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

End-to-end delay is a critical attribute of quality of service (QoS) in application domains such as cloud computing and computer networks. This metric is particularly important in tandem service systems, where the end-to-end service is…

Machine Learning · Computer Science 2021-01-13 Majid Raeis , Ali Tizghadam , Alberto Leon-Garcia

Event Extraction (EE) is an essential information extraction task that aims to extract event-related information from unstructured texts. The paradigm of this task has shifted from conventional classification-based methods to more…

Computation and Language · Computer Science 2024-07-23 Zijin Hong , Jian Liu

Clarifying user needs is essential for existing task-oriented dialogue systems. However, in real-world applications, developers can never guarantee that all possible user demands are taken into account in the design phase. Consequently,…

Computation and Language · Computer Science 2019-06-13 Weikang Wang , Jiajun Zhang , Qian Li , Mei-Yuh Hwang , Chengqing Zong , Zhifei Li

Co-training is a popular semi-supervised learning framework to utilize a large amount of unlabeled data in addition to a small labeled set. Co-training methods exploit predicted labels on the unlabeled data and select samples based on…

Computation and Language · Computer Science 2018-04-18 Jiawei Wu , Lei Li , William Yang Wang

Continuous value prediction plays a crucial role in industrial-scale recommendation systems, including tasks such as predicting users' watch-time and estimating the gross merchandise value (GMV) in e-commerce transactions. However, it…

Information Retrieval · Computer Science 2026-02-27 Runpeng Cui , Zhipeng Sun , Chi Lu , Peng Jiang

Conversational question answering (ConvQA) over law knowledge bases (KBs) involves answering multi-turn natural language questions about law and hope to find answers in the law knowledge base. Despite many methods have been proposed.…

Artificial Intelligence · Computer Science 2024-01-17 Mi Wu

Recent question generation (QG) approaches often utilize the sequence-to-sequence framework (Seq2Seq) to optimize the log-likelihood of ground-truth questions using teacher forcing. However, this training objective is inconsistent with…

Computation and Language · Computer Science 2020-11-03 Yuxi Xie , Liangming Pan , Dongzhe Wang , Min-Yen Kan , Yansong Feng

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

Conversational question answering (QA) requires the ability to correctly interpret a question in the context of previous conversation turns. We address the conversational QA task by decomposing it into question rewriting and question…

Information Retrieval · Computer Science 2020-10-26 Svitlana Vakulenko , Shayne Longpre , Zhucheng Tu , Raviteja Anantha

Multilingual e-commerce search suffers from severe data imbalance across languages, label noise, and limited supervision for low-resource languages--challenges that impede the cross-lingual generalization of relevance models despite the…

Information Retrieval · Computer Science 2025-10-27 Yabo Yin , Yang Xi , Jialong Wang , Shanqi Wang , Jiateng Hu

We introduce Coarse Q-learning (CQL), a reinforcement-learning model for bandit problems with stochastically varying menus. Alternatives are exogenously partitioned into similarity classes, and feedback from sampled alternatives is pooled…

Theoretical Economics · Economics 2026-05-13 Philippe Jehiel , Aviman Satpathy