English

Beyond Relevance: Improving User Engagement by Personalization for Short-Video Search

Information Retrieval 2024-09-18 v1

Abstract

Personalized search has been extensively studied in various applications, including web search, e-commerce, social networks, etc. With the soaring popularity of short-video platforms, exemplified by TikTok and Kuaishou, the question arises: can personalization elevate the realm of short-video search, and if so, which techniques hold the key? In this work, we introduce PR2\text{PR}^2, a novel and comprehensive solution for personalizing short-video search, where PR2\text{PR}^2 stands for the Personalized Retrieval and Ranking augmented search system. Specifically, PR2\text{PR}^2 leverages query-relevant collaborative filtering and personalized dense retrieval to extract relevant and individually tailored content from a large-scale video corpus. Furthermore, it utilizes the QIN (Query-Dominate User Interest Network) ranking model, to effectively harness user long-term preferences and real-time behaviors, and efficiently learn from user various implicit feedback through a multi-task learning framework. By deploying the PR2\text{PR}^2 in production system, we have achieved the most remarkable user engagement improvements in recent years: a 10.2% increase in CTR@10, a notable 20% surge in video watch time, and a 1.6% uplift of search DAU. We believe the practical insights presented in this work are valuable especially for building and improving personalized search systems for the short video platforms.

Keywords

Cite

@article{arxiv.2409.11281,
  title  = {Beyond Relevance: Improving User Engagement by Personalization for Short-Video Search},
  author = {Wentian Bao and Hu Liu and Kai Zheng and Chao Zhang and Shunyu Zhang and Enyun Yu and Wenwu Ou and Yang Song},
  journal= {arXiv preprint arXiv:2409.11281},
  year   = {2024}
}