English
Related papers

Related papers: CTR-Sink: Attention Sink for Language Models in Cl…

200 papers

Sequential user behavior modeling is pivotal for Click-Through Rate (CTR) prediction yet is hindered by three intrinsic bottlenecks: (1) the "Attention Sink" phenomenon, where standard Softmax compels the model to allocate probability mass…

Information Retrieval · Computer Science 2026-01-15 Shenqiang Ke , Jianxiong Wei , Qingsong Hua

The modern recommender systems are facing an increasing challenge of modelling and predicting the dynamic and context-rich user preferences. Traditional collaborative filtering and content-based methods often struggle to capture the…

Information Retrieval · Computer Science 2025-07-21 Yitong Li , Raoul Grasman

Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as RNN, GRUs, and,…

Information Retrieval · Computer Science 2024-08-27 Yaoyiran Li , Xiang Zhai , Moustafa Alzantot , Keyi Yu , Ivan Vulić , Anna Korhonen , Mohamed Hammad

Sequential recommendation (SR) tasks aim to predict users' next interaction by learning their behavior sequence and capturing the connection between users' past interactions and their changing preferences. Conventional SR models often focus…

Information Retrieval · Computer Science 2024-12-19 Haoyi Zhang , Guohao Sun , Jinhu Lu , Guanfeng Liu , Xiu Susie Fang

This research designs a unified architecture of CTR prediction benchmark (Bench-CTR) platform that offers flexible interfaces with datasets and components of a wide range of CTR prediction models. Moreover, we construct a comprehensive…

Information Retrieval · Computer Science 2025-12-02 Shan Gao , Yanwu Yang

The motivations of users to make interactions can be divided into static preference and dynamic interest. To accurately model user representations over time, recent studies in sequential recommendation utilize information propagation and…

Information Retrieval · Computer Science 2023-09-19 Qingtian Bian , Jiaxing Xu , Hui Fang , Yiping Ke

The recently introduced Controlled Text Reduction (CTR) task isolates the text generation step within typical summarization-style tasks. It does so by challenging models to generate coherent text conforming to pre-selected content within…

Computation and Language · Computer Science 2024-02-27 Aviv Slobodkin , Avi Caciularu , Eran Hirsch , Ido Dagan

Accurately predicting click-through rates (CTR) under stringent privacy constraints poses profound challenges, particularly when user-item interactions are sparse and fragmented across domains. Conventional cross-domain CTR (CCTR) methods…

Information Retrieval · Computer Science 2025-03-24 Jiangcheng Qin , Xueyuan Zhang , Baisong Liu , Jiangbo Qian , Yangyang Wang

The click-through rate (CTR) reflects the ratio of clicks on a specific item to its total number of views. It has significant impact on websites' advertising revenue. Learning sophisticated models to understand and predict user behavior is…

Machine Learning · Computer Science 2020-07-29 Amit Livne , Roy Dor , Eyal Mazuz , Tamar Didi , Bracha Shapira , Lior Rokach

Click through rate (CTR) estimation is a fundamental task in personalized advertising and recommender systems. Recent years have witnessed the success of both the deep learning based model and attention mechanism in various tasks in…

Machine Learning · Computer Science 2019-05-17 Junlin Zhang , Tongwen Huang , Zhiqi Zhang

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

Information Retrieval · Computer Science 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

Click-Through Rate (CTR) prediction has become an essential task in digital industries, such as digital advertising or online shopping. Many deep learning-based methods have been implemented and have become state-of-the-art models in the…

Information Retrieval · Computer Science 2024-06-19 Ibrahim Can Yilmaz , Said Aldemir

Large language model (LLM) unlearning has become a critical mechanism for removing undesired data, knowledge, or behaviors from pre-trained models while retaining their general utility. Yet, with the rise of open-weight LLMs, we ask: can…

Machine Learning · Computer Science 2025-10-21 Bingqi Shang , Yiwei Chen , Yihua Zhang , Bingquan Shen , Sijia Liu

Inspired by advances in LLMs, reasoning-enhanced sequential recommendation performs multi-step deliberation before making final predictions, unlocking greater potential for capturing user preferences. However, current methods are…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou , Shoujin Wang , Weizhi Zhang , Xu Cai , Sunghun Kim

Large-scale supervised data is essential for training modern ranking models, but obtaining high-quality human annotations is costly. Click data has been widely used as a low-cost alternative, and with recent advances in large language…

Information Retrieval · Computer Science 2025-11-11 Lulu Yu , Keping Bi , Jiafeng Guo , Shihao Liu , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng

This thesis addresses automatic lexical error recovery and tokenization of corrupt text input. We propose a technique that can automatically correct misspellings, segmentation errors and real-word errors in a unified framework that uses…

cmp-lg · Computer Science 2009-09-25 Peter Ingels

Sequential Recommendation Systems (SRS) have become essential in many real-world applications. However, existing SRS methods often rely on collaborative filtering signals and fail to capture real-time user preferences, while Conversational…

Information Retrieval · Computer Science 2025-09-12 Yifan Wang , Shen Gao , Jiabao Fang , Rui Yan , Billy Chiu , Shuo Shang

Click prediction is one of the fundamental problems in sponsored search. Most of existing studies took advantage of machine learning approaches to predict ad click for each event of ad view independently. However, as observed in the…

Information Retrieval · Computer Science 2014-07-29 Yuyu Zhang , Hanjun Dai , Chang Xu , Jun Feng , Taifeng Wang , Jiang Bian , Bin Wang , Tie-Yan Liu

Eliciting reasoning capabilities from language models (LMs) is a critical direction on the path towards building intelligent systems. Most recent studies dedicated to reasoning focus on out-of-distribution performance on…

Driven by advances in Large Language Models (LLMs), integrating them into recommendation tasks has gained interest due to their strong semantic understanding and prompt flexibility. Prior work encoded user-item interactions or metadata into…

Information Retrieval · Computer Science 2025-06-10 Keyu Zhao , Fengli Xu , Yong Li