English
Related papers

Related papers: ORCA: Mitigating Over-Reliance for Multi-Task Dwel…

200 papers

Click-through rate (CTR) estimation plays as a core function module in various personalized online services, including online advertising, recommender systems, and web search etc. From 2015, the success of deep learning started to benefit…

Information Retrieval · Computer Science 2021-04-22 Weinan Zhang , Jiarui Qin , Wei Guo , Ruiming Tang , Xiuqiang He

While test-time scaling has enabled large language models to solve highly difficult tasks, state-of-the-art results come at exorbitant compute costs. These inefficiencies can be attributed to the miscalibration of post-trained language…

Machine Learning · Computer Science 2026-04-02 Cai Zhou , Zekai Wang , Menghua Wu , Qianyu Julie Zhu , Flora C. Shi , Chenyu Wang , Ashia Wilson , Tommi Jaakkola , Stephen Bates

Click-through rate (CTR) prediction is critical for industrial applications such as recommender system and online advertising. Practically, it plays an important role for CTR modeling in these applications by mining user interest from rich…

Information Retrieval · Computer Science 2019-05-27 Qi Pi , Weijie Bian , Guorui Zhou , Xiaoqiang Zhu , Kun Gai

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as the standard paradigm for improving reasoning capability of large language models, while Multi-Token Prediction (MTP) has been a widely adopted module in pretraining.…

Machine Learning · Computer Science 2026-05-28 Zili Wang , Jiajun Chai , Lin Chen , Xiaohan Wang , Shiming Xiang , Guojun Yin

Sequential recommendation methods are increasingly important in cutting-edge recommender systems. Through leveraging historical records, the systems can capture user interests and perform recommendations accordingly. State-of-the-art…

Information Retrieval · Computer Science 2023-08-10 Chong Liu , Xiaoyang Liu , Rongqin Zheng , Lixin Zhang , Xiaobo Liang , Juntao Li , Lijun Wu , Min Zhang , Leyu Lin

Despite intense efforts in basic and clinical research, an individualized ventilation strategy for critically ill patients remains a major challenge. Recently, dynamic treatment regime (DTR) with reinforcement learning (RL) on electronic…

Machine Learning · Computer Science 2022-06-01 Changchang Yin , Ruoqi Liu , Jeffrey Caterino , Ping Zhang

Despite the rapid growth of online advertisement in developing countries, existing highly over-parameterized Click-Through Rate (CTR) prediction models are difficult to be deployed due to the limited computing resources. In this paper, by…

Machine Learning · Computer Science 2021-04-16 Joonyoung Yi , Buru Chang

Predicting click-through rates (CTR) is a fundamental task for Web applications, where a key issue is to devise effective models for feature interactions. Current methodologies predominantly concentrate on modeling feature interactions…

Information Retrieval · Computer Science 2024-04-08 Yushen Li , Jinpeng Wang , Tao Dai , Jieming Zhu , Jun Yuan , Rui Zhang , Shu-Tao Xia

Click-through prediction (CTR) models transform features into latent vectors and enumerate possible feature interactions to improve performance based on the input feature set. Therefore, when selecting an optimal feature set, we should…

Information Retrieval · Computer Science 2024-03-27 Fuyuan Lyu , Xing Tang , Dugang Liu , Liang Chen , Xiuqiang He , Xue Liu

Deep learning techniques have been applied widely in industrial recommendation systems. However, far less attention has been paid to the overfitting problem of models in recommendation systems, which, on the contrary, is recognized as a…

Information Retrieval · Computer Science 2022-09-14 Zhao-Yu Zhang , Xiang-Rong Sheng , Yujing Zhang , Biye Jiang , Shuguang Han , Hongbo Deng , Bo Zheng

Online advertising in recommendation platforms has gained significant attention, with a predominant focus on channel recommendation and budget allocation strategies. However, current offline reinforcement learning (RL) methods face…

Information Retrieval · Computer Science 2025-07-10 Langming Liu , Wanyu Wang , Chi Zhang , Bo Li , Hongzhi Yin , Xuetao Wei , Wenbo Su , Bo Zheng , Xiangyu Zhao

The Decision Transformer (DT) has established a powerful sequence modeling approach to offline reinforcement learning. It conditions its action predictions on Return-to-Go (RTG), using it both to distinguish trajectory quality during…

Artificial Intelligence · Computer Science 2026-01-23 Yongyi Wang , Hanyu Liu , Lingfeng Li , Bozhou Chen , Ang Li , Qirui Zheng , Xionghui Yang , Wenxin Li

An intelligent decision-making system enabled by Vehicle-to-Everything (V2X) communications is essential to achieve safe and efficient autonomous driving (AD), where two types of decisions have to be made at different timescales, i.e.,…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Tong Liu , Lei Lei , Kan Zheng , Xuemin , Shen

Test-Time Adaptation (TTA) aims to mitigate distributional shifts between training and test domains during inference time. However, existing TTA methods fall short in the realistic scenario where models face both continually changing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yingkai Yang , Chaoqi Chen , Hui Huang

Dynamic Traffic Assignment (DTA) provides an approach to determine the optimal path and/or departure time based on the transportation network characteristics and user behavior (e.g., selfish or social). In the literature, most of the…

Systems and Control · Computer Science 2017-08-15 Tarikul Islam , Hai L. Vu , Manoj Panda , Nam Hoang , Dong Ngoduy

Understanding how language models carry out long-horizon reasoning remains an open challenge. Existing interpretability methods often highlight tokens correlated with an answer, but rarely reveal where consequential reasoning turns occur,…

Machine Learning · Computer Science 2026-03-03 Waldemar Chang

Recommendation systems have been extensively studied by many literature in the past and are ubiquitous in online advertisement, shopping industry/e-commerce, query suggestions in search engines, and friend recommendation in social networks.…

Information Retrieval · Computer Science 2021-05-11 Farzaneh Rajabi , Jack Siyuan He

The click-through rate (CTR) reflects the ratio of clicks on a specific item to its total number of views. It has significant impact on websites' advertising revenue. Learning sophisticated models to understand and predict user behavior is…

Machine Learning · Computer Science 2020-07-29 Amit Livne , Roy Dor , Eyal Mazuz , Tamar Didi , Bracha Shapira , Lior Rokach

The two primary tasks in the search recommendation system are search relevance matching and click-through rate (CTR) prediction -- the former focuses on seeking relevant items for user queries whereas the latter forecasts which item may…

Information Retrieval · Computer Science 2025-03-27 Rong Chen , Shuzhi Cao , Ailong He , Shuguang Han , Jufeng Chen