English
Related papers

Related papers: Stratified Expert Cloning for Retention-Aware Reco…

200 papers

Recently, short video platforms have achieved rapid user growth by recommending interesting content to users. The objective of the recommendation is to optimize user retention, thereby driving the growth of DAU (Daily Active Users).…

Machine Learning · Computer Science 2023-02-14 Qingpeng Cai , Shuchang Liu , Xueliang Wang , Tianyou Zuo , Wentao Xie , Bin Yang , Dong Zheng , Peng Jiang , Kun Gai

Deep learning has brought great progress for the sequential recommendation (SR) tasks. With advanced network architectures, sequential recommender models can be stacked with many hidden layers, e.g., up to 100 layers on real-world…

Information Retrieval · Computer Science 2021-05-13 Jiachun Wang , Fajie Yuan , Jian Chen , Qingyao Wu , Min Yang , Yang Sun , Guoxiao Zhang

We present a simple, yet powerful data-augmentation technique to enable data-efficient learning from parametric experts for reinforcement and imitation learning. We focus on what we call the policy cloning setting, in which we use online or…

Machine Learning · Computer Science 2022-05-24 Alexandre Galashov , Josh Merel , Nicolas Heess

Reinforcement learning (RL) has shown great success in estimating sequential treatment strategies which take into account patient heterogeneity. However, health-outcome information, which is used as the reward for reinforcement learning…

Machine Learning · Computer Science 2021-02-24 Aaron Sonabend-W , Nilanjana Laha , Ashwin N. Ananthakrishnan , Tianxi Cai , Rajarshi Mukherjee

Self-supervised learning (SSL) is able to build latent representations that generalize well to unseen data. However, only a few SSL techniques exist for the online CL setting, where data arrives in small minibatches, the model must comply…

Machine Learning · Computer Science 2025-07-16 Giacomo Cignoni , Andrea Cossu , Alexandra Gomez-Villa , Joost van de Weijer , Antonio Carta

Meta-reinforcement learning (RL) addresses the problem of sample inefficiency in deep RL by using experience obtained in past tasks for a new task to be solved. However, most meta-RL methods require partially or fully on-policy data, i.e.,…

Artificial Intelligence · Computer Science 2021-01-07 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

Supervised neural approaches are hindered by their dependence on large, meticulously annotated datasets, a requirement that is particularly cumbersome for sequential tasks. The quality of annotations tends to deteriorate with the transition…

Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Jingqi Gao , Yueqi Xie , Qichen Ye , Yining Hua , Jae Boum Kim , Shoujin Wang , Sunghun Kim

In few-shot imitation learning (FSIL), using behavioral cloning (BC) to solve unseen tasks with few expert demonstrations becomes a popular research direction. The following capabilities are essential in robotics applications: (1) Behaving…

Robotics · Computer Science 2021-12-07 Jia-Fong Yeh , Chi-Ming Chung , Hung-Ting Su , Yi-Ting Chen , Winston H. Hsu

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Shared embedding spaces are widely used for multimodal search and data curation. In practice, two problems often limit how well this works. First, embeddings can reflect modality more than meaning, so examples cluster by input type even…

Information Retrieval · Computer Science 2026-05-05 Pratyush Muthukumar , Harshil Kotamreddy , Sarah Amiraslani , Tomo Kanazawa , Ramani Akkati , Shaan Jain , Andrew Mathau

Continual Reinforcement Learning (CRL) is essential for developing agents that can learn, adapt, and accumulate knowledge over time. However, a fundamental challenge persists as agents must strike a delicate balance between plasticity,…

Machine Learning · Computer Science 2025-03-11 Chengqi Zheng , Haiyan Yin , Jianda Chen , Terence Ng , Yew-Soon Ong , Ivor Tsang

Sequential decision making significantly speeds up research and is more cost-effective compared to fixed-n methods. We present a method for sequential decision making for stratified count data that retains Type-I error guarantee or false…

Methodology · Statistics 2023-02-23 Rosanne J. Turner , Peter D. Grünwald

Personalization is very powerful in improving the effectiveness of health interventions. Reinforcement learning (RL) algorithms are suitable for learning these tailored interventions from sequential data collected about individuals.…

Artificial Intelligence · Computer Science 2020-05-22 Ali el Hassouni , Mark Hoogendoorn , Martijn van Otterlo , A. E. Eiben , Vesa Muhonen , Eduardo Barbaro

The problem of personalization in Information Retrieval has been under study for a long time. A well-known issue related to this task is the lack of publicly available datasets that can support a comparative evaluation of personalized…

Information Retrieval · Computer Science 2023-10-06 Pranav Kasela , Gabriella Pasi , Raffaele Perego

Incorporating expert demonstrations has empirically helped to improve the sample efficiency of reinforcement learning (RL). This paper quantifies theoretically to what extent this extra information reduces RL's sample complexity. In…

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ye Zhu , Jie Yang , Si-Qi Liu , Ruimao Zhang

With rapid advances in containerization techniques, the serverless computing model is becoming a valid candidate execution model in edge networking, similar to the widely used cloud model for applications that are stateless, single purpose…

Networking and Internet Architecture · Computer Science 2023-05-23 Mounir Bensalem , Erkan Ipek , Admela Jukan