English
Related papers

Related papers: SlateFree: a Model-Free Decomposition for Reinforc…

200 papers

In this paper, we propose a theoretically founded sequential strategy for training large-scale Recommender Systems (RS) over implicit feedback, mainly in the form of clicks. The proposed approach consists in minimizing pairwise ranking loss…

Information Retrieval · Computer Science 2020-12-15 Aleksandra Burashnikova , Marianne Clausel , Charlotte Laclau , Frack Iutzeller , Yury Maximov , Massih-Reza Amini

Privacy laws and regulations enforce data-driven systems, e.g., recommender systems, to erase the data that concern individuals. As machine learning models potentially memorize the training data, data erasure should also unlearn the data…

Information Retrieval · Computer Science 2022-03-23 Yuyuan Li , Xiaolin Zheng , Chaochao Chen , Junlin Liu

Recently, a new multi-step temporal learning algorithm, called $Q(\sigma)$, unifies $n$-step Tree-Backup (when $\sigma=0$) and $n$-step Sarsa (when $\sigma=1$) by introducing a sampling parameter $\sigma$. However, similar to other…

Artificial Intelligence · Computer Science 2018-02-12 Long Yang , Minhao Shi , Qian Zheng , Wenjia Meng , Gang Pan

Developing agents that can perform challenging complex tasks is the goal of reinforcement learning. The model-free reinforcement learning has been considered as a feasible solution. However, the state of the art research has been to develop…

Machine Learning · Computer Science 2020-08-24 MyungJae Shin , Joongheon Kim

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

Machine Learning · Computer Science 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

Dynamic sequential recommendation (DSR) can generate model parameters based on user behavior to improve the personalization of sequential recommendation under various user preferences. However, it faces the challenges of large parameter…

Information Retrieval · Computer Science 2024-08-02 Zheqi Lv , Shaoxuan He , Tianyu Zhan , Shengyu Zhang , Wenqiao Zhang , Jingyuan Chen , Zhou Zhao , Fei Wu

We study reward-free reinforcement learning (RL) with linear function approximation, where the agent works in two phases: (1) in the exploration phase, the agent interacts with the environment but cannot access the reward; and (2) in the…

Machine Learning · Computer Science 2024-02-15 Junkai Zhang , Weitong Zhang , Quanquan Gu

This paper addresses the problem of model-free reinforcement learning for Robust Markov Decision Process (RMDP) with large state spaces. The goal of the RMDP framework is to find a policy that is robust against the parameter uncertainties…

Machine Learning · Computer Science 2021-02-15 Kishan Panaganti , Dileep Kalathil

Recently, sequential recommendation has been adapted to the LLM paradigm to enjoy the power of LLMs. LLM-based methods usually formulate recommendation information into natural language and the model is trained to predict the next item in…

Information Retrieval · Computer Science 2024-02-16 Hanbing Wang , Xiaorui Liu , Wenqi Fan , Xiangyu Zhao , Venkataramana Kini , Devendra Yadav , Fei Wang , Zhen Wen , Jiliang Tang , Hui Liu

Recurrent neural networks for session-based recommendation have attracted a lot of attention recently because of their promising performance. repeat consumption is a common phenomenon in many recommendation scenarios (e.g., e-commerce,…

Information Retrieval · Computer Science 2018-12-07 Pengjie Ren , Zhumin Chen , Jing Li , Zhaochun Ren , Jun Ma , Maarten de Rijke

Online decision tree learning algorithms typically examine all features of a new data point to update model parameters. We propose a novel alternative, Reinforcement Learning- based Decision Trees (RLDT), that uses Reinforcement Learning…

Machine Learning · Computer Science 2015-07-27 Abhinav Garlapati , Aditi Raghunathan , Vaishnavh Nagarajan , Balaraman Ravindran

We propose a soft gradient boosting framework for sequential regression that embeds a learnable linear feature transform within the boosting procedure. At each boosting iteration, we train a soft decision tree and learn a linear input…

Machine Learning · Computer Science 2025-09-17 Huseyin Karaca , Suleyman Serdar Kozat

In this report we review memory-based meta-learning as a tool for building sample-efficient strategies that learn from past experience to adapt to any task within a target class. Our goal is to equip the reader with the conceptual…

The paper considers a class of multi-agent Markov decision processes (MDPs), in which the network agents respond differently (as manifested by the instantaneous one-stage random costs) to a global controlled state and the control actions of…

Machine Learning · Statistics 2015-06-04 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

Machine Learning · Computer Science 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

Recommendation strategies are typically evaluated by using previously logged data, employing off-policy evaluation methods to estimate their expected performance. However, for strategies that present users with slates of multiple items, the…

Information Retrieval · Computer Science 2023-12-29 Shreyas Chaudhari , David Arbour , Georgios Theocharous , Nikos Vlassis

In order to speed-up classification models when facing a large number of categories, one usual approach consists in organizing the categories in a particular structure, this structure being then used as a way to speed-up the prediction…

Machine Learning · Computer Science 2015-11-26 Aurélia Léon , Ludovic Denoyer

Bayesian inference without the likelihood evaluation, or likelihood-free inference, has been a key research topic in simulation studies for gaining quantitatively validated simulation models on real-world datasets. As the likelihood…

Methodology · Statistics 2022-11-07 Dongjun Kim , Kyungwoo Song , YoonYeong Kim , Yongjin Shin , Wanmo Kang , Il-Chul Moon , Weonyoung Joo

Recommending appropriate algorithms to a classification problem is one of the most challenging issues in the field of data mining. The existing algorithm recommendation models are generally constructed on only one kind of meta-features by…

Information Retrieval · Computer Science 2021-06-08 Guangtao Wang , Qinbao Song , Xiaoyan Zhu

Recommender systems are one of the most successful applications of data mining and machine learning technology in practice. Academic research in the field is historically often based on the matrix completion problem formulation, where for…

Information Retrieval · Computer Science 2018-02-26 Massimo Quadrana , Paolo Cremonesi , Dietmar Jannach