English
Related papers

Related papers: Optimizing an Utility Function for Exploration / E…

200 papers

In many sequential decision-making problems, the goal is to optimize a utility function while satisfying a set of constraints on different utilities. This learning problem is formalized through Constrained Markov Decision Processes (CMDPs).…

Machine Learning · Computer Science 2020-03-05 Yonathan Efroni , Shie Mannor , Matteo Pirotta

Proper balance between exploitation and exploration is what makes good decisions, which achieve high rewards like payoff or evolutionary fitness. The Infomax principle postulates that maximization of information directs the function of…

Machine Learning · Computer Science 2016-05-25 Gautam Reddy , Antonio Celani , Massimo Vergassola

How to efficiently explore in reinforcement learning is an open problem. Many exploration algorithms employ the epistemic uncertainty of their own value predictions -- for instance to compute an exploration bonus or upper confidence bound.…

Machine Learning · Computer Science 2023-03-08 Simon Schmitt , John Shawe-Taylor , Hado van Hasselt

Click-Through Rate (CTR) prediction on cold users is a challenging task in recommender systems. Recent researches have resorted to meta-learning to tackle the cold-user challenge, which either perform few-shot user representation learning…

Information Retrieval · Computer Science 2022-10-31 Yanyan Shen , Lifan Zhao , Weiyu Cheng , Zibin Zhang , Wenwen Zhou , Kangyi Lin

Recommender systems have been widely applied to assist user's decision making by providing a list of personalized item recommendations. Context-aware recommender systems (CARS) additionally take context information into considering in the…

Information Retrieval · Computer Science 2017-10-25 Yong Zheng

Etsy is a global marketplace where people across the world connect to make, buy and sell unique goods. Sellers at Etsy can promote their product listings via advertising campaigns similar to traditional sponsored search ads. Click-Through…

Information Retrieval · Computer Science 2017-11-23 Kamelia Aryafar , Devin Guillory , Liangjie Hong

One of the challenges in online reinforcement learning (RL) is that the agent needs to trade off the exploration of the environment and the exploitation of the samples to optimize its behavior. Whether we optimize for regret, sample…

Machine Learning · Computer Science 2021-11-19 Jean Tarbouriech , Matteo Pirotta , Michal Valko , Alessandro Lazaric

We study platforms in the sharing economy and discuss the need for incentivizing users to explore options that otherwise would not be chosen. For instance, rental platforms such as Airbnb typically rely on customer reviews to provide users…

Machine Learning · Computer Science 2017-11-27 Christoph Hirnschall , Adish Singla , Sebastian Tschiatschek , Andreas Krause

Reinforcement learning requires interaction with an environment, which is expensive for robots. This constraint necessitates approaches that work with limited environmental interaction by maximizing the reuse of previous experiences. We…

Artificial Intelligence · Computer Science 2024-04-05 Benedict Quartey , Ankit Shah , George Konidaris

Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore…

Machine Learning · Computer Science 2026-04-21 Faisal Mohamed , Catherine Ji , Benjamin Eysenbach , Glen Berseth

Symbolic Regression aims to automatically identify compact and interpretable mathematical expressions that model the functional relationship between input and output variables. Most existing search-based symbolic regression methods…

Machine Learning · Computer Science 2026-01-22 Jianwen Sun , Xinrui Li , Fuqing Li , Xiaoxuan Shen

This paper introduces a novel contextual bandit algorithm for personalized pricing under utility fairness constraints in scenarios with uncertain demand, achieving an optimal regret upper bound. Our approach, which incorporates dynamic…

Machine Learning · Statistics 2023-11-29 Xi Chen , David Simchi-Levi , Yining Wang

This research presents an innovative and unique way of solving the advertisement prediction problem which is considered as a learning problem over the past several years. Online advertising is a multi-billion-dollar industry and is growing…

Information Retrieval · Computer Science 2017-02-15 Muhammad Junaid Effendi , Syed Abbas Ali

We study reinforcement learning from human feedback in general Markov decision processes, where agents learn from trajectory-level preference comparisons. A central challenge in this setting is to design algorithms that select informative…

Machine Learning · Computer Science 2025-12-05 Andreas Schlaginhaufen , Reda Ouhamma , Maryam Kamgarpour

The deep reinforcement learning (DRL) algorithm works brilliantly on solving various complex control tasks. This phenomenal success can be partly attributed to DRL encouraging intelligent agents to sufficiently explore the environment and…

Machine Learning · Computer Science 2023-01-09 Chao Li , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

This paper has been withdrawn by the authors. We present a framework for sequential decision making in problems described by graphical models. The setting is given by dependent discrete random variables with associated costs or revenues. In…

Applications · Statistics 2013-07-01 Gabriele Martinelli , Jo Eidsvik , Ragnar Hauge

Recommendation Systems have become integral to modern user experiences, but lack transparency in their decision-making processes. Existing explainable recommendation methods are hindered by reliance on a post-hoc paradigm, wherein…

Information Retrieval · Computer Science 2024-12-04 Xiaohan Yu , Li Zhang , Chong Chen

One of the important factors that affects the performance of Cross Language Information Retrieval(CLIR)is the quality of translations being employed in CLIR. In order to improve the quality of translations, it is important to exploit…

Information Retrieval · Computer Science 2014-05-22 Hosein Azarbonyad , Azadeh Shakery , Heshaam Faili

Recent results have shown that the MCTS algorithm (a new, adaptive, randomized optimization algorithm) is effective in a remarkably diverse set of applications in Artificial Intelligence, Operations Research, and High Energy Physics. MCTS…

Artificial Intelligence · Computer Science 2015-09-29 S. Ali Mirsoleimani , Aske Plaat , Jaap van den Herik

Unsupervised reinforcement learning (URL) aims to pre-train agents by exploring diverse states or skills in reward-free environments, facilitating efficient adaptation to downstream tasks. As the agent cannot access extrinsic rewards during…

Machine Learning · Computer Science 2025-05-19 Chengyang Ying , Huayu Chen , Xinning Zhou , Zhongkai Hao , Hang Su , Jun Zhu