English
Related papers

Related papers: A Markov Decision Process Analysis of the Cold Sta…

200 papers

In this paper, we study the remote estimation problem of a Markov process over a channel with a cost. We formulate this problem as an infinite horizon optimization problem with two players, i.e., a sensor and a monitor, that have distinct…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Edoardo David Santi , Touraj Soleymani , Deniz Gunduz

Recommender systems are increasingly used to predict and serve content that aligns with user taste, yet the task of matching new users with relevant content remains a challenge. We consider podcasting to be an emerging medium with rapid…

Information Retrieval · Computer Science 2020-07-28 Zahra Nazari , Christophe Charbuillet , Johan Pages , Martin Laurent , Denis Charrier , Briana Vecchione , Ben Carterette

In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian…

Statistics Theory · Mathematics 2020-04-22 Giorgio M. Vitetta , Pasquale Di Viesti , Emilio Sirignano , Francesco Montorsi

The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal…

Machine Learning · Statistics 2015-08-04 Yuval Harel , Ron Meir , Manfred Opper

Clicking data, which exists in abundance and contains objective user preference information, is widely used to produce personalized recommendations in web-based applications. Current popular recommendation algorithms, typically based on…

Methodology · Statistics 2019-04-08 Qinghua Liu , Andrew Henry Reiner , Arnoldo Frigessi , Ida Scheel

Gaussian processes are a versatile probabilistic machine learning model whose effectiveness often depends on good hyperparameters, which are typically learned by maximising the marginal likelihood. In this work, we consider iterative…

Machine Learning · Computer Science 2024-05-29 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , José Miguel Hernández-Lobato

We consider a transmitter-receiver pair in a slotted-time system. The transmitter observes a dynamic source and sends updates to a remote receiver through an error-free communication channel that suffers a random delay. We consider two…

Information Theory · Computer Science 2025-12-19 Yutao Chen , Anthony Ephremides

Whereas classical Markov decision processes maximize the expected reward, we consider minimizing the risk. We propose to evaluate the risk associated to a given policy over a long-enough time horizon with the help of a central limit…

Optimization and Control · Mathematics 2015-12-03 Pengqian Yu , Jia Yuan Yu , Huan Xu

Sequential recommenders have made great strides in capturing a user's preferences. Nevertheless, the cold-start recommendation remains a fundamental challenge as they typically involve limited user-item interactions for personalization.…

Information Retrieval · Computer Science 2023-08-22 Minchang Kim , Yongjin Yang , Jung Hyun Ryu , Taesup Kim

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Machine Learning · Computer Science 2023-11-23 Ryota Ozaki , Kazuki Ishikawa , Youhei Kanzaki , Shinya Suzuki , Shion Takeno , Ichiro Takeuchi , Masayuki Karasuyama

In this paper we propose to solve an important problem in recommendation -- user cold start, based on meta leaning method. Previous meta learning approaches finetune all parameters for each new user, which is both computing and storage…

Information Retrieval · Computer Science 2019-12-10 Liang Zhao , Yang Wang , Daxiang Dong , Hao Tian

We consider a decision maker who must choose an action in order to maximize a reward function that depends also on an unknown parameter {\Theta}. The decision maker can delay taking the action in order to experiment and gather additional…

Machine Learning · Statistics 2021-06-22 Victor F. Araman , Rene Caldentey

With the rapid evolution of the Internet and the exponential proliferation of information, users encounter information overload and the conundrum of choice. Personalized recommendation systems play a pivotal role in alleviating this burden…

Information Retrieval · Computer Science 2024-03-29 Kangming Xu , Huiming Zhou , Haotian Zheng , Mingwei Zhu , Qi Xin

The recommender system is one of the most promising ways to address the information overload problem in online systems. Based on the personal historical record, the recommender system can find interesting and relevant objects for the user…

Information Retrieval · Computer Science 2015-06-17 An Zeng , Alexandre Vidmer , Matus Medo , Yi-Cheng Zhang

The Bayesian treatment of neural networks dictates that a prior distribution is specified over their weight and bias parameters. This poses a challenge because modern neural networks are characterized by a large number of parameters, and…

Machine Learning · Statistics 2022-04-26 Ba-Hien Tran , Simone Rossi , Dimitrios Milios , Maurizio Filippone

Using only implicit data, many recommender systems fail in general to provide a precise set of recommendations to users with limited interaction history. This issue is regarded as the "Cold Start" problem and is typically resolved by…

Information Retrieval · Computer Science 2017-04-11 Yubo Zhou , Ali Nadaf

This paper provides a theoretical analysis of a new learning problem for recommender systems where users provide feedback by comparing pairs of items instead of rating them individually. We assume that comparisons stem from latent user and…

Machine Learning · Computer Science 2025-08-20 Suryanarayana Sankagiri , Jalal Etesami , Matthias Grossglauser

This paper tackles the growing issue of excessive data transmission in networks. With increasing traffic, backhaul links and core networks are under significant traffic, leading to the investigation of caching solutions at edge routers.…

Networking and Internet Architecture · Computer Science 2024-10-31 Farnaz Niknia , Ping Wang , Zixu Wang , Aakash Agarwal , Adib S. Rezaei

There is much empirical evidence that item-item collaborative filtering works well in practice. Motivated to understand this, we provide a framework to design and analyze various recommendation algorithms. The setup amounts to online binary…

Machine Learning · Computer Science 2016-01-11 Guy Bresler , Devavrat Shah , Luis F. Voloch

Recommendation systems often rely on point-wise loss metrics such as the mean squared error. However, in real recommendation settings only few items are presented to a user. This observation has recently encouraged the use of rank-based…

Machine Learning · Computer Science 2015-11-05 Phong Nguyen , Jun Wang , Alexandros Kalousis