English
Related papers

Related papers: It's Time to Consider "Time" when Evaluating Recom…

200 papers

Recommending appropriate algorithms to a classification problem is one of the most challenging issues in the field of data mining. The existing algorithm recommendation models are generally constructed on only one kind of meta-features by…

Information Retrieval · Computer Science 2021-06-08 Guangtao Wang , Qinbao Song , Xiaoyan Zhu

Offline evaluations of recommender systems attempt to estimate users' satisfaction with recommendations using static data from prior user interactions. These evaluations provide researchers and developers with first approximations of the…

Information Retrieval · Computer Science 2020-01-28 Mucun Tian , Michael D. Ekstrand

Direct optimization of IR metrics has often been adopted as an approach to devise and develop ranking-based recommender systems. Most methods following this approach aim at optimizing the same metric being used for evaluation, under the…

Information Retrieval · Computer Science 2021-06-07 Roger Zhe Li , Julián Urbano , Alan Hanjalic

Though it has been recognized that recommending serendipitous (i.e., surprising and relevant) items can be helpful for increasing users' satisfaction and behavioral intention, how to measure serendipity in the offline environment is still…

Human-Computer Interaction · Computer Science 2020-04-23 Li Chen , Ningxia Wang , Yonghua Yang , Keping Yang , Quan Yuan

Research on recommender systems is a challenging task, as is building and operating such systems. Major challenges include non-reproducible research results, dealing with noisy data, and answering many questions such as how many…

Information Retrieval · Computer Science 2017-04-04 Joeran Beel , Siddharth Dinesh

The ongoing rapid expansion of the Internet greatly increases the necessity of effective recommender systems for filtering the abundant information. Extensive research for recommender systems is conducted by a broad range of communities…

Physics and Society · Physics 2015-06-04 Linyuan Lü , Matus Medo , Chi Ho Yeung , Yi-Cheng Zhang , Zi-Ke Zhang , Tao Zhou

Recommendation to groups of users is a challenging and currently only passingly studied task. Especially the evaluation aspect often appears ad-hoc and instead of truly evaluating on groups of users, synthesizes groups by merging individual…

Artificial Intelligence · Computer Science 2017-08-01 Zsolt Mezei , Carsten Eickhoff

As the field of recommender systems has developed, authors have used a myriad of notations for describing the mathematical workings of recommendation algorithms. These notations ap-pear in research papers, books, lecture notes, blog posts,…

Information Retrieval · Computer Science 2019-02-13 Michael D. Ekstrand , Joseph A. Konstan

Recommender systems are crucial tools to overcome the information overload brought about by the Internet. Rigorous tests are needed to establish to what extent sophisticated methods can improve the quality of the predictions. Here we…

Information Retrieval · Computer Science 2007-09-19 Marcel Blattner , Alexander Hunziker , Paolo Laureti

Recommender systems are one of the most successful applications of machine learning and data science. They are successful in a wide variety of application domains, including e-commerce, media streaming content, email marketing, and…

Information Retrieval · Computer Science 2023-04-04 Juan Pablo Equihua , Maged Ali , Henrik Nordmark , Berthold Lausen

Reciprocal recommender systems~(RRS), conducting bilateral recommendations between two involved parties, have gained increasing attention for enhancing matching efficiency. However, the majority of existing methods in the literature still…

Information Retrieval · Computer Science 2024-08-20 Chen Yang , Sunhao Dai , Yupeng Hou , Wayne Xin Zhao , Jun Xu , Yang Song , Hengshu Zhu

Sustainability-oriented evaluation metrics can help to assess the quality of recommender systems beyond wide-spread metrics such as accuracy, precision, recall, and satisfaction. Following the United Nations`s sustainable development goals…

Information Retrieval · Computer Science 2025-07-31 Alexander Felfernig , Damian Garber , Viet-Man Le , Sebastian Lubos , Thi Ngoc Trang Tran

The selection of the best classification algorithm for a given dataset is a very widespread problem. It is also a complex one, in the sense it requires to make several important methodological choices. Among them, in this work we focus on…

Machine Learning · Computer Science 2012-07-18 Vincent Labatut , Hocine Cherifi

As recommender systems become widely deployed in different domains, they increasingly influence their users' beliefs and preferences. Auditing recommender systems is crucial as it not only ensures the continuous improvement of…

Machine Learning · Computer Science 2024-09-23 Vibhhu Sharma , Shantanu Gupta , Nil-Jana Akpinar , Zachary C. Lipton , Liu Leqi

Recommender systems help people find relevant content in a personalized way. One main promise of such systems is that they are able to increase the visibility of items in the long tail, i.e., the lesser-known items in a catalogue. Existing…

Information Retrieval · Computer Science 2024-07-03 Anastasiia Klimashevskaia , Dietmar Jannach , Mehdi Elahi , Christoph Trattner

Context: Software engineering has a problem in that when we empirically evaluate competing prediction systems we obtain conflicting results. Objective: To reduce the inconsistency amongst validation study results and provide a more formal…

Software Engineering · Computer Science 2021-01-15 Martin Shepperd , Stephen G. MacDonell

Our work revisits the design of mechanisms via the learning-augmented framework. In this model, the algorithm is enhanced with imperfect (machine-learned) information concerning the input, usually referred to as prediction. The goal is to…

Computer Science and Game Theory · Computer Science 2024-10-29 George Christodoulou , Alkmini Sgouritsa , Ioannis Vlachos

Recommender systems operate in an inherently dynamical setting. Past recommendations influence future behavior, including which data points are observed and how user preferences change. However, experimenting in production systems with real…

Information Retrieval · Computer Science 2020-11-17 Karl Krauth , Sarah Dean , Alex Zhao , Wenshuo Guo , Mihaela Curmei , Benjamin Recht , Michael I. Jordan

A prevalent practice in recommender systems consists in averaging item embeddings to represent users or higher-level concepts in the same embedding space. This paper investigates the relevance of such a practice. For this purpose, we…

Information Retrieval · Computer Science 2023-08-31 Walid Bendada , Guillaume Salha-Galvan , Romain Hennequin , Thomas Bouabça , Tristan Cazenave

Probabilistic time-series models become popular in the forecasting field as they help to make optimal decisions under uncertainty. Despite the growing interest, a lack of thorough analysis hinders choosing what is worth applying for the…

Machine Learning · Computer Science 2020-11-24 Seungjae Jung , Kyung-Min Kim , Hanock Kwak , Young-Jin Park