English
Related papers

Related papers: On the Difficulty of Evaluating Baselines: A Study…

200 papers

Datasets are often generated in a sequential manner, where the previous samples and intermediate decisions or interventions affect subsequent samples. This is especially prominent in cases where there are significant human-AI interactions,…

Information Retrieval · Computer Science 2022-05-30 Ali Shirali

Large-scale recommender systems often face severe latency and storage constraints at prediction time. These are particularly acute when the number of items that could be recommended is large, and calculating predictions for the full set is…

Information Retrieval · Computer Science 2017-09-05 Maciej Kula

Recommender systems are crucial tools to overcome the information overload brought about by the Internet. Rigorous tests are needed to establish to what extent sophisticated methods can improve the quality of the predictions. Here we…

Information Retrieval · Computer Science 2007-09-19 Marcel Blattner , Alexander Hunziker , Paolo Laureti

Various studies in recent years have pointed out large issues in the offline evaluation of recommender systems, making it difficult to assess whether true progress has been made. However, there has been little research into what set of…

Information Retrieval · Computer Science 2022-11-03 Tobias Schnabel

Large language models (LLMs) struggle with multi-step reasoning, where inference-time scaling has emerged as a promising strategy for performance improvement. Verifier-guided search outperforms repeated sampling when sample size is limited…

Computation and Language · Computer Science 2025-02-04 Fei Yu , Yingru Li , Benyou Wang

Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information. As such it is important to ask: what are the possible fairness risks,…

Computers and Society · Computer Science 2019-03-12 Alex Beutel , Jilin Chen , Tulsee Doshi , Hai Qian , Li Wei , Yi Wu , Lukasz Heldt , Zhe Zhao , Lichan Hong , Ed H. Chi , Cristos Goodrow

Matrix factorization (MF) is extensively used to mine the user preference from explicit ratings in recommender systems. However, the reliability of explicit ratings is not always consistent, because many factors may affect the user's final…

Information Retrieval · Computer Science 2018-06-25 Zhipeng Wu , Hui Tian , Xuzhen Zhu , Shuo Wang

Bayesian Personalized Ranking (BPR), a collaborative filtering approach based on matrix factorization, frequently serves as a benchmark for recommender systems research. However, numerous studies often overlook the nuances of BPR…

Information Retrieval · Computer Science 2024-10-21 Aleksandr Milogradskii , Oleg Lashinin , Alexander P , Marina Ananyeva , Sergey Kolesnikov

Machine Learning (ML) research has increased substantially in recent years, due to the success of predictive modeling across diverse application domains. However, well-known barriers exist when attempting to deploy ML models in high-stakes,…

Machine Learning · Computer Science 2024-09-19 Nathan Wolfrath , Joel Wolfrath , Hengrui Hu , Anjishnu Banerjee , Anai N. Kothari

Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach…

Machine Learning · Computer Science 2016-05-30 Tobias Schnabel , Adith Swaminathan , Ashudeep Singh , Navin Chandak , Thorsten Joachims

Argument Mining is the research area which aims at extracting argument components and predicting argumentative relations (i.e.,support and attack) from text. In particular, numerous approaches have been proposed in the literature to predict…

Computation and Language · Computer Science 2020-03-12 Oana Cocarascu , Elena Cabrio , Serena Villata , Francesca Toni

We apply recurrent neural networks (RNN) on a new domain, namely recommender systems. Real-life recommender systems often face the problem of having to base recommendations only on short session-based data (e.g. a small sportsware website)…

Machine Learning · Computer Science 2016-03-30 Balázs Hidasi , Alexandros Karatzoglou , Linas Baltrunas , Domonkos Tikk

Expertise is a loosely defined concept that is hard to formalize. Much research has focused on designing efficient algorithms for expert finding in large databases in various application domains. The evaluation of such recommender systems…

Information Retrieval · Computer Science 2018-06-29 Robin Brochier , Adrien Guille , Benjamin Rothan , Julien Velcin

Strong empirical evidence that one machine-learning algorithm A outperforms another one B ideally calls for multiple trials optimizing the learning pipeline over sources of variation such as data sampling, data augmentation, parameter…

The selection, development, or comparison of machine learning methods in data mining can be a difficult task based on the target problem and goals of a particular study. Numerous publicly available real-world and simulated benchmark…

Machine Learning · Computer Science 2017-03-03 Randal S. Olson , William La Cava , Patryk Orzechowski , Ryan J. Urbanowicz , Jason H. Moore

We consider the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative. Using movie reviews as data, we find that standard machine learning techniques definitively…

Computation and Language · Computer Science 2007-05-23 Bo Pang , Lillian Lee , Shivakumar Vaithyanathan

Recommendation systems are now an integral part of our daily lives. We rely on them for tasks such as discovering new movies, finding friends on social media, and connecting job seekers with relevant opportunities. Given their vital role,…

Artificial Intelligence · Computer Science 2025-02-26 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

Much of the complexity of Recommender Systems (RSs) comes from the fact that they are used as part of more complex applications and affect user experience through a varied range of user interfaces. However, research focused almost…

Recent trends in planning research have led to empirical comparison becoming commonplace. The field has started to settle into a methodology for such comparisons, which for obvious practical reasons requires running a subset of planners on…

Artificial Intelligence · Computer Science 2011-06-10 E. Dahlman , A. E. Howe

Over the past decades, researchers had put lots of effort investigating ranking techniques used to rank query results retrieved during information retrieval, or to rank the recommended products in recommender systems. In this project, we…

Information Retrieval · Computer Science 2022-08-23 Jiashu Wu