English
Related papers

Related papers: Comparing item response theory models for ranking …

200 papers

The problem of relevance ranking consists of sorting a set of objects with respect to a given criterion. Since users may prefer different relevance criteria, the ranking algorithms should be adaptable to the user needs. Two main approaches…

Machine Learning · Computer Science 2023-11-06 Leonardo Rigutini , Tiziano Papini , Marco Maggini , Franco Scarselli

Large Language Models (LLMs) are being increasingly explored as general-purpose tools for recommendation tasks, enabling zero-shot and instruction-following capabilities without the need for task-specific training. While the research…

Information Retrieval · Computer Science 2025-08-05 Ethan Bito , Yongli Ren , Estrid He

In responding to rating questions, an individual may give answers either according to his/her knowledge/awareness or to his/her level of indecision/uncertainty, typically driven by a response style. As ignoring this dual behaviour may lead…

Methodology · Statistics 2021-04-08 Roberto Colombi , Sabrina Giordano , Anna Gottard , Maria Iannario

Unbiased Learning to Rank (ULTR) that learns to rank documents with biased user feedback data is a well-known challenge in information retrieval. Existing methods in unbiased learning to rank typically rely on click modeling or inverse…

Information Retrieval · Computer Science 2023-02-09 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Dawei Yin , Brian D. Davison

Large language models (LLMs) are increasingly deployed via public-facing interfaces to interact with millions of users, each with diverse preferences. Despite this, preference tuning of LLMs predominantly relies on reward models trained…

Computation and Language · Computer Science 2024-12-06 Vishakh Padmakumar , Chuanyang Jin , Hannah Rose Kirk , He He

In many real-world settings, the critical class is rare and a missed detection carries a disproportionately high cost. For example, tumors are rare and a false negative diagnosis could have severe consequences on treatment outcomes;…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mohammadi Kiarash , Zhao He , Mengyao Zhai , Frederick Tung

Large-scale industrial recommendation models predict the most relevant items from catalogs containing millions or billions of options. To train these models efficiently, a small set of irrelevant items (negative samples) is selected from…

Information Retrieval · Computer Science 2024-10-30 Arushi Prakash , Dimitrios Bermperidis , Srivas Chennu

Listwise ranking losses have been widely studied in recommender systems. However, new paradigms of content consumption present new challenges for ranking methods. In this work we contribute an analysis of learning to rank for personalized…

Information Retrieval · Computer Science 2022-01-20 Yuguang Yue , Yuanpu Xie , Huasen Wu , Haofeng Jia , Shaodan Zhai , Wenzhe Shi , Jonathan J Hunt

Reward models (RMs) are essential for aligning Large Language Models (LLMs) with human preferences. However, they often struggle with capturing complex human preferences and generalizing to unseen data. To address these challenges, we…

Computation and Language · Computer Science 2025-08-06 Anamika Lochab , Ruqi Zhang

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

Recommendation algorithms typically build models based on historical user-item interactions (e.g., clicks, likes, or ratings) to provide a personalized ranked list of items. These interactions are often distributed unevenly over different…

Information Retrieval · Computer Science 2021-03-16 Ziwei Zhu , Jianling Wang , James Caverlee

The application of large language models (LLMs) in recommendation systems has recently gained traction. Traditional recommendation systems often lack explainability and suffer from issues such as popularity bias. Previous research has also…

Information Retrieval · Computer Science 2025-12-04 Yaqi Wang , Haojia Sun , Shuting Zhang

Online learning to rank (OLTR) via implicit feedback has been extensively studied for document retrieval in cases where the feedback is available at the level of individual items. To learn from item-level feedback, the current algorithms…

Information Retrieval · Computer Science 2019-01-10 Chang Li , Artem Grotov , Ilya Markov , Maarten de Rijke

Ranks estimated from data are uncertain and this poses a challenge in many applications. However, estimated ranks are deterministic functions of estimated parameters, so the uncertainty in the ranks must be determined by the uncertainty in…

Methodology · Statistics 2023-06-22 Justin Rising

Higher-order networks are efficient representations of sequential data. Unlike the classic first-order network approach, they capture indirect dependencies between items composing the input sequences by the use of \textit{memory-nodes}. We…

Physics and Society · Physics 2021-09-08 Célestin Coquidé , Julie Queiros , François Queyroi

Ranking models have achieved promising results, but it remains challenging to design personalized ranking systems to leverage user profiles and semantic representations between queries and documents. In this paper, we propose a topic-based…

Information Retrieval · Computer Science 2021-08-16 Minghui Huang , Wei Peng , Dong Wang

Learning to rank is an important problem in machine learning and recommender systems. In a recommender system, a user is typically recommended a list of items. Since the user is unlikely to examine the entire recommended list, partial…

Information Retrieval · Computer Science 2018-11-22 Prakhar Gupta , Gaurush Hiranandani , Harvineet Singh , Branislav Kveton , Zheng Wen , Iftikhar Ahamath Burhanuddin

This paper proposes a theoretical analysis of recommendation systems in an online setting, where items are sequentially recommended to users over time. In each round, a user, randomly picked from a population of $m$ users, requests a…

Machine Learning · Statistics 2020-10-26 Kaito Ariu , Narae Ryu , Se-Young Yun , Alexandre Proutière

Ranked lists are frequently used by information retrieval (IR) systems to present results believed to be relevant to the users information need. Fairness is a relatively new but important aspect of these rankings to measure, joining a rich…

Information Retrieval · Computer Science 2022-01-11 Amifa Raj , Michael D. Ekstrand

Item Response Theory (IRT) is widely applied in the human sciences to model persons' responses on a set of items measuring one or more latent constructs. While several R packages have been developed that implement IRT models, they tend to…

Computation · Statistics 2020-02-04 Paul-Christian Bürkner