English
Related papers

Related papers: Analyzing the Effectiveness of Listwise Reranking …

200 papers

Retrieve-and-rerank is a prevalent framework in neural information retrieval, wherein a bi-encoder network initially retrieves a pre-defined number of candidates (e.g., K=100), which are then reranked by a more powerful cross-encoder model.…

Information Retrieval · Computer Science 2024-05-29 Revanth Gangi Reddy , Pradeep Dasigi , Md Arafat Sultan , Arman Cohan , Avirup Sil , Heng Ji , Hannaneh Hajishirzi

Large language models (LLMs) exhibit positional bias in how they use context, which especially complicates listwise ranking. To address this, we propose permutation self-consistency, a form of self-consistency over ranking list outputs of…

Computation and Language · Computer Science 2024-04-23 Raphael Tang , Xinyu Zhang , Xueguang Ma , Jimmy Lin , Ferhan Ture

Oftentimes, environments for sequential decision-making problems can be quite sparse in the provision of evaluative feedback to guide reinforcement-learning agents. In the extreme case, long trajectories of behavior are merely punctuated…

Machine Learning · Computer Science 2023-08-22 Akash Velu , Skanda Vaidyanath , Dilip Arumugam

Retrievability of a document is a collection-based statistic that measures its expected (reciprocal) rank of being retrieved within a specific rank cut-off. A collection with uniformly distributed retrievability scores across documents is…

Information Retrieval · Computer Science 2025-11-19 Xuejun Chang , Zaiqiao Meng , Debasis Ganguly

In e-commerce ranking, implicit user feedback is systematically confounded by Position Bias -- the strong propensity of users to interact with top-ranked items regardless of relevance. While Deep Learning architectures (e.g., Two-Tower…

Information Retrieval · Computer Science 2026-02-03 Vipul Dinesh Pawar

Stochastic resetting, where a dynamical process is intermittently returned to a fixed reference state, has emerged as a powerful mechanism for optimizing first-passage properties. Existing theory largely treats static, non-learning…

Machine Learning · Computer Science 2026-03-18 Jello Zhou , Vudtiwat Ngampruetikorn , David J. Schwab

We introduce LOCORE, Long-Context Re-ranker, a model that takes as input local descriptors corresponding to an image query and a list of gallery images and outputs similarity scores between the query and each gallery image. This model is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Zilin Xiao , Pavel Suma , Ayush Sachdeva , Hao-Jen Wang , Giorgos Kordopatis-Zilos , Giorgos Tolias , Vicente Ordonez

Performance of text classification models tends to drop over time due to changes in data, which limits the lifetime of a pretrained model. Therefore an ability to predict a model's ability to persist over time can help design models that…

Computation and Language · Computer Science 2022-11-22 Rabab Alkhalifa , Elena Kochkina , Arkaitz Zubiaga

Distributed LLM serving systems optimize per-request latency and throughput. However, under long-context workloads, inference accuracy becomes more variable. When incorrect responses trigger retries, accuracy directly translates into…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-20 Takeshi Yoshimura , Valentijn Dymphnus van de Beek , Tatsuhiro Chiba

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Natural data are often long-tail distributed over semantic classes. Existing recognition methods tackle this imbalanced classification by placing more emphasis on the tail data, through class re-balancing/re-weighting or ensembling over…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xudong Wang , Long Lian , Zhongqi Miao , Ziwei Liu , Stella X. Yu

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

Machine Learning · Computer Science 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

Interleaving is an online evaluation approach for information retrieval systems that compares the effectiveness of ranking functions in interpreting the users' implicit feedback. Previous work such as Hofmann et al (2011) has evaluated the…

Information Retrieval · Computer Science 2023-03-20 Alessandro Benedetti , Anna Ruggero

Across a variety of ranking tasks, researchers use reciprocal rank to measure the effectiveness for users interested in exactly one relevant item. Despite its widespread use, evidence suggests that reciprocal rank is brittle when…

Information Retrieval · Computer Science 2023-06-14 Fernando Diaz

We present the methodology and results of the Deep Retrieval team for subtask 4b of the CLEF CheckThat! 2025 competition, which focuses on retrieving relevant scientific literature for given social media posts. To address this task, we…

Information Retrieval · Computer Science 2025-07-08 Pascal J. Sager , Ashwini Kamaraj , Benjamin F. Grewe , Thilo Stadelmann

Large Language Models (LLMs) excel across a variety of language tasks yet are constrained by limited input lengths and high computational costs. Existing approaches\textemdash such as relative positional encodings (e.g., RoPE, ALiBi) and…

Computation and Language · Computer Science 2025-02-18 Kun-Hui Lee , Eunhwan Park , Donghoon Han , Seung-Hoon Na

Reinforcement learning (RL) policies are typically trained for fixed objectives, making reuse difficult when task requirements change. We study inference-time policy reuse: given a library of pre-trained policies and a new composite…

Machine Learning · Computer Science 2026-04-29 Ihor Vitenko , Noha Ibrahim , Sihem Amer-Yahia

This paper presents the results of an empirical investigation of temporal reference resolution in scheduling dialogs. The algorithm adopted is primarily a linear-recency based approach that does not include a model of global focus. A fully…

cmp-lg · Computer Science 2008-02-03 Janyce Wiebe , Tom O'Hara , Kenneth McKeever , Thorsten Oehrstroem-Sandgren

Generative retrieval stands out as a promising new paradigm in text retrieval that aims to generate identifier strings of relevant passages as the retrieval target. This generative paradigm taps into powerful generative language models,…

Computation and Language · Computer Science 2023-12-19 Yongqi Li , Nan Yang , Liang Wang , Furu Wei , Wenjie Li

Supervised machine learning models and their evaluation strongly depends on the quality of the underlying dataset. When we search for a relevant piece of information it may appear anywhere in a given passage. However, we observe a bias in…

Information Retrieval · Computer Science 2021-01-19 Sebastian Hofstätter , Aldo Lipani , Sophia Althammer , Markus Zlabinger , Allan Hanbury
‹ Prev 1 8 9 10 Next ›