English
Related papers

Related papers: Modeling Relevance Ranking under the Pre-training …

200 papers

Despite the significant progress made by existing retrieval augmented language models (RALMs) in providing trustworthy responses and grounding in reliable sources, they often overlook effective alignment with human preferences. In the…

Computation and Language · Computer Science 2024-12-19 Zhuoran Jin , Hongbang Yuan , Tianyi Men , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown…

Information Retrieval · Computer Science 2021-09-14 Shengyao Zhuang , Guido Zuccon

Supervised ranking methods based on bi-encoder or cross-encoder architectures have shown success in multi-stage text ranking tasks, but they require large amounts of relevance judgments as training data. In this work, we propose Listwise…

Information Retrieval · Computer Science 2023-05-04 Xueguang Ma , Xinyu Zhang , Ronak Pradeep , Jimmy Lin

The problem of relevance ranking consists of sorting a set of objects with respect to a given criterion. Since users may prefer different relevance criteria, the ranking algorithms should be adaptable to the user needs. Two main approaches…

Machine Learning · Computer Science 2023-11-06 Leonardo Rigutini , Tiziano Papini , Marco Maggini , Franco Scarselli

Utilizing large language models (LLMs) for document reranking has been a popular and promising research direction in recent years, many studies are dedicated to improving the performance and efficiency of using LLMs for reranking. Besides,…

Information Retrieval · Computer Science 2025-04-11 Qi Liu , Haozhe Duan , Yiqun Chen , Quanfeng Lu , Weiwei Sun , Jiaxin Mao

Author profiling is the task of inferring characteristics about individuals by analyzing content they share. Supervised machine learning still dominates automatic systems that perform this task, despite the popularity of prompting large…

Computation and Language · Computer Science 2025-05-29 Jan Hofmann , Cornelia Sindermann , Roman Klinger

Large-scale Vision-Language Models (LVLMs) process both images and text, excelling in multimodal tasks such as image captioning and description generation. However, while these models excel at generating factual content, their ability to…

The advent of deep neural networks pre-trained via language modeling tasks has spurred a number of successful applications in natural language processing. This work explores one such popular model, BERT, in the context of document ranking.…

Information Retrieval · Computer Science 2019-11-01 Rodrigo Nogueira , Wei Yang , Kyunghyun Cho , Jimmy Lin

The introduction of Large Language Models (LLMs), and the vast volume of publicly available medical data, amplified the application of NLP to the medical domain. However, LLMs are pretrained on data that are not explicitly relevant to the…

Computation and Language · Computer Science 2023-12-12 Chris Solomou

The recent literature on online learning to rank (LTR) has established the utility of prior knowledge to Bayesian ranking bandit algorithms. However, a major limitation of existing work is the requirement for the prior used by the algorithm…

Machine Learning · Computer Science 2023-02-27 Javad Azizi , Ofer Meshi , Masrour Zoghi , Maryam Karimzadehgan

Large Language Models (LLMs) have demonstrated significant strides across various information retrieval tasks, particularly as rerankers, owing to their strong generalization and knowledge-transfer capabilities acquired from extensive…

Information Retrieval · Computer Science 2025-06-18 Rahul Seetharaman , Kaustubh D. Dhole , Aman Bansal

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web. A prevailing…

Computation and Language · Computer Science 2021-09-20 Yu Gu , Robert Tinn , Hao Cheng , Michael Lucas , Naoto Usuyama , Xiaodong Liu , Tristan Naumann , Jianfeng Gao , Hoifung Poon

Ranking documents using Large Language Models (LLMs) by directly feeding the query and candidate documents into the prompt is an interesting and practical problem. However, researchers have found it difficult to outperform fine-tuned…

Information Retrieval · Computer Science 2024-03-29 Zhen Qin , Rolf Jagerman , Kai Hui , Honglei Zhuang , Junru Wu , Le Yan , Jiaming Shen , Tianqi Liu , Jialu Liu , Donald Metzler , Xuanhui Wang , Michael Bendersky

The search engine plays a fundamental role in online e-commerce systems, to help users find the products they want from the massive product collections. Relevance is an essential requirement for e-commerce search, since showing products…

Information Retrieval · Computer Science 2021-02-16 Shaowei Yao , Jiwei Tan , Xi Chen , Keping Yang , Rong Xiao , Hongbo Deng , Xiaojun Wan

Large-scale pre-trained language models such as BERT are popular solutions for text classification. Due to the superior performance of these advanced methods, nowadays, people often directly train them for a few epochs and deploy the…

Computation and Language · Computer Science 2023-06-13 Yu-Chen Lin , Si-An Chen , Jie-Jyun Liu , Chih-Jen Lin

Context: Mobile app reviews written by users on app stores or social media are significant resources for app developers.Analyzing app reviews have proved to be useful for many areas of software engineering (e.g., requirement engineering,…

Software Engineering · Computer Science 2022-04-08 Mohammad Abdul Hadi , Fatemeh H. Fard

Retrieval-based dialogue systems select the best response from many candidates. Although many state-of-the-art models have shown promising performance in dialogue response selection tasks, there is still quite a gap between R@1 and R@10…

Computation and Language · Computer Science 2021-05-31 Mingzhi Yu , Diane Litman

Web search provides a promising way for people to obtain information and has been extensively studied. With the surgence of deep learning and large-scale pre-training techniques, various neural information retrieval models are proposed and…

Information Retrieval · Computer Science 2022-03-02 Yujia Zhou , Jing Yao , Zhicheng Dou , Ledell Wu , Ji-Rong Wen

We explore several new models for document relevance ranking, building upon the Deep Relevance Matching Model (DRMM) of Guo et al. (2016). Unlike DRMM, which uses context-insensitive encodings of terms and query-document term interactions,…

Information Retrieval · Computer Science 2018-09-12 Ryan McDonald , Georgios-Ioannis Brokos , Ion Androutsopoulos

Service manual documents are crucial to the engineering company as they provide guidelines and knowledge to service engineers. However, it has become inconvenient and inefficient for service engineers to retrieve specific knowledge from…

Computation and Language · Computer Science 2021-06-25 Jia Wei Chong , Zhiyuan Chen , Mei Shin Oh