English
Related papers

Related papers: Fine-Grained Relevance Annotations for Multi-Task …

200 papers

Learning to Rank has traditionally considered settings where given the relevance information of objects, the desired order in which to rank the objects is clear. However, with today's large variety of users and layouts this is not always…

Information Retrieval · Computer Science 2018-08-29 Harrie Oosterhuis , Maarten de Rijke

Retrieval-augmented language models have exhibited promising performance across various areas of natural language processing (NLP), including fact-critical tasks. However, due to the black-box nature of advanced large language models (LLMs)…

Computation and Language · Computer Science 2024-04-29 Xuan Zhang , Wei Gao

Retrieval augmented generation has revolutionized large language model (LLM) outputs by providing factual supports. Nevertheless, it struggles to capture all the necessary knowledge for complex reasoning questions. Existing retrieval…

Computation and Language · Computer Science 2024-10-21 Zijian Li , Qingyan Guo , Jiawei Shao , Lei Song , Jiang Bian , Jun Zhang , Rui Wang

With the widespread use of the internet, it has become increasingly crucial to extract specific information from vast amounts of academic articles efficiently. Data mining techniques are generally employed to solve this issue. However, data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Jinghong Li , Koichi Ota , Wen Gu , Shinobu Hasegawa

Retrieval-Augmented Generation (RAG) aims to generate more reliable and accurate responses, by augmenting large language models (LLMs) with the external vast and dynamic knowledge. Most previous work focuses on using RAG for single-round…

Artificial Intelligence · Computer Science 2024-03-28 Linhao Ye , Zhikai Lei , Jianghao Yin , Qin Chen , Jie Zhou , Liang He

Recent advancements in Large Language Models (LLMs) have emphasized the critical role of fine-tuning (FT) techniques in adapting LLMs to specific tasks, especially when retraining from scratch is computationally infeasible. Fine-tuning…

Artificial Intelligence · Computer Science 2025-10-23 Xiao Han , Zimo Zhao , Wanyu Wang , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

In addition to the frequency of terms in a document collection, the distribution of terms plays an important role in determining the relevance of documents for a given search query. In this paper, term distribution analysis using Fourier…

Information Retrieval · Computer Science 2009-07-18 Patricio Galeas , Ralph Kretschmer , Bernd Freisleben

Retrieval-Augmented Generation (RAG) enables large language models to provide more precise and pertinent responses by incorporating external knowledge. In the Query-Focused Summarization (QFS) task, GraphRAG-based approaches have notably…

Information Retrieval · Computer Science 2025-04-11 Yubin Hong , Chaofan Li , Jingyi Zhang , Yingxia Shao

Dense retrieval models are typically fine-tuned with contrastive learning objectives that require binary relevance judgments, even though relevance is inherently graded. We analyze how graded relevance scores and the threshold used to…

Information Retrieval · Computer Science 2026-01-09 Tomer Wullach , Ori Shapira , Amir DN Cohen

Most efforts in interpreting neural relevance models have focused on local explanations, which explain the relevance of a document to a query but are not useful in predicting the model's behavior on unseen query-document pairs. We propose a…

Information Retrieval · Computer Science 2024-10-07 Youngwoo Kim , Razieh Rahimi , James Allan

Fine-grained opinion analysis of text provides a detailed understanding of expressed sentiments, including the addressed entity. Although this level of detail is valuable, annotating opinions in datasets for model training requires…

Computation and Language · Computer Science 2026-05-28 Gaurav Negi , MA Waskow , John McCrae , Omnia Zayed , Paul Buitelaar

Humans can learn to solve new tasks by inducing high-level strategies from example solutions to similar problems and then adapting these strategies to solve unseen problems. Can we use large language models to induce such high-level…

Machine Learning · Computer Science 2025-08-27 Weijia Xu , Nebojsa Jojic , Nicolas Le Roux

Large language models (LLMs) are increasingly deployed in information systems, including being used as second-stage rerankers in information retrieval pipelines, yet their susceptibility to recency bias has received little attention. We…

Information Retrieval · Computer Science 2025-09-16 Hanpei Fang , Sijie Tao , Nuo Chen , Kai-Xin Chang , Tetsuya Sakai

To retrieve more relevant, appropriate and useful documents given a query, finding clues about that query through the text is crucial. Recent deep learning models regard the task as a term-level matching problem, which seeks exact or…

Information Retrieval · Computer Science 2021-02-01 Yufeng Zhang , Jinghao Zhang , Zeyu Cui , Shu Wu , Liang Wang

Despite the strong language understanding abilities of large language models (LLMs), they still struggle with reliable question answering (QA) over long, structured documents, particularly for numerical reasoning. Financial annual reports…

Computation and Language · Computer Science 2026-04-07 Yi-Cheng Wang , Wei-An Wang , Chu-Song Chen

To support complex search tasks, where the initial information requirements are complex or may change during the search, a search engine must adapt the information delivery as the user's information requirements evolve. To support this…

Information Retrieval · Computer Science 2021-05-24 Jianghong Zhou , Eugene Agichtein

Unstructured data, especially text, continues to grow rapidly in various domains. In particular, in the financial sphere, there is a wealth of accumulated unstructured financial data, such as the textual disclosure documents that companies…

Computation and Language · Computer Science 2024-04-18 Bolun "Namir" Xia , Vipula D. Rawte , Mohammed J. Zaki , Aparna Gupta

Large Language Models (LLMs) have transformed listwise document reranking by enabling global reasoning over candidate sets, yet single models often struggle to balance fine-grained relevance scoring with holistic cross-document analysis. We…

Computation and Language · Computer Science 2025-08-26 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

We investigate the exploitation of both lexical and neural relevance signals for ad-hoc passage retrieval. Our exploration involves a large-scale training dataset in which dense neural representations of MS-MARCO queries and passages are…

Information Retrieval · Computer Science 2025-10-21 Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto , Salvatore Trani

Large language models with long context windows can answer complex questions directly from full-length academic, technical, and policy documents, but passing entire documents is often costly, slow, and can degrade answer quality while…