English
Related papers

Related papers: Large Language Models for Relevance Judgment in Pr…

200 papers

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

Information Retrieval · Computer Science 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

Retrieval-augmented generation (RAG) is considered to be a promising approach to alleviate the hallucination issue of large language models (LLMs), and it has received widespread attention from researchers recently. Due to the limitation in…

Information Retrieval · Computer Science 2024-06-11 Hengran Zhang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of Large Language…

Computation and Language · Computer Science 2024-05-08 Daniele Grandi , Yash Patawari Jain , Allin Groom , Brandon Cramer , Christopher McComb

Large Language Models (LLMs) have been revolutionizing a myriad of natural language processing tasks with their diverse zero-shot capabilities. Indeed, existing work has shown that LLMs can be used to great effect for many tasks, such as…

Computation and Language · Computer Science 2024-06-28 Baharan Nouriinanloo , Maxime Lamothe

In the field of information retrieval, Query Likelihood Models (QLMs) rank documents based on the probability of generating the query given the content of a document. Recently, advanced large language models (LLMs) have emerged as effective…

Information Retrieval · Computer Science 2023-10-23 Shengyao Zhuang , Bing Liu , Bevan Koopman , Guido Zuccon

Consumers often heavily rely on online product reviews, analyzing both quantitative ratings and textual descriptions to assess product quality. However, existing research hasn't adequately addressed how to systematically encourage the…

Information Retrieval · Computer Science 2025-04-22 Ekta Gujral , Apurva Sinha , Lishi Ji , Bijayani Sanghamitra Mishra

Large language models (LLMs) have recently been used as backbones for recommender systems. However, their performance often lags behind conventional methods in standard tasks like retrieval. We attribute this to a mismatch between LLMs'…

Information Retrieval · Computer Science 2024-04-02 Yuwei Cao , Nikhil Mehta , Xinyang Yi , Raghunandan Keshavan , Lukasz Heldt , Lichan Hong , Ed H. Chi , Maheswaran Sathiamoorthy

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

Personalized product search (PPS) aims to retrieve products relevant to the given query considering user preferences within their purchase histories. Since large language models (LLM) exhibit impressive potential in content understanding…

Multimedia · Computer Science 2025-09-24 Beibei Zhang , Yanan Lu , Ruobing Xie , Zongyi Li , Siyuan Xing , Tongwei Ren , Fen Lin

Assessing the quality of scientific research is essential for scholarly communication, yet widely used approaches face limitations in scalability, subjectivity, and time delay. Recent advances in large language models (LLMs) offer new…

Information Retrieval · Computer Science 2026-04-21 Mengjia Wu , Yi Zhang , Robin Haunschild , Lutz Bornmann

AI-powered recruitment tools are increasingly adopted in personnel selection, yet they struggle to capture the requisition (req)-specific personal competencies (PCs) that distinguish successful candidates beyond job categories. We propose a…

Computation and Language · Computer Science 2026-04-02 Wanxin Li , Denver McNeney , Nivedita Prabhu , Charlene Zhang , Renee Barr , Matthew Kitching , Khanh Dao Duc , Anthony S. Boyce

Topic modeling has become a crucial method for analyzing text data, particularly for extracting meaningful insights from large collections of documents. However, the output of these models typically consists of lists of keywords that…

Information Retrieval · Computer Science 2025-02-27 Trishia Khandelwal

Large language models (LLMs), with advanced linguistic capabilities, have been employed in reranking tasks through a sequence-to-sequence approach. In this paradigm, multiple passages are reranked in a listwise manner and a textual reranked…

Information Retrieval · Computer Science 2024-11-08 Ruiyang Ren , Yuhao Wang , Kun Zhou , Wayne Xin Zhao , Wenjie Wang , Jing Liu , Ji-Rong Wen , Tat-Seng Chua

Accurate estimates of item difficulty are essential for valid assessment and effective adaptive learning. However, for newly created tasks, response data are typically unavailable. Pretesting and expert judgement can be costly and slow,…

Large language models (LLMs) are increasingly used as automated judges to evaluate recommendation systems, search engines, and other subjective tasks, where relying on human evaluators can be costly, time-consuming, and unscalable. LLMs…

Computation and Language · Computer Science 2025-02-10 Gerrit J. J. van den Burg , Gen Suzuki , Wei Liu , Murat Sensoy

The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements:…

Computation and Language · Computer Science 2024-03-18 Guanghua Li , Wensheng Lu , Wei Zhang , Defu Lian , Kezhong Lu , Rui Mao , Kai Shu , Hao Liao

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

Methodology · Statistics 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

Topic relevance between query and document is a very important part of social search, which can evaluate the degree of matching between document and user's requirement. In most social search scenarios such as Dianping, modeling search…

Information Retrieval · Computer Science 2025-12-11 Yizhu Liu , Ran Tao , Shengyu Guo , Yifan Yang

Query rewriting plays a vital role in enhancing conversational search by transforming context-dependent user queries into standalone forms. Existing approaches primarily leverage human-rewritten queries as labels to train query rewriting…

Human-Computer Interaction · Computer Science 2023-10-19 Fanghua Ye , Meng Fang , Shenghui Li , Emine Yilmaz