English
Related papers

Related papers: RankSteer: Activation Steering for Pointwise LLM R…

200 papers

We propose a novel framework that leverages large language models (LLMs) to guide the rank selection in tensor network models for higher-order data analysis. By utilising the intrinsic reasoning capabilities and domain knowledge of LLMs,…

Machine Learning · Computer Science 2024-10-15 Giorgos Iacovides , Wuyang Zhou , Danilo Mandic

Recent advances in Large Language Models (LLMs) - particularly model scaling and test-time techniques - have greatly enhanced the reasoning capabilities of language models at the expense of higher inference costs. To lower inference costs,…

Computation and Language · Computer Science 2025-11-21 Sangmook Lee , Dohyung Kim , Hyukhun Koh , Nakyeong Yang , Kyomin Jung

Deploying LLMs in real-world applications requires controllable output that satisfies multiple desiderata at the same time. While existing work extensively addresses LLM steering for a single behavior, \textit{compositional steering} --…

Computation and Language · Computer Science 2026-04-21 Gorjan Radevski , Kiril Gashteovski , Giwon Hong , Carolin Lawrence , Goran Glavaš

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

As large language models (LLMs) become more integrated into societal systems, the risk of them perpetuating and amplifying harmful biases becomes a critical safety concern. Traditional methods for mitigating bias often rely on data…

Artificial Intelligence · Computer Science 2025-08-13 Shivam Dubey

Large Language Models (LLMs) have demonstrated exceptional performance in the task of text ranking for information retrieval. While Pointwise ranking approaches offer computational efficiency by scoring documents independently, they often…

Information Retrieval · Computer Science 2025-12-03 Jieran Li , Xiuyuan Hu , Yang Zhao , Shengyao Zhuang , Hao Zhang

Large Language Model (LLM) based listwise ranking has shown superior performance in many passage ranking tasks. With the development of Large Reasoning Models (LRMs), many studies have demonstrated that step-by-step reasoning during…

Information Retrieval · Computer Science 2026-04-23 Wenhan Liu , Xinyu Ma , Weiwei Sun , Yutao Zhu , Yuchen Li , Dawei Yin , Zhicheng Dou

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles.…

Computation and Language · Computer Science 2025-04-30 Enfa Fane , Mihai Surdeanu , Eduardo Blanco , Steven R. Corman

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

Large Language Models (LLMs) are widely used by software engineers for programming tasks. However, research shows that LLMs often lack a deep understanding of program semantics. Even minor changes to syntax, such as renaming variables, can…

Computation and Language · Computer Science 2025-10-06 Francesca Lucchetti , Arjun Guha

Recent studies show that large language models (LLMs) can be instructed to effectively perform zero-shot passage re-ranking, in which the results of a first stage retrieval method, such as BM25, are rated and reordered to improve relevance.…

Information Retrieval · Computer Science 2023-10-24 Andrew Drozdov , Honglei Zhuang , Zhuyun Dai , Zhen Qin , Razieh Rahimi , Xuanhui Wang , Dana Alon , Mohit Iyyer , Andrew McCallum , Donald Metzler , Kai Hui

Recent work in zero-shot listwise reranking using LLMs has achieved state-of-the-art results. However, these methods are not without drawbacks. The proposed methods rely on large LLMs with billions of parameters and limited context sizes.…

Information Retrieval · Computer Science 2023-12-27 Manveer Singh Tamber , Ronak Pradeep , Jimmy Lin

Large Language Models (LLMs), while demonstrating remarkable capabilities across various applications, present significant challenges during inference due to their substantial model size, especially when deployed on edge devices. Activation…

Machine Learning · Computer Science 2025-04-29 Zhenyu Zhang , Zechun Liu , Yuandong Tian , Harshit Khaitan , Zhangyang Wang , Steven Li

Recent studies have shown that large language models (LLMs) can assess relevance and support information retrieval (IR) tasks such as document ranking and relevance judgment generation. However, the internal mechanisms by which…

Information Retrieval · Computer Science 2025-04-11 Qi Liu , Jiaxin Mao , Ji-Rong Wen

Zero-shot document re-ranking with Large Language Models (LLMs) has evolved from Pointwise methods to Listwise and Setwise approaches that optimize computational efficiency. Despite their success, these methods predominantly rely on…

Information Retrieval · Computer Science 2026-04-28 Haodong Chen , Shengyao Zhuang , Zheng Yao , Guido Zuccon , Teerapong Leelanupab

Activation steering, or representation engineering, offers a lightweight approach to align large language models (LLMs) by manipulating their internal activations at inference time. However, current methods suffer from two key limitations:…

Artificial Intelligence · Computer Science 2026-02-24 Hongjue Zhao , Haosen Sun , Jiangtao Kong , Xiaochang Li , Qineng Wang , Liwei Jiang , Qi Zhu , Tarek Abdelzaher , Yejin Choi , Manling Li , Huajie Shao

Steering vectors have emerged as a lightweight and effective approach for aligning large language models (LLMs) at inference time, enabling modulation over model behaviors by shifting LLM representations towards a target behavior. However,…

Machine Learning · Computer Science 2026-04-07 Soham Gadgil , Chris Lin , Su-In Lee

Modern large language models (LLMs) exhibit a remarkable capacity for role-playing, enabling them to embody not only human characters but also non-human entities. This versatility allows them to simulate complex human-like interactions and…

Computation and Language · Computer Science 2024-03-15 Aobo Kong , Shiwan Zhao , Hao Chen , Qicheng Li , Yong Qin , Ruiqi Sun , Xin Zhou , Enzhi Wang , Xiaohang Dong

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

Information Retrieval · Computer Science 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

Talent recruitment is a critical, yet costly process for many industries, with high recruitment costs and long hiring cycles. Existing talent recommendation systems increasingly adopt large language models (LLMs) due to their remarkable…

Computation and Language · Computer Science 2026-04-03 Silin Du , Hongyan Liu