English
Related papers

Related papers: Multi-Conditional Ranking with Large Language Mode…

200 papers

We introduce DecompSR, decomposed spatial reasoning, a large benchmark dataset (over 5m datapoints) and generation framework designed to analyse compositional spatial reasoning ability. The generation of DecompSR allows users to…

Artificial Intelligence · Computer Science 2026-04-15 Lachlan McPheat , Navdeep Kaur , Robert Blackwell , Alessandra Russo , Anthony G. Cohn , Pranava Madhyastha

Information retrieval (IR) systems have played a vital role in modern digital life and have cemented their continued usefulness in this new era of generative AI via retrieval-augmented generation. With strong language processing…

Computation and Language · Computer Science 2025-03-04 Shijie Chen , Bernal Jiménez Gutiérrez , Yu Su

When evaluating Large Language Models (LLMs) in question answering domains, it is common to ask the model to choose among a fixed set of choices (so-called multiple-choice question-answering, or MCQA). Although downstream tasks of interest…

Computation and Language · Computer Science 2025-10-03 Narun Raman , Taylor Lundy , Kevin Leyton-Brown

Recommender systems are crucial for personalizing user experiences but often depend on implicit feedback data, which can be noisy and misleading. Existing denoising studies involve incorporating auxiliary information or learning strategies…

Information Retrieval · Computer Science 2025-02-14 Shuyao Wang , Zhi Zheng , Yongduo Sui , Hui Xiong

Multimodal Large Language Models (MLLMs) have recently emerged as general architectures capable of reasoning over diverse modalities. Benchmarks for MLLMs should measure their ability for cross-modal integration. However, current benchmarks…

Computation and Language · Computer Science 2026-03-04 Shunki Uebayashi , Kento Masui , Kyohei Atarashi , Han Bao , Hisashi Kashima , Naoto Inoue , Mayu Otani , Koh Takeuchi

With the emergence of large language models (LLMs) and their ability to perform a variety of tasks, their application in recommender systems (RecSys) has shown promise. However, we are facing significant challenges when deploying LLMs into…

Information Retrieval · Computer Science 2025-02-21 Yueqing Liang , Liangwei Yang , Chen Wang , Xiongxiao Xu , Philip S. Yu , Kai Shu

Recent advances in large language models (LLMs) have revolutionized the landscape of reasoning tasks. To enhance the capabilities of LLMs to emulate human reasoning, prior studies have focused on modeling reasoning steps using various…

Artificial Intelligence · Computer Science 2024-05-28 Hongda Sun , Weikai Xu , Wei Liu , Jian Luan , Bin Wang , Shuo Shang , Ji-Rong Wen , Rui Yan

The same real-life questions posed to different individuals may lead to different answers based on their unique situations. For instance, whether a student is eligible for a scholarship depends on eligibility conditions, such as major or…

Computation and Language · Computer Science 2024-06-18 Peter Baile Chen , Yi Zhang , Chunwei Liu , Sejal Gupta , Yoon Kim , Michael Cafarella

The powerful reasoning and generative capabilities of large language models (LLMs) have inspired researchers to apply them to reasoning-based recommendation tasks, which require in-depth reasoning about user interests and the generation of…

Information Retrieval · Computer Science 2025-11-25 Shihao Cai , Chongming Gao , Haoyan Liu , Wentao Shi , Jianshan Sun , Ruiming Tang , Fuli Feng

Large language models (LLMs) have recently shown remarkable performance in language tasks and beyond. However, due to their limited inherent causal reasoning ability, LLMs still face challenges in handling tasks that require robust causal…

Computation and Language · Computer Science 2025-03-13 Xin Li , Zhuo Cai , Shoujin Wang , Kun Yu , Fang Chen

Reranking algorithms have made progress in improving document retrieval quality by efficiently aggregating relevance judgments generated by large language models (LLMs). However, identifying relevant documents for queries that require…

Information Retrieval · Computer Science 2025-11-04 Jerry Huang , Siddarth Madala , Cheng Niu , Julia Hockenmaier , Tong Zhang

The rapid development of multimodal large language models (MLLMs) has brought significant improvements to a wide range of tasks in real-world applications. However, LLMs still exhibit certain limitations in extracting implicit semantic…

Computation and Language · Computer Science 2025-01-03 Hebin Wang , Yangning Li , Yinghui Li , Hai-Tao Zheng , Wenhao Jiang , Hong-Gee Kim

Evaluation and ranking of large language models (LLMs) has become an important problem with the proliferation of these models and their impact. Evaluation methods either require human responses which are expensive to acquire or use pairs of…

Computation and Language · Computer Science 2024-06-11 Amit Dhurandhar , Rahul Nair , Moninder Singh , Elizabeth Daly , Karthikeyan Natesan Ramamurthy

Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resembles human language for various tasks. This opens up new…

Information Retrieval · Computer Science 2024-06-05 Jianghao Lin , Xinyi Dai , Rong Shan , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over…

Information Retrieval · Computer Science 2024-09-20 Junyi Chen , Lu Chi , Bingyue Peng , Zehuan Yuan

Despite demonstrating emergent reasoning abilities, Large Language Models (LLMS) often lose track of complex, multi-step reasoning. Existing studies show that providing guidance via decomposing the original question into multiple…

Computation and Language · Computer Science 2024-04-04 Gurusha Juneja , Subhabrata Dutta , Tanmoy Chakraborty

The rapid increase in textual information means we need more efficient methods to sift through, organize, and understand it all. While retrieval-augmented generation (RAG) models excel in accessing information from large document…

Computation and Language · Computer Science 2025-03-14 Seiji Maekawa , Hayate Iso , Nikita Bhutani

As a critical task for large-scale commercial recommender systems, reranking has shown the potential of improving recommendation results by uncovering mutual influence among items. Reranking rearranges items in the initial ranking lists…

Information Retrieval · Computer Science 2022-02-15 Yunjia Xi , Weiwen Liu , Xinyi Dai , Ruiming Tang , Weinan Zhang , Qing Liu , Xiuqiang He , Yong Yu

Multi-Criteria Decision Making~(MCDM) is widely applied in various fields, using quantitative and qualitative analyses of multiple levels and attributes to support decision makers in making scientific and rational decisions in complex…

Artificial Intelligence · Computer Science 2025-02-25 Hui Wang , Fafa Zhang , Chaoxu Mu

Although large language models (LLMs) have demonstrated their strong intelligence ability, the high demand for computation and storage hinders their practical application. To this end, many model compression techniques are proposed to…

Computation and Language · Computer Science 2024-11-01 Ge Yang , Changyi He , Jinyang Guo , Jianyu Wu , Yifu Ding , Aishan Liu , Haotong Qin , Pengliang Ji , Xianglong Liu