English
Related papers

Related papers: Permutation-Consensus Listwise Judging for Robust …

200 papers

Human relevance assessment is time-consuming and cognitively intensive, limiting the scalability of Information Retrieval evaluation. This has led to growing interest in using large language models (LLMs) as proxies for human judges.…

Information Retrieval · Computer Science 2026-04-28 Chuting Yu , Hang Li , Guido Zuccon , Joel Mackenzie , Teerapong Leelanupab

Large language models (LLMs) are increasingly used as information sources, yet small changes in semantic framing can destabilize their truth judgments. We propose P-StaT (Perturbation Stability of Truth), an evaluation framework for testing…

Computation and Language · Computer Science 2026-01-21 Samantha Dies , Courtney Maynard , Germans Savcisens , Tina Eliassi-Rad

The effective training and evaluation of retrieval systems require a substantial amount of relevance judgments, which are traditionally collected from human assessors -- a process that is both costly and time-consuming. Large Language…

Information Retrieval · Computer Science 2024-12-19 Hossein A. Rahmani , Emine Yilmaz , Nick Craswell , Bhaskar Mitra

Evaluating recommender systems remains a long-standing challenge, as offline methods based on historical user interactions and train-test splits often yield unstable and inconsistent results due to exposure bias, popularity bias, sampled…

Recent advancements in large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, single-shot inference often yields unreliable results for complex reasoning tasks, leading researchers to explore multiple…

Machine Learning · Computer Science 2025-02-14 Zhi Zhou , Tan Yuhao , Zenan Li , Yuan Yao , Lan-Zhe Guo , Xiaoxing Ma , Yu-Feng Li

While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new…

Computation and Language · Computer Science 2023-12-05 Derek Tam , Anisha Mascarenhas , Shiyue Zhang , Sarah Kwan , Mohit Bansal , Colin Raffel

This study focuses on improving the performance of lightweight Large Language Models (LLMs) in mathematical reasoning tasks. We introduce a novel method for measuring mathematical logic similarity and design an automatic screening mechanism…

Computation and Language · Computer Science 2024-09-04 Ding Kai , Ma Zhenguo , Yan Xiaoran

In psycholinguistics, the creation of controlled materials is crucial to ensure that research outcomes are solely attributed to the intended manipulations and not influenced by extraneous factors. To achieve this, psycholinguists typically…

Computation and Language · Computer Science 2024-02-09 Samuel Joseph Amouyal , Aya Meltzer-Asscher , Jonathan Berant

Large Language Models tend to struggle when dealing with specialized domains. While all aspects of evaluation hold importance, factuality is the most critical one. Similarly, reliable fact-checking tools and data sources are essential for…

Computation and Language · Computer Science 2025-09-03 Anum Afzal , Juraj Vladika , Florian Matthes

Large language models (LLMs) are stochastic, and not all models give deterministic answers, even when setting temperature to zero with a fixed random seed. However, few benchmark studies attempt to quantify uncertainty, partly due to the…

Computation and Language · Computer Science 2025-06-30 Robert E. Blackwell , Jon Barry , Anthony G. Cohn

Faithfulness evaluators based on large language models (LLMs) are often fooled by the fluency of the text and struggle with identifying errors in the summaries. We propose an approach to summary faithfulness evaluation in which multiple…

This study examines the use of Large Language Models (LLMs) for retrieving factual information, addressing concerns over their propensity to produce factually incorrect "hallucinated" responses or to altogether decline to even answer prompt…

Computation and Language · Computer Science 2024-03-15 Lauren Rhue , Sofie Goethals , Arun Sundararajan

This paper investigates the rational thinking capability of Large Language Models (LLMs) in multi-round argumentative debates by exploring the impact of fallacious arguments on their logical reasoning performance. More specifically, we…

Computation and Language · Computer Science 2025-01-03 Amirreza Payandeh , Dan Pluth , Jordan Hosier , Xuesu Xiao , Vijay K. Gurbani

Pretrained language models (LMs) are susceptible to generate text with nonfactual information. In this work, we measure and improve the factual accuracy of large-scale LMs for open-ended text generation. We design the FactualityPrompts test…

Computation and Language · Computer Science 2023-03-03 Nayeon Lee , Wei Ping , Peng Xu , Mostofa Patwary , Pascale Fung , Mohammad Shoeybi , Bryan Catanzaro

Large Language Models (LLMs) have demonstrated exceptional capabilities across diverse tasks, driving the development and widespread adoption of LLM-as-a-Judge systems for automated evaluation, including red teaming and benchmarking.…

Cryptography and Security · Computer Science 2025-11-18 Songze Li , Chuokun Xu , Jiaying Wang , Xueluan Gong , Chen Chen , Jirui Zhang , Jun Wang , Kwok-Yan Lam , Shouling Ji

Large Language Models (LLMs) are increasingly embedded in evaluative processes, from information filtering to assessing and addressing knowledge gaps through explanation and credibility judgments. This raises the need to examine how such…

Autoregressive Large Language Models (LLMs) trained for next-word prediction have demonstrated remarkable proficiency at producing coherent text. But are they equally adept at forming coherent probability judgments? We use probabilistic…

Computation and Language · Computer Science 2025-05-07 Jian-Qiao Zhu , Thomas L. Griffiths

This work presents a content-based recommender system for machine learning classifier algorithms. Given a new data set, a recommendation of what classifier is likely to perform best is made based on classifier performance over similar known…

Information Retrieval · Computer Science 2017-11-28 Marta Arias , Argimiro Arratia , Ariel Duarte-Lopez

Given the challenge of automatically evaluating free-form outputs from large language models (LLMs), an increasingly common solution is to use LLMs themselves as the judging mechanism, without any gold-standard scores. Implicitly, this…

Machine Learning · Computer Science 2026-04-07 Patrick Vossler , Fan Xia , Yifan Mai , Adarsh Subbaswamy , Jean Feng

LLM-as-a-Judge, which generates chain-of-thought (CoT) judgments, has become a widely adopted auto-evaluation method. However, its reliability is compromised by the CoT reasoning's inability to capture comprehensive and deeper details,…

Computation and Language · Computer Science 2025-04-08 Qiyuan Zhang , Yufei Wang , Yuxin Jiang , Liangyou Li , Chuhan Wu , Yasheng Wang , Xin Jiang , Lifeng Shang , Ruiming Tang , Fuyuan Lyu , Chen Ma