English
Related papers

Related papers: A Unified Perturbation Framework for Analyzing Lea…

200 papers

Evaluating alignment in language models requires testing how they behave under realistic pressure, not just what they claim they would do. While alignment failures increasingly cause real-world harm, comprehensive evaluation frameworks with…

Artificial Intelligence · Computer Science 2026-02-25 Nora Petrova , John Burden

As responsible AI gains importance in machine learning algorithms, properties such as fairness, adversarial robustness, and causality have received considerable attention in recent years. However, despite their individual significance,…

Machine Learning · Computer Science 2023-08-21 Ahmad-Reza Ehyaei , Kiarash Mohammadi , Amir-Hossein Karimi , Samira Samadi , Golnoosh Farnadi

Evaluating retrieval-ranking systems is crucial for developing high-performing models. While online A/B testing is the gold standard, its high cost and risks to user experience require effective offline methods. However, relying on…

Information Retrieval · Computer Science 2025-04-08 Seyedeh Baharan Khatami , Sayan Chakraborty , Ruomeng Xu , Babak Salimi

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis of 3,390…

Cryptography and Security · Computer Science 2025-07-30 Atil Samancioglu

Recent tabular Foundational Models (FM) such as TabPFN and TabICL, leverage in-context learning to achieve strong performance without gradient updates or fine-tuning. However, their robustness to adversarial manipulation remains largely…

Machine Learning · Computer Science 2026-04-10 Mohamed Djilani , Thibault Simonetto , Karim Tit , Florian Tambon , Salah Ghamizi , Maxime Cordy , Mike Papadakis

Large language models (LLMs) often present answers with high apparent confidence despite lacking an explicit mechanism for reasoning about certainty or truth. While existing benchmarks primarily evaluate single-turn accuracy, truthfulness…

Computation and Language · Computer Science 2026-03-05 Mohammadreza Saadat , Steve Nemzer

Preference-based data often appear complex and noisy but may conceal underlying homogeneous structures. This paper introduces a novel framework of ranking structure recognition for preference-based data. We first develop an approach to…

Machine Learning · Statistics 2025-11-11 Nan Lu , Jian Shi , Xin-Yu Tian

As large language models (LLMs) are increasingly deployed in high-stakes and operational settings, evaluation strategies based solely on aggregate accuracy are often insucient to characterize system reliability. This study proposes a…

Artificial Intelligence · Computer Science 2026-05-06 Hikmat Karimov , Rahid Zahid Alekberli

The trustworthiness of machine learning has emerged as a critical topic in the field, encompassing various applications and research areas such as robustness, security, interpretability, and fairness. The last decade saw the development of…

Machine Learning · Computer Science 2023-08-01 Haoyang Liu , Maheep Chaudhary , Haohan Wang

Large Language Models (LLMs) are increasingly used to annotate learning interactions, yet concerns about reliability limit their utility. We test whether verification-oriented orchestration-prompting models to check their own labels…

Artificial Intelligence · Computer Science 2026-01-29 Bakhtawar Ahtisham , Kirk Vanacore , Jinsook Lee , Zhuqian Zhou , Doug Pietrzak , Rene F. Kizilcec

Deep neural networks are highly vulnerable to adversarial examples, i.e.,small perturbations that can significantly degrade model performance. While adversarial training has become the primary defense strategy, most studies focus on…

Machine Learning · Computer Science 2026-05-14 Lilin Zhang , Yimo Guo , Yue Li , Jiancheng Shi , Xianggen Liu

Single-prompt accuracy is the dominant way to benchmark language models, but it can miss reliability failures that matter. We evaluate a 15-model open-weight corpus, with the main reliability analyses focused on 10 instruct models across…

Computation and Language · Computer Science 2026-05-05 Ranit Karmakar , Jayita Chatterjee

Most research on fair machine learning has prioritized optimizing criteria such as Demographic Parity and Equalized Odds. Despite these efforts, there remains a limited understanding of how different bias mitigation strategies affect…

Machine Learning · Computer Science 2024-05-24 Natasa Krco , Thibault Laugel , Vincent Grari , Jean-Michel Loubes , Marcin Detyniecki

Large language model (LLM) evaluation platforms increasingly rely on pairwise human judgments. These data are noisy, sparse, and non-uniform, yet leaderboards are reported with limited uncertainty quantification. We study this as…

Methodology · Statistics 2026-04-08 Jiachun Li , David Simchi-Levi , Will Wei Sun

We consider the problem of quantifying how an input perturbation impacts the outputs of large language models (LLMs), a fundamental task for model reliability and post-hoc interpretability. A key obstacle in this domain is disentangling the…

Machine Learning · Computer Science 2024-12-03 Paulius Rauba , Qiyao Wei , Mihaela van der Schaar

Evaluations of large language models (LLMs) suffer from instability, where small changes of random factors such as few-shot examples can lead to drastic fluctuations of scores and even model rankings. Moreover, different LLMs can have…

Machine Learning · Computer Science 2025-09-17 Yiyang Li , Yonghuang Wu , Ying Luo , Liangtai Sun , Zishu Qin , Lin Qiu , Xuezhi Cao , Xunliang Cai

Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data…

This paper addresses the challenges of aligning large language models (LLMs) with human values via preference learning (PL), focusing on incomplete and corrupted data in preference datasets. We propose a novel method for robustly and…

Artificial Intelligence · Computer Science 2025-10-30 Son The Nguyen , Niranjan Uma Naresh , Theja Tulabandhula

While Multimodal Large Language Models (MLLMs) perform strongly on single-turn chart generation, their ability to support real-world exploratory data analysis remains underexplored. In practice, users iteratively refine visualizations…

Computation and Language · Computer Science 2026-02-18 Manav Nitin Kapadnis , Lawanya Baghel , Atharva Naik , Carolyn Rosé

Automatic evaluation methods based on large language models (LLMs) are emerging as the standard tool for assessing the instruction-following abilities of LLM-based agents. The most common method in this paradigm, pairwise comparisons with a…

Artificial Intelligence · Computer Science 2025-06-09 Yi Xu , Laura Ruis , Tim Rocktäschel , Robert Kirk