English
Related papers

Related papers: Navigating the Rashomon Effect: How Personalizatio…

200 papers

Personalized prediction is a machine learning approach that predicts a person's future observations based on their past labeled observations and is typically used for sequential tasks, e.g., to predict daily mood ratings. When making…

Algorithmic risk assessments are used to inform decisions in a wide variety of high-stakes settings. Often multiple predictive models deliver similar overall performance but differ markedly in their predictions for individual cases, an…

Machine Learning · Computer Science 2021-05-04 Amanda Coston , Ashesh Rambachan , Alexandra Chouldechova

Explainable AI (XAI) is essential for validating and trusting models in safety-critical applications like autonomous driving. However, the reliability of XAI is challenged by the Rashomon effect, where multiple, equally accurate models can…

Machine Learning · Computer Science 2025-09-04 Helge Spieker , Jørn Eirik Betten , Arnaud Gotlieb , Nadjib Lazaar , Nassim Belmecheri

The existence of multiple, equally accurate models for a given predictive task leads to predictive multiplicity, where a ``Rashomon set'' of models achieve similar accuracy but diverges in their individual predictions. This inconsistency…

Machine Learning · Computer Science 2026-05-19 Parian Haghighat , Hadis Anahideh , Cynthia Rudin

There is increased interest in assisting non-expert audiences to effectively interact with machine learning (ML) tools and understand the complex output such systems produce. Here, we describe user experiments designed to study how…

Computers and Society · Computer Science 2020-09-16 Lydia P. Gleaves , Reva Schwartz , David A. Broniatowski

Large language model (LLM)-powered assistants have recently integrated memory mechanisms that record user preferences, leading to more personalized and user-aligned responses. However, irrelevant personalized memories are often introduced…

Computation and Language · Computer Science 2026-01-26 Xueyang Feng , Weinan Gan , Xu Chen , Quanyu Dai , Yong Liu

AIVisor, an agentic retrieval-augmented LLM for student advising, was used to examine how personalization affects system performance across multiple evaluation dimensions. Using twelve authentic advising questions intentionally designed to…

Information Retrieval · Computer Science 2026-05-19 Satyajit Movidi , Stephen Russell

In real applications, interaction between machine learning models and domain experts is critical; however, the classical machine learning paradigm that usually produces only a single model does not facilitate such interaction. Approximating…

Machine Learning · Computer Science 2023-11-20 Chudi Zhong , Zhi Chen , Jiachang Liu , Margo Seltzer , Cynthia Rudin

Personalisation of products and services is fast becoming the driver of success in banking and commerce. Machine learning holds the promise of gaining a deeper understanding of and tailoring to customers' needs and preferences. Whereas…

Machine Learning · Computer Science 2022-06-30 Charl Maree , Christian Omlin

We present an LLM-driven multi-agent probabilistic modeling framework that demonstrates how differences in students' subjective social perceptions arise and evolve in real-world classroom settings, under constraints from an observed social…

Artificial Intelligence · Computer Science 2026-03-24 Jinming Yang , Xinyu Jiang , Xinshan Jiao , Xinping Zhang

In this paper, we present a general specification for Functional Effects Models, which use Machine Learning (ML) methodologies to learn individual-specific preference parameters from socio-demographic characteristics, therefore accounting…

Machine Learning · Statistics 2025-09-23 Nicolas Salvadé , Tim Hillel

Machine learning is permeating every conceivable domain to promote data-driven decision support. The focus is often on advanced black-box models due to their assumed performance advantages, whereas interpretable models are often associated…

Machine Learning · Computer Science 2024-09-24 Sven Kruschel , Nico Hambauer , Sven Weinzierl , Sandra Zilker , Mathias Kraus , Patrick Zschech

Predictive models may generate biased predictions when classifying imbalanced datasets. This happens when the model favors the majority class, leading to low performance in accurately predicting the minority class. To address this issue,…

Machine Learning · Computer Science 2026-05-18 Mustafa Cavus , Przemysław Biecek

The usual goal of supervised learning is to find the best model, the one that optimizes a particular performance measure. However, what if the explanation provided by this model is completely different from another model and different again…

Machine Learning · Statistics 2024-09-11 Przemyslaw Biecek , Hubert Baniecki , Mateusz Krzyzinski , Dianne Cook

Alignment of Large Language Models (LLMs) aims to align outputs with human preferences, and personalized alignment further adapts models to individual users. This relies on personalized reward models that capture user-specific preferences…

Computation and Language · Computer Science 2026-04-21 Hongru Cai , Yongqi Li , Tiezheng Yu , Fengbin Zhu , Wenjie Wang , Fuli Feng , Wenjie Li

Accurately predicting the performance of different optimization algorithms for previously unseen problem instances is crucial for high-performing algorithm selection and configuration techniques. In the context of numerical optimization,…

Neural and Evolutionary Computing · Computer Science 2021-04-23 Tome Eftimov , Anja Jankovic , Gorjan Popovski , Carola Doerr , Peter Korošec

Machine learning (ML) models can make decisions based on large amounts of data, but they can be missing personal knowledge available to human users about whom predictions are made. For example, a model trained to predict psychiatric…

Machine Learning · Computer Science 2024-06-14 Isaac Lage , Sonali Parbhoo , Finale Doshi-Velez

The Rashomon set captures the collection of models that achieve near-identical empirical performance yet may differ substantially in their decision boundaries. Understanding the differences among these models, i.e., their multiplicity, is…

Machine Learning · Computer Science 2026-05-12 Xenia Heilmann , Luca Corbucci , Mattia Cerrato

Interpretability of learning-to-rank models is a crucial yet relatively under-examined research area. Recent progress on interpretable ranking models largely focuses on generating post-hoc explanations for existing black-box ranking models,…

Through extensive experience developing and explaining machine learning (ML) applications for real-world domains, we have learned that ML models are only as interpretable as their features. Even simple, highly interpretable model types such…

Machine Learning · Computer Science 2022-02-25 Alexandra Zytek , Ignacio Arnaldo , Dongyu Liu , Laure Berti-Equille , Kalyan Veeramachaneni