English

Mallows Model with Learned Distance Metrics: Sampling and Maximum Likelihood Estimation

Machine Learning 2025-07-14 v1 Data Structures and Algorithms Machine Learning Probability Statistics Theory Statistics Theory

Abstract

\textit{Mallows model} is a widely-used probabilistic framework for learning from ranking data, with applications ranging from recommendation systems and voting to aligning language models with human preferences~\cite{chen2024mallows, kleinberg2021algorithmic, rafailov2024direct}. Under this model, observed rankings are noisy perturbations of a central ranking σ\sigma, with likelihood decaying exponentially in distance from σ\sigma, i.e, P(π)exp(βd(π,σ)),P (\pi) \propto \exp\big(-\beta \cdot d(\pi, \sigma)\big), where β>0\beta > 0 controls dispersion and dd is a distance function. Existing methods mainly focus on fixed distances (such as Kendall's τ\tau distance), with no principled approach to learning the distance metric directly from data. In practice, however, rankings naturally vary by context; for instance, in some sports we regularly see long-range swaps (a low-rank team beating a high-rank one), while in others such events are rare. Motivated by this, we propose a generalization of Mallows model that learns the distance metric directly from data. Specifically, we focus on LαL_\alpha distances: dα(π,σ):=i=1π(i)σ(i)αd_\alpha(\pi,\sigma):=\sum_{i=1} |\pi(i)-\sigma(i)|^\alpha. For any α1\alpha\geq 1 and β>0\beta>0, we develop a Fully Polynomial-Time Approximation Scheme (FPTAS) to efficiently generate samples that are ϵ\epsilon- close (in total variation distance) to the true distribution. Even in the special cases of L1L_1 and L2L_2, this generalizes prior results that required vanishing dispersion (β0\beta\to0). Using this sampling algorithm, we propose an efficient Maximum Likelihood Estimation (MLE) algorithm that jointly estimates the central ranking, the dispersion parameter, and the optimal distance metric. We prove strong consistency results for our estimators (for any values of α\alpha and β\beta), and we validate our approach empirically using datasets from sports rankings.

Keywords

Cite

@article{arxiv.2507.08108,
  title  = {Mallows Model with Learned Distance Metrics: Sampling and Maximum Likelihood Estimation},
  author = {Yeganeh Alimohammadi and Kiana Asgari},
  journal= {arXiv preprint arXiv:2507.08108},
  year   = {2025}
}
R2 v1 2026-07-01T03:55:28.641Z