English
Related papers

Related papers: RUMBoost: Gradient Boosted Random Utility Models

200 papers

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

Probit unfolding models (PUMs) are a novel class of scaling models that allow for items with both monotonic and non-monotonic response functions and have shown great promise in the estimation of preferences from voting data in various…

Computation · Statistics 2025-04-02 Skylar Shi , Abel Rodriguez , Rayleigh Lei

We propose a soft gradient boosting framework for sequential regression that embeds a learnable linear feature transform within the boosting procedure. At each boosting iteration, we train a soft decision tree and learn a linear input…

Machine Learning · Computer Science 2025-09-17 Huseyin Karaca , Suleyman Serdar Kozat

This paper studies the Random Utility Model (RUM) in a repeated stochastic choice situation, in which the decision maker is imperfectly informed about the payoffs of each available alternative. We develop a gradient-based learning algorithm…

Theoretical Economics · Economics 2022-08-16 Emerson Melo

The Random Utility Model (RUM) is the leading model to represent the aggregate choices of a heterogeneous population of preference maximizers. We show that if (and only if) preferences are sufficiently uncorrelated, RUM choices can also be…

Theoretical Economics · Economics 2025-05-29 Daniele Caliari , Henrik Petri

Forecasting product demand in retail supply chains presents a complex challenge due to noisy, heterogeneous features and rapidly shifting consumer behavior. While traditional gradient boosting decision trees (GBDT) offer strong predictive…

Machine Learning · Computer Science 2026-03-06 Yadi Liu , Xiaoli Ma , Muxin Ge , Zeyu Han , Jingxi Qiu , Ye Aung Moe , Yilan Shen , Wenbin Wei , Cheng Huang

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

Machine Learning · Computer Science 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko

We explore the influence of framing on decision-making, where some products are framed (e.g., displayed, recommended, endorsed, or labeled). We introduce a novel choice function that captures observed variations in framed alternatives.…

Theoretical Economics · Economics 2025-02-04 Paul H. Y. Cheung , Yusufcan Masatlioglu

This paper discusses {General Random Utility Models (GRUMs)}. These are a class of parametric models that generate partial ranks over alternatives given attributes of agents and alternatives. We propose two preference elicitation scheme for…

Artificial Intelligence · Computer Science 2013-09-27 Hossein Azari Soufiani , David C. Parkes , Lirong Xia

Gradient boosted trees and other regression tree models perform well in a wide range of real-world, industrial applications. These tree models (i) offer insight into important prediction features, (ii) effectively manage sparse data, and…

Machine Learning · Statistics 2021-05-19 Alexander Thebelt , Jan Kronqvist , Miten Mistry , Robert M. Lee , Nathan Sudermann-Merx , Ruth Misener

Data quality or data evaluation is sometimes a task as important as collecting a large volume of data when it comes to generating accurate artificial intelligence models. In fact, being able to evaluate the data can lead to a larger…

Machine Learning · Computer Science 2023-05-24 Eloy Anguiano Batanero , Ángela Fernández Pascual , Álvaro Barbero Jiménez

As data collections become larger, exploratory regression analysis becomes more important but more challenging. When observations are hierarchically clustered the problem is even more challenging because model selection with mixed effect…

Machine Learning · Statistics 2017-02-15 Patrick J. Miller , Daniel B. McArtor , Gitta H. Lubke

This paper introduces the distributionally robust random utility model (DRO-RUM), which allows the preference shock (unobserved heterogeneity) distribution to be misspecified or unknown. We make three contributions using tools from the…

Theoretical Economics · Economics 2023-03-13 David Müller , Emerson Melo , Ruben Schlotter

We study a dynamic generalization of stochastic rationality in consumer behavior, the Dynamic Random Utility Model (DRUM). Under DRUM, a consumer draws a utility function from a stochastic utility process and maximizes this utility subject…

Theoretical Economics · Economics 2022-04-18 Nail Kashaev , Victor H. Aguiar

We study random utility (RU) rationality with aggregation when the underlying alternatives in each aggregate vary across consumers and are unobserved, as is typical for an outside option. RUM over the underlying alternatives is the natural…

Theoretical Economics · Economics 2026-03-10 Yuexin Liao , Kota Saito , Alec Sandroni

Random Utility Models (RUMs), which subsume Plackett-Luce model (PL) as a special case, are among the most popular models for preference learning. In this paper, we consider RUMs with features and their mixtures, where each alternative has…

Machine Learning · Computer Science 2022-05-04 Zhibing Zhao , Ao Liu , Lirong Xia

In many smart infrastructure applications flexibility in achieving sustainability goals can be gained by engaging end-users. However, these users often have heterogeneous preferences that are unknown to the decision-maker tasked with…

Computer Science and Game Theory · Computer Science 2017-04-27 Ioannis C. Konstantakopoulos , Lillian J. Ratliff , Ming Jin , S. Shankar Sastry , Costas Spanos

Large Language Models (LLMs) deliver strong performance but incur high inference cost in real-world services, especially under workloads with repeated or near-duplicate queries across users and sessions. In this work, we propose MemBoost, a…

Computation and Language · Computer Science 2026-03-30 Joris Köster , Zixuan Liu , Siavash Khajavi , Zizhan Zheng

Gradient boosting methods based on Structured Categorical Decision Trees (SCDT) have been demonstrated to outperform numerical and one-hot-encodings on problems where the categorical variable has a known underlying structure. However, the…

Machine Learning · Statistics 2020-07-10 Brian Lucena

Gradient boosting for decision tree algorithms are increasingly used in actuarial applications as they show superior predictive performance over traditional generalised linear models. Many enhancements to the first gradient boosting machine…

Machine Learning · Statistics 2025-08-05 Dominik Chevalier , Marie-Pier Côté