English
Related papers

Related papers: An Optimization Approach to Learning Falling Rule …

200 papers

Purpose: In recent years Monte-Carlo sampling methods, such as Monte Carlo tree search, have achieved tremendous success in model free reinforcement learning. A combination of the so called upper confidence bounds policy to preserve the…

Artificial Intelligence · Computer Science 2011-10-24 Boris Mitavskiy , Jonathan Rowe , Chris Cannings

An increasingly important building block of large scale machine learning systems is based on returning slates; an ordered lists of items given a query. Applications of this technology include: search, information retrieval and recommender…

Machine Learning · Computer Science 2024-01-01 Otmane Sakhi , David Rohde , Nicolas Chopin

In the face of uncertainty, the need for probabilistic assessments has long been recognized in the literature on forecasting. In classification, however, comparative evaluation of classifiers often focuses on predictions specifying a single…

Methodology · Statistics 2023-05-31 Johannes Resin

The problem of ranking/ordering instances, instead of simply classifying them, has recently gained much attention in machine learning. In this paper we formulate the ranking problem in a rigorous statistical framework. The goal is to learn…

Statistics Theory · Mathematics 2016-08-16 Stéphan Clémençon , Gábor Lugosi , Nicolas Vayatis

This study proposed an exhaustive stable/reproducible rule-mining algorithm combined to a classifier to generate both accurate and interpretable models. Our method first extracts rules (i.e., a conjunction of conditions about the values of…

Machine Learning · Computer Science 2017-07-03 Margaux Luck , Nicolas Pallet , Cecilia Damon

Ranking problems, also known as preference learning problems, define a widely spread class of statistical learning problems with many applications, including fraud detection, document ranking, medicine, credit risk screening, image ranking…

Machine Learning · Computer Science 2020-12-17 Tino Werner

State-of-the-art results in typical classification tasks are mostly achieved by unexplainable machine learning methods, like deep neural networks, for instance. Contrarily, in this paper, we investigate the application of rule learning…

Machine Learning · Computer Science 2024-03-11 Albert Nössig , Tobias Hell , Georg Moser

Bayesian optimization is a popular framework for efficiently tackling black-box search problems. As a rule, these algorithms operate by iteratively choosing what to evaluate next until some predefined budget has been exhausted. We…

Machine Learning · Statistics 2024-12-12 James T. Wilson

Algorithms with (machine-learned) predictions is a powerful framework for combining traditional worst-case algorithms with modern machine learning. However, the vast majority of work in this space assumes that the prediction itself is…

Machine Learning · Computer Science 2024-11-26 Michael Dinitz , Sungjin Im , Thomas Lavastida , Benjamin Moseley , Aidin Niaparast , Sergei Vassilvitskii

We consider a simple approach to solving assortment optimization under the random utility maximization model. The approach uses Monte-Carlo simulation to construct a ranking-based choice model that serves as a proxy for the true choice…

Optimization and Control · Mathematics 2025-10-02 Hassaan Khalid , Bradley Sturt

This paper describes an efficient reduction of the learning problem of ranking to binary classification. The reduction guarantees an average pairwise misranking regret of at most that of the binary classifier regret, improving a recent…

Machine Learning · Computer Science 2007-12-07 Nir Ailon , Mehryar Mohri

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

An alphabetic binary tree formulation applies to problems in which an outcome needs to be determined via alphabetically ordered search prior to the termination of some window of opportunity. Rather than finding a decision tree minimizing…

Information Theory · Computer Science 2009-03-28 Michael B. Baer

We study a novel spline-like basis, which we name the "falling factorial basis", bearing many similarities to the classic truncated power basis. The advantage of the falling factorial basis is that it enables rapid, linear-time computations…

Machine Learning · Statistics 2014-10-29 Yu-Xiang Wang , Alex Smola , Ryan J. Tibshirani

Decision tree learning is a widely used approach in machine learning, favoured in applications that require concise and interpretable models. Heuristic methods are traditionally used to quickly produce models with reasonably high accuracy.…

Replicability is a fundamental challenge in reinforcement learning (RL), as RL algorithms are empirically observed to be unstable and sensitive to variations in training conditions. To formally address this issue, we study \emph{list…

Machine Learning · Computer Science 2025-12-02 Bohan Zhang , Michael Chen , A. Pavan , N. V. Vinodchandran , Lin F. Yang , Ruosong Wang

Rule sets are highly interpretable logical models in which the predicates for decision are expressed in disjunctive normal form (DNF, OR-of-ANDs), or, equivalently, the overall model comprises an unordered collection of if-then decision…

Machine Learning · Computer Science 2022-06-09 Fan Yang , Kai He , Linxiao Yang , Hongxia Du , Jingbang Yang , Bo Yang , Liang Sun

As the vocabulary size of modern word-based language models becomes ever larger, many sampling-based training criteria are proposed and investigated. The essence of these sampling methods is that the softmax-related traversal over the…

Computation and Language · Computer Science 2021-06-18 Yingbo Gao , David Thulke , Alexander Gerstenberger , Khoa Viet Tran , Ralf Schlüter , Hermann Ney

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

In the context of tree-search stochastic planning algorithms where a generative model is available, we consider on-line planning algorithms building trees in order to recommend an action. We investigate the question of avoiding re-planning…

Machine Learning · Computer Science 2019-02-14 Erwan Lecarpentier , Guillaume Infantes , Charles Lesire , Emmanuel Rachelson