English
Related papers

Related papers: ODTlearn: A Package for Learning Optimal Decision …

200 papers

Interpretability of reinforcement learning policies is essential for many real-world tasks but learning such interpretable policies is a hard problem. Particularly rule-based policies such as decision trees and rules lists are difficult to…

Artificial Intelligence · Computer Science 2024-02-15 Daniël Vos , Sicco Verwer

The global optimization literature places large emphasis on reducing intractable optimization problems into more tractable structured optimization forms. In order to achieve this goal, many existing methods are restricted to optimization…

Optimization and Control · Mathematics 2025-04-28 Dimitris Bertsimas , Berk Öztürk

Output thresholding is the technique to search for the best threshold to be used during inference for any classifiers that can produce probability estimates on train and testing datasets. It is particularly useful in high imbalance…

Machine Learning · Computer Science 2024-05-21 Baran Koseoglu , Luca Traverso , Mohammed Topiwalla , Egor Kraev , Zoltan Szopory

Learning algorithms produce software models for realising critical classification tasks. Decision trees models are simpler than other models such as neural network and they are used in various critical domains such as the medical and the…

Machine Learning · Computer Science 2020-10-27 Tianqi Xiao , Omer Nguena Timo , Florent Avellaneda , Yasir Malik , Stefan Bruda

In this paper, we present Ontolearn-a framework for learning OWL class expressions over large knowledge graphs. Ontolearn contains efficient implementations of recent stateof-the-art symbolic and neuro-symbolic class expression learners…

Multi-modal large language models (MLLMs) achieve strong visual-language reasoning but suffer from high inference cost due to redundant visual tokens. Recent work explores visual token pruning to accelerate inference, while existing pruning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xiwen Chen , Wenhui Zhu , Gen Li , Xuanzhao Dong , Yujian Xiong , Hao Wang , Peijie Qiu , Qingquan Song , Zhipeng Wang , Shao Tang , Yalin Wang , Abolfazl Razi

We present POMDPPlanners, an open-source Python package for empirical evaluation of Partially Observable Markov Decision Process (POMDP) planning algorithms. The package integrates state-of-the-art planning algorithms, a suite of benchmark…

Artificial Intelligence · Computer Science 2026-02-25 Yaacov Pariente , Vadim Indelman

In the domain of complex reasoning tasks, such as mathematical reasoning, recent advancements have proposed the use of Direct Preference Optimization (DPO) to suppress output of dispreferred responses, thereby enhancing the long-chain…

Computation and Language · Computer Science 2025-10-27 Weibin Liao , Xu Chu , Yasha Wang

We propose ODTE, a new ensemble that uses oblique decision trees as base classifiers. Additionally, we introduce STree, the base algorithm for growing oblique decision trees, which leverages support vector machines to define hyperplanes…

Machine Learning · Computer Science 2025-03-18 Ricardo Montañana , José A. Gámez , José M. Puerta

We develop and implement a version of the popular "policytree" method (Athey and Wager, 2021) using discrete optimisation techniques. We test the performance of our algorithm in finite samples and find an improvement in the runtime of…

Econometrics · Economics 2025-06-19 James Cussens , Julia Hatamyar , Vishalie Shah , Noemi Kreif

As the field of data science continues to grow, there will be an ever-increasing demand for tools that make machine learning accessible to non-experts. In this paper, we introduce the concept of tree-based pipeline optimization for…

Neural and Evolutionary Computing · Computer Science 2016-03-22 Randal S. Olson , Nathan Bartley , Ryan J. Urbanowicz , Jason H. Moore

Many approaches for addressing Global Optimization problems typically rely on relaxations of nonlinear constraints over specific mathematical primitives. This is restricting in applications with constraints that are black-box, implicit or…

Optimization and Control · Mathematics 2025-01-03 Dimitris Bertsimas , Georgios Margaritis

Improving the multi-step reasoning ability of large language models (LLMs) with offline reinforcement learning (RL) is essential for quickly adapting them to complex tasks. While Direct Preference Optimization (DPO) has shown promise in…

Machine Learning · Computer Science 2024-12-30 Huaijie Wang , Shibo Hao , Hanze Dong , Shenao Zhang , Yilin Bao , Ziran Yang , Yi Wu

Decision trees are among the most popular machine learning models and are used routinely in applications ranging from revenue management and medicine to bioinformatics. In this paper, we consider the problem of learning optimal binary…

Machine Learning · Computer Science 2023-07-20 Sina Aghaei , Andrés Gómez , Phebe Vayanos

Dynamic treatment regimes (DTRs) are sequences of decision rules designed to tailor treatment based on patients' treatment history and evolving disease status. Ordinal outcomes frequently serve as primary endpoints in clinical trials and…

Methodology · Statistics 2025-03-11 Xinru Wang , Tanujit Chakraborty , Bibhas Chakraborty

Decision trees are machine learning models commonly used in various application scenarios. In the era of big data, traditional decision tree induction algorithms are not suitable for learning large-scale datasets due to their stringent data…

Machine Learning · Computer Science 2020-12-14 Zhe Lin , Sharad Sinha , Wei Zhang

Deep learning hyper-parameter optimization is a tough task. Finding an appropriate network configuration is a key to success, however most of the times this labor is roughly done. In this work we introduce a novel library to tackle this…

Machine Learning · Computer Science 2018-07-11 Andrés Camero , Jamal Toutouh , Enrique Alba

Predict-then-Optimize (PTO) pipelines are widely employed in computing and networked systems, where Machine Learning (ML) models are used to predict critical contextual information for downstream decision-making tasks such as cloud LLM…

Machine Learning · Computer Science 2026-02-04 Jiaqi Wen , Lei Fan , Jianyi Yang

One-class Classification (OCC) is an area of machine learning which addresses prediction based on unbalanced datasets. Basically, OCC algorithms achieve training by means of a single class sample, with potentially some additional…

Machine Learning · Statistics 2020-03-27 Sarah Itani , Fabian Lecron , Philippe Fortemps

Three-dimensional (3D) point cloud analysis has become central to applications ranging from autonomous driving and robotics to forestry and ecological monitoring. Although numerous deep learning methods have been proposed for point cloud…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Said Ohamouddou , Hanaa El Afia , Abdellatif El Afia , Raddouane Chiheb