English
Related papers

Related papers: ODTlearn: A Package for Learning Optimal Decision …

200 papers

Decision trees are ubiquitous in machine learning for their ease of use and interpretability. Yet, these models are not typically employed in reinforcement learning as they cannot be updated online via stochastic gradient descent. We…

Machine Learning · Computer Science 2020-06-29 Andrew Silva , Taylor Killian , Ivan Dario Jimenez Rodriguez , Sung-Hyun Son , Matthew Gombolay

We propose a query learning algorithm for ordered multi-terminal binary decision diagrams (OMTBDDs) using at most n equivalence and 2n(l\lcei\log_2 m\rceil+ 3n) membership queries by extending the algorithm for ordered binary decision…

Machine Learning · Computer Science 2023-03-07 Atsuyoshi Nakamura

Dynamic treatment regime (DTR) plays a critical role in precision medicine when assigning patient-specific treatments at multiple stages and optimizing a long term clinical outcome. However, most of existing work about DTRs have been…

Methodology · Statistics 2023-02-20 Chang Wang , Lu Wang

Optimization modeling is one of the most crucial but technical parts of operations research (OR). To automate the modeling process, existing works have leveraged large language models (LLMs), prompting them to break down tasks into steps…

Artificial Intelligence · Computer Science 2025-10-28 Haoyang Liu , Jie Wang , Yuyang Cai , Xiongwei Han , Yufei Kuang , Jianye Hao

Oblique Decision Tree (ODT) separates the feature space by linear projections, as opposed to the conventional Decision Tree (DT) that forces axis-parallel splits. ODT has been proven to have a stronger representation ability than DT, as it…

Machine Learning · Computer Science 2025-02-04 Shen-Huan Lyu , Yi-Xiao He , Yanyan Wang , Zhihao Qu , Bin Tang , Baoliu Ye

We consider the problem of learning classification trees that are robust to distribution shifts between training and testing/deployment data. This problem arises frequently in high stakes settings such as public health and social work where…

Machine Learning · Computer Science 2025-08-27 Nathan Justin , Sina Aghaei , Andrés Gómez , Phebe Vayanos

We introduce milearn, a Python package for multi-instance learning (MIL) that follows the familiar scikit-learn fit/predict interface while providing a unified framework for both classical and neural-network-based MIL algorithms for…

Machine Learning · Computer Science 2025-12-02 Dmitry Zankov , Pavlo Polishchuk , Michal Sobieraj , Mario Barbatti

We present an algorithm, called the Offset Tree, for learning to make decisions in situations where the payoff of only one choice is observed, rather than all choices. The algorithm reduces this setting to binary classification, allowing…

Machine Learning · Computer Science 2016-04-05 Alina Beygelzimer , John Langford

In pool-based active learning, the learner is given an unlabeled data set and aims to efficiently learn the unknown hypothesis by querying the labels of the data points. This can be formulated as the classical Optimal Decision Tree (ODT)…

Machine Learning · Computer Science 2024-08-01 Su Jia , Fatemeh Navidi , Viswanath Nagarajan , R. Ravi

Optimization problems seek to find the best solution to an objective under a set of constraints, and have been widely investigated in real-world applications. Modeling and solving optimization problems in a specific domain typically require…

Optimization and Control · Mathematics 2024-07-12 Jihai Zhang , Wei Wang , Siyan Guo , Li Wang , Fangquan Lin , Cheng Yang , Wotao Yin

Decision Trees (DTs) constitute one of the major highly non-linear AI models, valued, e.g., for their efficiency on tabular data. Learning accurate DTs is, however, complicated, especially for oblique DTs, and does take a significant…

Machine Learning · Computer Science 2024-10-21 Subrat Prasad Panda , Blaise Genest , Arvind Easwaran , Ponnuthurai Nagaratnam Suganthan

Laser-scanned point clouds of forests make it possible to extract valuable information for forest management. To consider single trees, a forest point cloud needs to be segmented into individual tree point clouds. Existing segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jonathan Henrich , Jan van Delden , Dominik Seidel , Thomas Kneib , Alexander Ecker

Decision tree algorithms have been among the most popular algorithms for interpretable (transparent) machine learning since the early 1980's. The problem that has plagued decision tree algorithms since their inception is their lack of…

Machine Learning · Computer Science 2023-09-28 Xiyang Hu , Cynthia Rudin , Margo Seltzer

Polytrees are a subclass of Bayesian networks that seek to capture the conditional dependencies between a set of $n$ variables as a directed forest and are motivated by their more efficient inference and improved interpretability. Since the…

Data Structures and Algorithms · Computer Science 2026-05-06 Juha Harviainen , Frank Sommer , Manuel Sorge

In recent years, automated data-driven decision-making systems have enjoyed a tremendous success in a variety of fields (e.g., to make product recommendations, or to guide the production of entertainment). More recently, these algorithms…

Machine Learning · Computer Science 2019-03-27 Sina Aghaei , Mohammad Javad Azizi , Phebe Vayanos

To efficiently select optimal dataset combinations for enhancing multi-task learning (MTL) performance in large language models, we proposed a novel framework that leverages a neural network to predict the best dataset combinations. The…

Computation and Language · Computer Science 2025-05-06 Zaifu Zhan , Rui Zhang

Autonomous mobile robots are usually faced with challenging situations when driving in complex environments. Namely, they have to recognize the static and dynamic obstacles, plan the driving path and execute their motion. For addressing the…

Robotics · Computer Science 2021-06-03 Bogdan Trasnea , Cosmin Ginerica , Mihai Zaha , Gigel Macesanu , Claudiu Pozna , Sorin Grigorescu

Deep learning has been widely applied in recommender systems, which has achieved revolutionary progress recently. However, most existing learning-based methods assume that the user and item distributions remain unchanged between the…

Information Retrieval · Computer Science 2025-03-13 Xihong Yang , Yiqi Wang , Jin Chen , Wenqi Fan , Xiangyu Zhao , En Zhu , Xinwang Liu , Defu Lian

\texttt{ml\_edm} is a Python 3 library, designed for early decision making of any learning tasks involving temporal/sequential data. The package is also modular, providing researchers an easy way to implement their own triggering strategy…

Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Recently, self-supervised representation learning techniques (via contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Sina Mohseni , Arash Vahdat , Jay Yadawa