English
Related papers

Related papers: ODTlearn: A Package for Learning Optimal Decision …

200 papers

The effect of training data size on machine learning methods has been well investigated over the past two decades. The predictive performance of tree based machine learning methods, in general, improves with a decreasing rate as the size of…

Machine Learning · Statistics 2021-01-01 Zardad Khan , Naz Gul , Nosheen Faiz , Asma Gul , Werner Adler , Berthold Lausen

Online decision tree learning algorithms typically examine all features of a new data point to update model parameters. We propose a novel alternative, Reinforcement Learning- based Decision Trees (RLDT), that uses Reinforcement Learning…

Machine Learning · Computer Science 2015-07-27 Abhinav Garlapati , Aditi Raghunathan , Vaishnavh Nagarajan , Balaraman Ravindran

Recent recommender systems aim to provide not only accurate recommendations but also explanations that help users understand them better. However, most existing explainable recommendations only consider the importance of content in reviews,…

Information Retrieval · Computer Science 2024-08-06 Wenxin Zhao , Peng Zhang , Hansu Gu , Dongsheng Li , Tun Lu , Ning Gu

Tree-based models are widely recognized for their interpretability and have proven effective in various application domains, particularly in high-stakes domains. However, learning decision trees (DTs) poses a significant challenge due to…

Machine Learning · Computer Science 2026-03-13 Sascha Marton

Model selection is a strategy aimed at creating accurate and robust models. A key challenge in designing these algorithms is identifying the optimal model for classifying any particular input sample. This paper addresses this challenge and…

Machine Learning · Computer Science 2023-05-22 James Kotary , Vincenzo Di Vito , Ferdinando Fioretto

Applying DevOps practices to machine learning system is termed as MLOps and machine learning systems evolve on new data unlike traditional systems on requirements. The objective of MLOps is to establish a connection between different…

Software Engineering · Computer Science 2024-02-21 Pir Sami Ullah Shah , Naveed Ahmad , Mirza Omer Beg

Decision trees have been a very popular class of predictive models for decades due to their interpretability and good performance on categorical features. However, they are not always robust and tend to overfit the data. Additionally, if…

Machine Learning · Computer Science 2019-08-14 Oktay Gunluk , Jayant Kalagnanam , Minhan Li , Matt Menickelly , Katya Scheinberg

Student assessment is one of the most fundamental tasks in the field of AI Education (AIEd). One of the most common approach to student assessment is Knowledge Tracing (KT), which evaluates a student's knowledge state by predicting whether…

Computers and Society · Computer Science 2022-05-02 Suyeong An , Junghoon Kim , Minsam Kim , Juneyoung Park

Classification trees continue to be widely adopted in machine learning applications due to their inherently interpretable nature and scalability. We propose a rolling subtree lookahead algorithm that combines the relative scalability of the…

Machine Learning · Computer Science 2023-04-24 Zeynel Batuhan Organ , Enis Kayış , Taghi Khaniyev

Imbalanced-learn is an open-source python toolbox aiming at providing a wide range of methods to cope with the problem of imbalanced dataset frequently encountered in machine learning and pattern recognition. The implemented…

Machine Learning · Computer Science 2016-09-22 Guillaume Lemaitre , Fernando Nogueira , Christos K. Aridas

Model trees provide an appealing way to perform interpretable machine learning for both classification and regression problems. In contrast to ``classic'' decision trees with constant values in their leaves, model trees can use linear…

Machine Learning · Computer Science 2026-03-11 Sabino Francesco Roselli , Eibe Frank

Knowledge Discovery and Data Mining (KDD) is a multidisciplinary area focusing upon methodologies for extracting useful knowledge from data and there are several useful KDD tools to extracting the knowledge. This knowledge can be used to…

Information Retrieval · Computer Science 2012-02-24 Surjeet Kumar Yadav , Brijesh Bharadwaj , Saurabh Pal

Classification and Regression Tree (CART), Random Forest (RF) and Gradient Boosting Tree (GBT) are probably the most popular set of statistical learning methods. However, their statistical consistency can only be proved under very…

Statistics Theory · Mathematics 2025-02-17 Haoran Zhan , Yu Liu , Yingcun Xia

Optimal decision tree (\odt) is a fundamental problem arising in applications such as active learning, entity identification, and medical diagnosis. An instance of \odt is given by $m$ hypotheses, out of which an unknown ``true'' hypothesis…

Data Structures and Algorithms · Computer Science 2025-05-22 Zhengjia Zhuo , Viswanath Nagarajan

Label distribution learning (LDL) is a general learning framework, which assigns to an instance a distribution over a set of labels rather than a single label or multiple labels. Current LDL methods have either restricted assumptions on the…

Machine Learning · Computer Science 2017-10-18 Wei Shen , Kai Zhao , Yilu Guo , Alan Yuille

Decision trees are a popular machine learning model which are traditionally trained by heuristic methods. Massive improvements in computing power and optimisation techniques has led to renewed interest in learning globally optimal decision…

Optimization and Control · Mathematics 2025-11-25 Mitchell Keegan , Michael Forbes , Paul Corry , Mahdi Abolghasemi

Large-scale industrial recommender systems are usually confronted with computational problems due to the enormous corpus size. To retrieve and recommend the most relevant items to users under response time limits, resorting to an efficient…

Information Retrieval · Computer Science 2019-11-21 Han Zhu , Daqing Chang , Ziru Xu , Pengye Zhang , Xiang Li , Jie He , Han Li , Jian Xu , Kun Gai

In recent years, the concept of automated machine learning has become very popular. Automated Machine Learning (AutoML) mainly refers to the automated methods for model selection and hyper-parameter optimization of various algorithms such…

Machine Learning · Computer Science 2021-08-09 Sayan Putatunda , Dayananda Ubrangala , Kiran Rama , Ravi Kondapalli

Decision tree is an important method for both induction research and data mining, which is mainly used for model classification and prediction. ID3 algorithm is the most widely used algorithm in the decision tree so far. In this paper, the…

Machine Learning · Computer Science 2016-12-02 Singh Vijendra , Hemjyotsana Parashar , Nisha Vasudeva

Many real-life optimization problems frequently contain one or more constraints or objectives for which there are no explicit formulas. If data is however available, these data can be used to learn the constraints. The benefits of this…

Machine Learning · Computer Science 2022-09-23 Adejuyigbe Fajemisin , Donato Maragno , Dick den Hertog