English
Related papers

Related papers: Exploring the Design Space of Fair Tree Learning A…

200 papers

This research aims to develop machine learning models for students academic performance and study strategies prediction which could be generalized to all courses in higher education. Key learning attributes (intrinsic, extrinsic, autonomy,…

Machine Learning · Computer Science 2022-10-18 Fidelia A. Orji , Julita Vassileva

Recent efforts to learn reward functions from human feedback have tended to use deep neural networks, whose lack of transparency hampers our ability to explain agent behaviour or verify alignment. We explore the merits of learning…

Machine Learning · Computer Science 2022-10-04 Tom Bewley , Jonathan Lawry , Arthur Richards , Rachel Craddock , Ian Henderson

Decision tree learning is increasingly being used for pointwise inference. Important applications include causal heterogenous treatment effects and dynamic policy decisions, as well as conditional quantile regression and design of…

Machine Learning · Statistics 2024-02-08 Matias D. Cattaneo , Jason M. Klusowski , Peter M. Tian

Tree-based models are widely recognized for their interpretability and have proven effective in various application domains, particularly in high-stakes domains. However, learning decision trees (DTs) poses a significant challenge due to…

Machine Learning · Computer Science 2026-03-13 Sascha Marton

Sparse decision tree optimization has been one of the most fundamental problems in AI since its inception and is a challenge at the core of interpretable machine learning. Sparse decision tree optimization is computationally hard, and…

Machine Learning · Computer Science 2022-07-07 Hayden McTavish , Chudi Zhong , Reto Achermann , Ilias Karimalis , Jacques Chen , Cynthia Rudin , Margo Seltzer

Decision trees are prized for their interpretability and strong performance on tabular data. Yet, their reliance on simple axis-aligned linear splits often forces deep, complex structures to capture non-linear feature effects, undermining…

Machine Learning · Computer Science 2025-10-23 Nakul Upadhya , Eldan Cohen

A tremendous range of design tasks in materials, physics, and biology can be formulated as finding the optimum of an objective function depending on many parameters without knowing its closed-form expression or the derivative. Traditional…

Machine Learning · Computer Science 2024-04-08 Ye Wei , Bo Peng , Ruiwen Xie , Yangtao Chen , Yu Qin , Peng Wen , Stefan Bauer , Po-Yen Tung

There is a recent proliferation of research on the integration of machine learning and optimization. One expansive area within this research stream is predictive-model embedded optimization, which proposes the use of pre-trained predictive…

Machine Learning · Computer Science 2022-10-20 Chenbo Shi , Mohsen Emadikhiav , Leonardo Lozano , David Bergman

Classification and Regression Trees (CARTs) are off-the-shelf techniques in modern Statistics and Machine Learning. CARTs are traditionally built by means of a greedy procedure, sequentially deciding the splitting predictor variable(s) and…

Machine Learning · Statistics 2021-10-25 Rafael Blanquero , Emilio Carrizosa , Cristina Molero-Río , Dolores Romero Morales

We initiate the study of fair classifiers that are robust to perturbations in the training distribution. Despite recent progress, the literature on fairness has largely ignored the design of fair and robust classifiers. In this work, we…

Machine Learning · Computer Science 2020-11-05 Debmalya Mandal , Samuel Deng , Suman Jana , Jeannette M. Wing , Daniel Hsu

As machine learning is increasingly used to make real-world decisions, recent research efforts aim to define and ensure fairness in algorithmic decision making. Existing methods often assume a fixed set of observable features to define…

Machine Learning · Computer Science 2020-05-11 YooJung Choi , Golnoosh Farnadi , Behrouz Babaki , Guy Van den Broeck

One of the most critical problems in weight-sharing neural architecture search is the evaluation of candidate models within a predefined search space. In practice, a one-shot supernet is trained to serve as an evaluator. A faithful ranking…

Machine Learning · Computer Science 2021-07-29 Xiangxiang Chu , Bo Zhang , Ruijun Xu

We present an algorithm for learning decision trees using stochastic gradient information as the source of supervision. In contrast to previous approaches to gradient-based tree learning, our method operates in the incremental learning…

Machine Learning · Statistics 2019-09-25 Henry Gouk , Bernhard Pfahringer , Eibe Frank

Global optimization of decision trees has shown to be promising in terms of accuracy, size, and consequently human comprehensibility. However, many of the methods used rely on general-purpose solvers for which scalability remains an issue.…

Machine Learning · Computer Science 2025-01-31 Jacobus G. M. van der Linden , Mathijs M. de Weerdt , Emir Demirović

Training data used for developing machine learning classifiers can exhibit biases against specific protected attributes. Such biases typically originate from historical discrimination or certain underlying patterns that disproportionately…

Machine Learning · Computer Science 2025-02-04 Anam Zahid , Abdur Rehman Ali , Shaina Raza , Rai Shahnawaz , Faisal Kamiran , Asim Karim

Learning algorithms produce software models for realising critical classification tasks. Decision trees models are simpler than other models such as neural network and they are used in various critical domains such as the medical and the…

Machine Learning · Computer Science 2020-10-27 Tianqi Xiao , Omer Nguena Timo , Florent Avellaneda , Yasir Malik , Stefan Bruda

Pairwise ordered tree alignment are combinatorial objects that appear in RNA secondary structure comparison. However, the usual representation of tree alignments as supertrees is ambiguous, i.e. two distinct supertrees may induce identical…

Quantitative Methods · Quantitative Biology 2016-03-08 Cedric Chauve , Julien Courtiel , Yann Ponty

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Human lives are increasingly being affected by the outcomes of automated decision-making systems and it is essential for the latter to be, not only accurate, but also fair. The literature of algorithmic fairness has grown considerably over…

Machine Learning · Computer Science 2022-11-15 Ainhize Barrainkua , Paula Gordaliza , Jose A. Lozano , Novi Quadrianto

Decision trees are interpretable models that are well-suited to non-linear learning problems. Much work has been done on extending decision tree learning algorithms with differential privacy, a system that guarantees the privacy of samples…

Machine Learning · Computer Science 2023-10-13 Daniël Vos , Jelle Vos , Tianyu Li , Zekeriya Erkin , Sicco Verwer