English
Related papers

Related papers: Optimal Decision Trees for Nonlinear Metrics

200 papers

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

Boosted decision trees enjoy popularity in a variety of applications; however, for large-scale datasets, the cost of training a decision tree in each round can be prohibitively expensive. Inspired by ideas from the multi-arm bandit…

Machine Learning · Computer Science 2018-05-22 Maryam Aziz , Jesse Anderton , Javed Aslam

Machine learning algorithms may have disparate impacts on protected groups. To address this, we develop methods for Bayes-optimal fair classification, aiming to minimize classification error subject to given group fairness constraints. We…

Machine Learning · Statistics 2025-08-28 Xianli Zeng , Kevin Jiang , Guang Cheng , Edgar Dobriban

The nonlinear model of the best-worst method frequently produces multiple optimal weight sets, which are conventionally determined through optimization software. While an analytical approach exists that provides both a closed-form…

Optimization and Control · Mathematics 2026-02-02 Harshit M. Ratandhara , Mohit Kumar

This paper investigates tree species classification using Sentinel-2 multispectral satellite image time-series. Despite their critical importance for many applications, such maps are often unavailable, outdated, or inaccurate for large…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Florian Mouret , David Morin , Milena Planells , Cécile Vincent-Barbaroux

Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to 'mine' variables of interest…

Econometrics · Economics 2020-12-22 Mochen Yang , Edward McFowland , Gordon Burtch , Gediminas Adomavicius

In an era where artificial intelligence and machine learning algorithms increasingly impact human life, it is crucial to develop models that account for potential discrimination in their predictions. This paper tackles this problem by…

Machine Learning · Statistics 2024-10-10 Anna Gottard , Vanessa Verrina , Sabrina Giordano

In binary classification tasks, accurate representation of probabilistic predictions is essential for various real-world applications such as predicting payment defaults or assessing medical risks. The model must then be well-calibrated to…

Machine Learning · Computer Science 2024-08-08 Agathe Fernandes Machado , Arthur Charpentier , Emmanuel Flachaire , Ewen Gallic , François Hu

Decision trees are interpretable models that are well-suited to non-linear learning problems. Much work has been done on extending decision tree learning algorithms with differential privacy, a system that guarantees the privacy of samples…

Machine Learning · Computer Science 2023-10-13 Daniël Vos , Jelle Vos , Tianyu Li , Zekeriya Erkin , Sicco Verwer

In decision problems, often, utilities and probabilities are hard to determine. In such cases, one can resort to so-called choice functions. They provide a means to determine which options in a particular set are optimal, and allow…

Statistics Theory · Mathematics 2018-08-10 Nathan Huntley , Matthias C. M. Troffaes

Economic complexity methods, and in particular relatedness measures, lack a systematic evaluation and comparison framework. We argue that out-of-sample forecast exercises should play this role, and we compare various machine learning models…

Machine Learning · Computer Science 2021-06-01 Giambattista Albora , Luciano Pietronero , Andrea Tacchella , Andrea Zaccaria

Bias originates from both data and algorithmic design, often exacerbated by traditional fairness methods that fail to address the subtle impacts of protected attributes. This study introduces an approach to mitigate bias in machine learning…

Machine Learning · Computer Science 2024-10-08 Khadija Zanna , Akane Sano

In the application of machine learning to real-life decision-making systems, e.g., credit scoring and criminal justice, the prediction outcomes might discriminate against people with sensitive attributes, leading to unfairness. The commonly…

Machine Learning · Computer Science 2022-03-21 Suyun Liu , Luis Nunes Vicente

This paper extends the RRT* algorithm, a recently developed but widely-used sampling-based optimal motion planner, in order to effectively handle nonlinear kinodynamic constraints. Nonlinearity in kinodynamic differential constraints often…

Robotics · Computer Science 2016-03-15 Jung-Su Ha , Han-Lim Choi , Jeong hwan Jeon

The purpose of this paper is two-fold, first, to review a recent method introduced by S. Becker, P. Cheridito, and P. Jentzen, for solving high-dimensional optimal stopping problems using deep Neural Networks, second, to propose an…

Optimization and Control · Mathematics 2023-04-25 Sigurd Assing , Xin Zhi

Performance optimization of deep learning models is conducted either manually or through automatic architecture search, or a combination of both. On the other hand, their performance strongly depends on the target hardware and how…

Machine Learning · Computer Science 2022-09-23 Vahid Partovi Nia , Alireza Ghaffari , Mahdi Zolnouri , Yvon Savaria

Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a…

Neural and Evolutionary Computing · Computer Science 2023-04-25 William G. La Cava

Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other.…

Machine Learning · Computer Science 2020-01-01 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

We propose an algorithm named best-scored random forest for binary classification problems. The terminology "best-scored" means to select the one with the best empirical performance out of a certain number of purely random tree candidates…

Machine Learning · Statistics 2019-05-28 Hanyuan Hang , Xiaoyu Liu , Ingo Steinwart

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban