English
Related papers

Related papers: Theoretical Analysis of an XGBoost Framework for P…

200 papers

While the space of renewable energy forecasting has received significant attention in the last decade, literature has primarily focused on machine learning models that train on only one objective at a time. A host of classification (and…

Optimization and Control · Mathematics 2023-01-31 Aswin Kannan

The use of multiple imputation (MI) is becoming increasingly popular for addressing missing data. Although some conventional MI approaches have been well studied and have shown empirical validity, they have limitations when processing large…

Methodology · Statistics 2023-07-31 Yongshi Deng , Thomas Lumley

Tree ensembles such as XGBoost are often preferred for discriminative tasks in mixed-type tabular data, due to their inductive biases, minimal hyperparameter tuning, and training efficiency. We argue that these qualities, when leveraged…

Machine Learning · Computer Science 2026-03-10 Jim Achterberg , Marcel Haas , Bram van Dijk , Marco Spruit

Wildfires present intricate challenges for prediction, necessitating the use of sophisticated machine learning techniques for effective modeling\cite{jain2020review}. In our research, we conducted a thorough assessment of various machine…

Machine Learning · Computer Science 2024-04-03 Di Fan , Ayan Biswas , James Paul Ahrens

We present a robust deep incremental learning framework for regression tasks on financial temporal tabular datasets which is built upon the incremental use of commonly available tabular and time series prediction models to adapt to…

Machine Learning · Computer Science 2023-10-11 Thomas Wong , Mauricio Barahona

In this work in progress, we demonstrate a new use-case for the ENIGMA system. The ENIGMA system using the XGBoost implementation of gradient boosted decision trees has demonstrated high capability to learn to guide the E theorem prover's…

Artificial Intelligence · Computer Science 2020-04-21 Zarathustra Amadeus Goertzel

Most real-world classification problems deal with imbalanced datasets, posing a challenge for Artificial Intelligence (AI), i.e., machine learning algorithms, because the minority class, which is of extreme interest, often proves difficult…

Machine Learning · Computer Science 2025-04-28 Gissel Velarde , Michael Weichert , Anuj Deshmunkh , Sanjay Deshmane , Anindya Sudhir , Khushboo Sharma , Vaibhav Joshi

Accurately predicting customer churn using large scale time-series data is a common problem facing many business domains. The creation of model features across various time windows for training and testing can be particularly challenging…

Machine Learning · Statistics 2018-02-13 Bryan Gregory

Machine learning algorithms such as random forests or xgboost are gaining more importance and are increasingly incorporated into production processes in order to enable comprehensive digitization and, if possible, automation of processes.…

Machine Learning · Computer Science 2021-07-20 Eva Bartz , Martin Zaefferer , Olaf Mersmann , Thomas Bartz-Beielstein

This paper evaluates XGboost's performance given different dataset sizes and class distributions, from perfectly balanced to highly imbalanced. XGBoost has been selected for evaluation, as it stands out in several benchmarks due to its…

Machine Learning · Computer Science 2023-03-28 Gissel Velarde , Anindya Sudhir , Sanjay Deshmane , Anuj Deshmunkh , Khushboo Sharma , Vaibhav Joshi

As several studies have shown, predicting credit risk is still a major concern for the financial services industry and is receiving a lot of scholarly interest. This area of study is crucial because it aids financial organizations in…

Machine Learning · Computer Science 2024-12-24 Sahar Yarmohammadtoosky Dinesh Chowdary Attota

An approach to evolutionary ensemble learning for classification is proposed in which boosting is used to construct a stack of programs. Each application of boosting identifies a single champion and a residual dataset, i.e. the training…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Zhilei Zhou , Ziyu Qiu , Brad Niblett , Andrew Johnston , Jeffrey Schwartzentruber , Nur Zincir-Heywood , Malcolm Heywood

We study approximation algorithms for revenue maximization based on static item pricing, where a seller chooses prices for various goods in the market, and then the buyers purchase utility-maximizing bundles at these given prices. We…

Computer Science and Game Theory · Computer Science 2017-05-03 Elliot Anshelevich , Shreyas Sekar

Matrix product states provide a natural entanglement basis to represent a quantum register and operate quantum gates on it. This scheme can be materialized to simulate a quantum adiabatic algorithm solving hard instances of a NP-Complete…

Quantum Physics · Physics 2009-11-11 M. C. Banuls , R. Orus , J. I. Latorre , A. Perez , P. Ruiz-Femenia

Despite the rise to dominance of deep learning in unstructured data domains, tree-based methods such as Random Forests (RF) and Gradient Boosted Decision Trees (GBDT) are still the workhorses for handling discriminative tasks on tabular…

Machine Learning · Computer Science 2025-04-21 João Bravo

For many machine learning models, a choice of hyperparameters is a crucial step towards achieving high performance. Prevalent meta-learning approaches focus on obtaining good hyperparameters configurations with a limited computational…

Machine Learning · Computer Science 2022-01-31 Katarzyna Woźnica , Mateusz Grzyb , Zuzanna Trafas , Przemysław Biecek

In recent years, product categorisation has been a common issue for E-commerce companies who have utilised machine learning to categorise their products automatically. In this study, we propose an ensemble approach, using a combination of…

Machine Learning · Computer Science 2023-04-28 Kieron Drumm

The absorption, distribution, metabolism, excretion, and toxicity (ADMET) properties are important in drug discovery as they define efficacy and safety. In this work, we applied an ensemble of features, including fingerprints and…

Biomolecules · Quantitative Biology 2022-09-20 Hao Tian , Rajas Ketkar , Peng Tao

Accurate prediction of crop yield before harvest is of great importance for crop logistics, market planning, and food distribution around the world. Yield prediction requires monitoring of phenological and climatic characteristics over…

Machine Learning · Computer Science 2023-02-08 Florian Huber , Artem Yushchenko , Benedikt Stratmann , Volker Steinhage

Accurate demand forecasting is critical for brick-and-mortar retailers to optimize inventory management and minimize costs. This study evaluates statistical baselines, tree-based ensembles (XGBoost and LightGBM), and deep learning…

Machine Learning · Computer Science 2026-03-12 Luka Hobor , Mario Brcic , Lidija Polutnik , Ante Kapetanovic