中文
相关论文

相关论文: Theoretical Analysis of an XGBoost Framework for P…

200 篇论文

We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the zero or linearity assumption for the prior mean function in Gaussian process and grouped random effects models…

机器学习 · 计算机科学 2024-11-06 Fabio Sigrist

For regulatory and interpretability reasons, logistic regression is still widely used. To improve prediction accuracy and interpretability, a preprocessing step quantizing both continuous and categorical data is usually performed:…

统计方法学 · 统计学 2019-03-22 Adrien Ehrhardt , Christophe Biernacki , Vincent Vandewalle , Philippe Heinrich

A key element in solving real-life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several…

机器学习 · 计算机科学 2021-11-24 Ravid Shwartz-Ziv , Amitai Armon

Economic complexity methods, and in particular relatedness measures, lack a systematic evaluation and comparison framework. We argue that out-of-sample forecast exercises should play this role, and we compare various machine learning models…

机器学习 · 计算机科学 2021-06-01 Giambattista Albora , Luciano Pietronero , Andrea Tacchella , Andrea Zaccaria

Traditional statistical and machine learning methods typically assume that the training and test data follow the same distribution. However, this assumption is frequently violated in real-world applications, where the training data in the…

统计方法学 · 统计学 2025-07-08 Hanxuan Ye , Hongzhe Li

Recent concept-based interpretable models have succeeded in providing meaningful explanations by pre-defined concept sets. However, the dependency on the pre-defined concepts restricts the application because of the limited number of…

人工智能 · 计算机科学 2025-02-19 Shin'ya Yamaguchi , Kosuke Nishida

In this paper, we propose a general deep learning training framework XGrad which introduces weight prediction into the popular gradient-based optimizers to boost their convergence and generalization when training the deep neural network…

机器学习 · 计算机科学 2024-04-09 Lei Guan , Dongsheng Li , Yanqi Shi , Jian Meng

This paper introduces a novel decision-focused framework for energy storage arbitrage bidding. Inspired by the bidding process for energy storage in electricity markets, we propose a predict-then-bid end-to-end method incorporating the…

系统与控制 · 电气工程与系统科学 2025-05-07 Ming Yi , Yiqian Wu , Saud Alghumayjan , James Anderson , Bolun Xu

Accurate prediction of crop states (e.g., phenology stages and cold hardiness) is essential for timely farm management decisions such as irrigation, fertilization, and canopy management to optimize crop yield and quality. While traditional…

人工智能 · 计算机科学 2026-05-20 William Solow , Paola Pesantez-Cabrera , Markus Keller , Lav Khot , Sandhya Saisubramanian , Alan Fern

We present Natural Gradient Boosting (NGBoost), an algorithm for generic probabilistic prediction via gradient boosting. Typical regression models return a point estimate, conditional on covariates, but probabilistic regression models…

机器学习 · 计算机科学 2020-06-11 Tony Duan , Anand Avati , Daisy Yi Ding , Khanh K. Thai , Sanjay Basu , Andrew Y. Ng , Alejandro Schuler

Breast cancer has rapidly increased in prevalence in recent years, making it one of the leading causes of mortality worldwide. Among all cancers, it is by far the most common. Diagnosing this illness manually requires significant time and…

Many applied problems contain signal that becomes clear only after combining multiple raw measurements. Ratios and rates are common examples. In gradient boosted trees, this combination is not an explicit operation: the model must…

机器学习 · 计算机科学 2026-01-14 Mykola Pinchuk

Optimal charging of electric vehicle (EVs) depends heavily on reliable sensor measurements from the battery pack to the cloud-controller of the smart charging station. However, an adversary could corrupt the voltage sensor data during…

系统与控制 · 电气工程与系统科学 2026-01-21 Sanchita Ghosh , Tanushree Roy

Multicalibration extends classical calibration by requiring predictions to be unbiased over a rich collection of functions, encompassing both prediction slices and subpopulations. It has emerged as a powerful framework for fairness,…

机器学习 · 统计学 2026-05-26 Hanxuan Ye , Hongzhe Li

Food production is a complex process which can benefit from many optimisation approaches. However, there is growing interest in methods that support customisation of food properties to satisfy individual consumer preferences. This paper…

神经与进化计算 · 计算机科学 2022-04-14 Mohammad Majid al-Rifaie , Marc Cavazza

Randomized experiments, or A/B testing, are the gold standard for evaluating interventions, yet they remain underutilized in inventory management. This study addresses this gap by analyzing A/B testing strategies in multi-item, multi-period…

统计方法学 · 统计学 2026-02-03 Xinqi Chen , Xingyu Bai , Zeyu Zheng , Nian Si

A new implementation of an adiabatically-trained ensemble model is derived that shows significant improvements over classical methods. In particular, empirical results of this new algorithm show that it offers not just higher performance,…

机器学习 · 计算机科学 2022-10-17 Salvatore Certo , Andrew Vlasic , Daniel Beaulieu

I present an application of established machine learning techniques to NHANES health survey data for predicting diabetes status. I compare baseline models (logistic regression, random forest, XGBoost) with a hybrid approach that uses an…

机器学习 · 计算机科学 2025-12-03 Mithra D K

The method of choice to study one-dimensional strongly interacting many body quantum systems is based on matrix product states and operators. Such method allows to explore the most relevant, and numerically manageable, portion of an…

统计力学 · 物理学 2018-10-10 Chu Guo , Zhanming Jie , Wei Lu , Dario Poletti

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

最优化与控制 · 数学 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira