English
Related papers

Related papers: SecureBoost+: Large Scale and High-Performance Ver…

200 papers

Fraud detection is to identify, monitor, and prevent potentially fraudulent activities from complex data. The recent development and success in AI, especially machine learning, provides a new data-driven way to deal with fraud. From a…

Machine Learning · Statistics 2023-05-19 Biao Xu , Yao Wang , Xiuwu Liao , Kaidong Wang

Vertical federated learning (VFL) has recently emerged as an appealing distributed paradigm empowering multi-party collaboration for training high-quality models over vertically partitioned datasets. Gradient boosting has been popularly…

Cryptography and Security · Computer Science 2023-06-06 Yifeng Zheng , Shuangqing Xu , Songlei Wang , Yansong Gao , Zhongyun Hua

Federated learning, conducive to solving data privacy and security problems, has attracted increasing attention recently. However, the existing federated boosting model sequentially builds a decision tree model with the weak base learner,…

Machine Learning · Computer Science 2022-04-05 Yujin Han , Pan Du , Kai Yang

We introduce S-BDT: a novel $(\varepsilon,\delta)$-differentially private distributed gradient boosted decision tree (GBDT) learner that improves the protection of single training data points (privacy) while achieving meaningful learning…

Cryptography and Security · Computer Science 2024-08-19 Thorsten Peinemann , Moritz Kirschte , Joshua Stock , Carlos Cotrini , Esfandiar Mohammadi

Gradient boosting decision forests, used by XGBoost or AdaBoost, offer higher accuracy and lower training times than decision trees for large datasets. Protocols for private inference over decision trees can be used to preserve the privacy…

In AI research and industry, machine learning is the most widely used tool. One of the most important machine learning algorithms is Gradient Boosting Decision Tree, i.e. GBDT whose training process needs considerable computational…

Machine Learning · Computer Science 2024-04-30 Cheng Daning , Xia Fen , Li Shigang , Zhang Yunquan

Gradient boosting decision tree (GBDT) is a widely-used machine learning algorithm in both data analytic competitions and real-world industrial applications. Further, driven by the rapid increase in data volume, efforts have been made to…

Machine Learning · Computer Science 2019-08-06 Fangcheng Fu , Jiawei Jiang , Yingxia Shao , Bin Cui

Gradient boosted decision trees are a popular machine learning technique, in part because of their ability to give good accuracy with small models. We describe two extensions to the standard tree boosting algorithm designed to increase this…

Machine Learning · Statistics 2017-11-01 Natalia Ponomareva , Thomas Colthurst , Gilbert Hendry , Salem Haykal , Soroush Radpour

Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However,…

Machine Learning · Computer Science 2022-01-25 ZhenZhe Ying , Zhuoer Xu , Zhifeng Li , Weiqiang Wang , Changhua Meng

The privacy-sensitive nature of decentralized datasets and the robustness of eXtreme Gradient Boosting (XGBoost) on tabular data raise the needs to train XGBoost in the context of federated learning (FL). Existing works on federated XGBoost…

Machine Learning · Computer Science 2024-03-26 Chenyang Ma , Xinchi Qiu , Daniel J. Beutel , Nicholas D. Lane

Gradient Boosting Decision Tree (GBDT) are popular machine learning algorithms with implementations such as LightGBM and in popular machine learning toolkits like Scikit-Learn. Many implementations can only produce trees in an offline…

Machine Learning · Statistics 2020-02-06 Chapman Siu

Gradient boosting methods based on Structured Categorical Decision Trees (SCDT) have been demonstrated to outperform numerical and one-hot-encodings on problems where the categorical variable has a known underlying structure. However, the…

Machine Learning · Statistics 2020-07-10 Brian Lucena

In light of increasing privacy concerns and stringent legal regulations, using secure multiparty computation (MPC) to enable collaborative GBDT model training among multiple data owners has garnered significant attention. Despite this,…

Cryptography and Security · Computer Science 2025-12-23 Anxiao Song , Shujie Cui , Jianli Bai , Ke Cheng , Yulong Shen , Giovanni Russello

The application of federated extreme gradient boosting to mobile crowdsensing apps brings several benefits, in particular high performance on efficiency and classification. However, it also brings a new challenge for data and model privacy…

Cryptography and Security · Computer Science 2020-05-13 Zhuzhu Wang , Yilong Yang , Yang Liu , Ximeng Liu , Brij B. Gupta , Jianfeng Ma

Gradient Boosting Decision Tree (GBDT) has achieved remarkable success in a wide variety of applications. The split finding algorithm, which determines the tree construction process, is one of the most crucial components of GBDT. However,…

Machine Learning · Computer Science 2023-05-19 Zheyu Zhang , Tianping Zhang , Jian Li

User-generated data is crucial to predictive modeling in many applications. With a web/mobile/wearable interface, a data owner can continuously record data generated by distributed users and build various predictive models from the data to…

Cryptography and Security · Computer Science 2019-05-02 Sagar Sharma , Keke Chen

Medical diagnosis is a crucial task in the medical field, in terms of providing accurate classification and respective treatments. Having near-precise decisions based on correct diagnosis can affect a patient's life itself, and may…

Machine Learning · Computer Science 2025-08-27 A. Yarkın Yıldız , Asli Kalayci

Vertical Federated Learning (FL) is a new paradigm that enables users with non-overlapping attributes of the same data samples to jointly train a model without directly sharing the raw data. Nevertheless, recent works show that it's still…

Machine Learning · Computer Science 2022-10-05 Xiaochen Li , Yuke Hu , Weiran Liu , Hanwen Feng , Li Peng , Yuan Hong , Kui Ren , Zhan Qin

Transformer-based neural networks, empowered by Self-Supervised Learning (SSL), have demonstrated unprecedented performance across various domains. However, related literature suggests that tabular Transformers may struggle to outperform…

Uplift modeling comprises a collection of machine learning techniques designed for managers to predict the incremental impact of specific actions on customer outcomes. However, accurately estimating this incremental impact poses significant…

Machine Learning · Computer Science 2025-02-10 Junjie Gao , Xiangyu Zheng , DongDong Wang , Zhixiang Huang , Bangqi Zheng , Kai Yang