English
Related papers

Related papers: Collaborative Training of Balanced Random Forests …

200 papers

Existing domain adaptation (DA) methods often involve pre-training on the source domain and fine-tuning on the target domain. For multi-target domain adaptation, having a dedicated/separate fine-tuned network for each target domain, that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Sidra Aleem , Julia Dietlmeier , Eric Arazo , Suzanne Little

Generalizing policies across different domains with dynamics mismatch poses a significant challenge in reinforcement learning. For example, a robot learns the policy in a simulator, but when it is deployed in the real world, the dynamics of…

Machine Learning · Computer Science 2023-10-16 Kang Xu , Chenjia Bai , Xiaoteng Ma , Dong Wang , Bin Zhao , Zhen Wang , Xuelong Li , Wei Li

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

Machine Learning · Computer Science 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

The most recent multi-source covariate shift algorithm is an efficient hyperparameter optimization algorithm for missing target output. In this paper, we extend this algorithm to the framework of federated learning. For data islands in…

Machine Learning · Statistics 2023-03-01 Yaqian Xu , Wenquan Cui , Jianjun Xu , Haoyang Cheng

We present Neural Random Forest Imitation - a novel approach for transforming random forests into neural networks. Existing methods propose a direct mapping and produce very inefficient architectures. In this work, we introduce an imitation…

Machine Learning · Computer Science 2024-04-05 Christoph Reinders , Bodo Rosenhahn

Domain adaptation has been a fundamental technology for transferring knowledge from a source domain to a target domain. The key issue of domain adaptation is how to reduce the distribution discrepancy between two domains in a proper way…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Lei Tian , Yongqiang Tang , Liangchen Hu , Zhida Ren , Wensheng Zhang

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

In this paper, we propose a novel domain adaptation method for the source-free setting. In this setting, we cannot access source data during adaptation, while unlabeled target data and a model pretrained with source data are given. Due to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Masato Ishii , Masashi Sugiyama

Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be…

Machine Learning · Computer Science 2021-10-19 Yunye Gong , Xiao Lin , Yi Yao , Thomas G. Dietterich , Ajay Divakaran , Melinda Gervasio

Random Forest is an ensemble of decision trees based on the bagging and random subspace concepts. As suggested by Breiman, the strength of unstable learners and the diversity among them are the ensemble models' core strength. In this paper,…

Machine Learning · Computer Science 2022-08-11 M. A. Ganaie , M. Tanveer , P. N. Suganthan , V. Snasel

Random forest (RF) stands out as a highly favored machine learning approach for classification problems. The effectiveness of RF hinges on two key factors: the accuracy of individual trees and the diversity among them. In this study, we…

Machine Learning · Computer Science 2024-10-28 Ye-eun Kim , Seoung Yun Kim , Hyunjoong Kim

We describe a new instance-based learning algorithm called the Boundary Forest (BF) algorithm, that can be used for supervised and unsupervised learning. The algorithm builds a forest of trees whose nodes store previously seen examples. It…

Machine Learning · Computer Science 2015-05-14 Charles Mathy , Nate Derbinsky , José Bento , Jonathan Rosenthal , Jonathan Yedidia

Sampling-based motion planners perform exceptionally well in robotic applications that operate in high-dimensional space. However, most works often constrain the planning workspace rooted at some fixed locations, do not adaptively reason on…

Robotics · Computer Science 2021-03-09 Tin Lai

In this paper we analyze, evaluate, and improve the performance of training Random Forest (RF) models on modern CPU architectures. An exact, state-of-the-art binary decision tree building algorithm is used as the basis of this study.…

Due to privacy, storage, and other constraints, there is a growing need for unsupervised domain adaptation techniques in machine learning that do not require access to the data used to train a collection of source models. Existing methods…

Machine Learning · Computer Science 2023-06-01 Maohao Shen , Yuheng Bu , Gregory Wornell

We propose a novel algorithm for optimizing multivariate linear threshold functions as split functions of decision trees to create improved Random Forest classifiers. Standard tree induction methods resort to sampling and exhaustive search…

Machine Learning · Computer Science 2015-06-26 Mohammad Norouzi , Maxwell D. Collins , David J. Fleet , Pushmeet Kohli

Random Forests (RF) is a popular machine learning method for classification and regression problems. It involves a bagging application to decision tree models. One of the primary advantages of the Random Forests model is the reduction in…

Machine Learning · Statistics 2022-07-06 Sai K Popuri

Deep-learning methods offer unsurpassed recognition performance in a wide range of domains, including fine-grained recognition tasks. However, in most problem areas there are insufficient annotated training samples. Therefore, the topic of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Bernd Gruner , Matthias Körschens , Björn Barz , Joachim Denzler

Random Forests (RF) are among the most powerful and widely used predictive models for centralized tabular data, yet few methods exist to adapt them to the federated learning setting. Unlike most federated learning approaches, the…

Machine Learning · Statistics 2026-05-08 Rémi Khellaf , Erwan Scornet , Aurélien Bellet , Julie Josse

We introduce the domain adaptation and randomization approach for calibrating neural network-based equalizers for real transmissions, using synthetic data. The approach renders up to 99\% training process reduction, which we demonstrate in…