English
Related papers

Related papers: Asymptotic Normality of Infinite Centered Random F…

200 papers

The Distributional Random Forest (DRF) is a recently introduced Random Forest algorithm to estimate multivariate conditional distributions. Due to its general estimation procedure, it can be employed to estimate a wide range of targets such…

Statistics Theory · Mathematics 2023-12-20 Jeffrey Näf , Corinne Emmenegger , Peter Bühlmann , Nicolai Meinshausen

Gradient boosting is widely popular due to its flexibility and predictive accuracy. However, statistical inference and uncertainty quantification for gradient boosting remain challenging and under-explored. We propose a unified framework…

Machine Learning · Statistics 2025-09-30 Haimo Fang , Kevin Tan , Giles Hooker

Causal inference from observational data requires untestable identification assumptions. If these assumptions apply, machine learning (ML) methods can be used to study complex forms of causal effect heterogeneity. Recently, several ML…

Methodology · Statistics 2023-12-20 Richard Post , Isabel van den Heuvel , Marko Petkovic , Edwin van den Heuvel

In this study, classification problems based on feedforward neural networks in a data-imbalanced environment are considered. Learning from an imbalanced dataset is one of the most important practical problems in the field of machine…

Machine Learning · Statistics 2020-12-23 Muneki Yasuda , Yeo Xian En , Seishirou Ueno

A reduced-bias nonparametric estimator of the cumulative distribution function (CDF) and the survival function is proposed using infinite-order kernels. Fourier transform theory on generalized functions is utilized to obtain the improved…

Methodology · Statistics 2009-03-18 Arthur Berg , Dimitris N. Politis

Long-tailed (LT) classification is an unavoidable and challenging problem in the real world. Most existing long-tailed classification methods focus only on solving the class-wise imbalance while ignoring the attribute-wise imbalance. The…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jinye Yang , Ji Xu , Di Wu , Jianhang Tang , Shaobo Li , Guoyin Wang

Random Forest (RF) is a widely used ensemble learning technique known for its robust classification performance across diverse domains. However, it often relies on hundreds of trees and all input features, leading to high inference cost and…

Machine Learning · Computer Science 2025-07-08 Sijan Bhattarai , Saurav Bhandari , Girija Bhusal , Saroj Shakya , Tapendra Pandey

We develop a central limit theorem (CLT) for a non-parametric estimator of the transition matrices in controlled Markov chains (CMCs) with finite state-action spaces. Our results establish precise conditions on the logging policy under…

Statistics Theory · Mathematics 2026-03-26 Ziwei Su , Imon Banerjee , Diego Klabjan

Classification on imbalanced datasets is a challenging task in real-world applications. Training conventional classification algorithms directly by minimizing classification error in this scenario can compromise model performance for…

Machine Learning · Computer Science 2020-03-05 Xiangrui Li , Dongxiao Zhu

Many real-world classification problems are significantly class-imbalanced to detriment of the class of interest. The standard set of proper evaluation metrics is well-known but the usual assumption is that the test dataset imbalance equals…

Machine Learning · Computer Science 2020-04-16 Jan Brabec , Tomáš Komárek , Vojtěch Franc , Lukáš Machlica

Imbalanced data are frequently encountered in real-world classification tasks. Previous works on imbalanced learning mostly focused on learning with a minority class of few samples. However, the notion of imbalance also applies to cases…

Machine Learning · Computer Science 2024-09-09 Yin Jin , Ningtao Wang , Ruofan Wu , Pengfei Shi , Xing Fu , Weiqiang Wang

Sampling-based algorithms, such as Rapidly Exploring Random Trees (RRT) and its variants, have been used extensively for motion planning. Control barrier functions (CBFs) have been recently proposed to synthesize controllers for…

Robotics · Computer Science 2022-06-03 Ahmad Ahmad , Calin Belta , Roberto Tron

In this paper, we propose a balancing training method to address problems in imbalanced data learning. To this end, we derive a new loss used in the balancing training phase that alleviates the influence of samples that cause an overfitted…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Seulki Park , Jongin Lim , Younghan Jeon , Jin Young Choi

The training loss function that enforces certain training sample distribution patterns plays a critical role in building a re-identification (ReID) system. Besides the basic requirement of discrimination, i.e., the features corresponding to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Lu Yang , Yunlong Wang , Lingqiao Liu , Peng Wang , Lu Chi , Zehuan Yuan , Changhu Wang , Yanning Zhang

The present study introduces a method for improving the classification performance of imbalanced multiclass data streams from wireless body worn sensors. Data imbalance is an inherent problem in activity recognition caused by the irregular…

Machine Learning · Computer Science 2016-03-14 Roberto L. Shinmoto Torres , Damith C. Ranasinghe , Qinfeng Shi , Anton van den Hengel

The effectiveness of anomaly signal detection can be significantly undermined by the inherent uncertainty of relying on one specified model. Under the framework of model average methods, this paper proposes a novel criterion to select the…

Machine Learning · Statistics 2024-05-30 Gaoxiang Zhao , Lu Wang , Xiaoqiang Wang

We present an extension to the model-free anomaly detection algorithm, Isolation Forest. This extension, named Extended Isolation Forest (EIF), resolves issues with assignment of anomaly score to given data points. We motivate the problem…

Machine Learning · Computer Science 2020-07-09 Sahand Hariri , Matias Carrasco Kind , Robert J. Brunner

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia

In this paper, we introduce a collaborative training algorithm of balanced random forests with convolutional neural networks for domain adaptation tasks. In real scenarios, most domain adaptation algorithms face the challenges from noisy,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Jongbin Ryu , Jiun Bae , Jongwoo Lim

Recent theoretical works have characterized the dynamics of wide shallow neural networks trained via gradient descent in an asymptotic mean-field limit when the width tends towards infinity. At initialization, the random sampling of the…

Probability · Mathematics 2022-03-29 Zhengdao Chen , Grant M. Rotskoff , Joan Bruna , Eric Vanden-Eijnden