English
Related papers

Related papers: A Simple and Effective Random Forest Modelling for…

200 papers

Random Forest is a machine learning method that offers many advantages, including the ability to easily measure variable importance. Class balancing technique is a well-known solution to deal with class imbalance problem. However, it has…

Machine Learning · Statistics 2023-12-19 Yunbi Nam , Sunwoo Han

The second-order dependence structure of purely nondeterministic stationary process is described by the coefficients of the famous Wold representation. These coefficients can be obtained by factorizing the spectral density of the process.…

Statistics Theory · Mathematics 2017-12-21 Jonas Krampe , Jens-Peter Kreiss , Efstathios Paparoditis

As a flexible nonparametric learning tool, the random forests algorithm has been widely applied to various real applications with appealing empirical performance, even in the presence of high-dimensional feature space. Unveiling the…

Statistics Theory · Mathematics 2022-09-27 Chien-Ming Chi , Patrick Vossler , Yingying Fan , Jinchi Lv

This paper describes the Context Tree Switching technique, a modification of Context Tree Weighting for the prediction of binary, stationary, n-Markov sources. By modifying Context Tree Weighting's recursive weighting scheme, it is possible…

Information Theory · Computer Science 2011-11-15 Joel Veness , Kee Siong Ng , Marcus Hutter , Michael Bowling

Reservoir computing is a recently introduced machine learning paradigm that has been shown to be well-suited for the processing of spatiotemporal data. Rather than training the network node connections and weights via backpropagation in…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Ashley Prater

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

Concept drift has potential in smart grid analysis because the socio-economic behaviour of consumers is not governed by the laws of physics. Likewise there are also applications in wind power forecasting. In this paper we present decision…

Artificial Intelligence · Computer Science 2016-02-16 A. Zhukov , D. Sidorov , A. Foley

We introduce a modification of Random Forests to estimate functions when unobserved confounding variables are present. The technique is tailored for high-dimensional settings with many observed covariates. We use spectral deconfounding…

Computation · Statistics 2025-09-25 Markus Ulmer , Cyrill Scheidegger , Peter Bühlmann

This paper proposes a flexible framework for inferring large-scale time-varying and time-lagged correlation networks from multivariate or high-dimensional non-stationary time series with piecewise smooth trends. Built on a novel and unified…

Methodology · Statistics 2023-02-13 Lujia Bai , Weichi Wu

Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on coefficients of features, necessitating that the random…

Machine Learning · Computer Science 2024-09-23 Ruikai Yang , Fan He , Mingzhen He , Jie Yang , Xiaolin Huang

Recurrent events are common in clinical, healthcare, social and behavioral studies. A recent analysis framework for potentially censored recurrent event data is to construct a censored longitudinal data set consisting of times to the first…

Applications · Statistics 2025-02-11 Abigail Loe , Susan Murray , Zhenke Wu

Statistical Relational Learning (SRL) models have attracted significant attention due to their ability to model complex data while handling uncertainty. However, most of these models have been limited to discrete domains due to their…

Machine Learning · Computer Science 2021-10-20 Yuqiao Chen , Sriraam Natarajan , Nicholas Ruozzi

The present paper introduces a data-driven framework for describing the time-varying nature of an SIRD model in the context of COVID-19. By embedding a rolling regression in a mixed integer bilevel nonlinear programming problem, our aim is…

Populations and Evolution · Quantitative Biology 2021-03-04 Javier Rubio-Herrero , Yuchen Wang

Tree methods (recursive partitioning) are a popular class of nonparametric methods for analyzing data. One extension of the basic tree methodology is the survival tree, which applies recursive partitioning to censored survival data. There…

Methodology · Statistics 2017-03-01 Wei Fu , Jeffrey S. Simonoff

Tree kernels have been proposed to be used in many areas as the automatic learning of natural language applications. In this paper, we propose a new linear time algorithm based on the concept of weighted tree automata for SubTree kernel…

Computation and Language · Computer Science 2023-02-03 Ludovic Mignot , Faissal Ouardi , Djelloul Ziadi

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang

Random forests are a learning algorithm proposed by Breiman [Mach. Learn. 45 (2001) 5--32] that combines several randomized decision trees and aggregates their predictions by averaging. Despite its wide usage and outstanding practical…

Statistics Theory · Mathematics 2015-08-11 Erwan Scornet , Gérard Biau , Jean-Philippe Vert

Practical inference procedures for quantile regression models of panel data have been a pervasive concern in empirical work, and can be especially challenging when the panel is observed over many time periods and temporal dependence needs…

Econometrics · Economics 2025-07-25 Antonio F. Galvao , Carlos Lamarche , Thomas Parker

Random feature models (RFMs), two-layer networks with a randomly initialized fixed first layer and a trained linear readout, are among the simplest nonlinear predictors. Prior asymptotic analyses in the proportional high-dimensional regime…

Machine Learning · Statistics 2026-02-20 Samet Demir , Zafer Dogan

Time-frequency (TF) representations of time series are intrinsically subject to the boundary effects. As a result, the structures of signals that are highlighted by the representations are garbled when approaching the boundaries of the TF…

Signal Processing · Electrical Eng. & Systems 2021-02-24 Adrien Meynard , Hau-Tieng Wu