中文
相关论文

相关论文: Discrete minimax estimation with trees

200 篇论文

When analysing binary data, the ease at which one can interpret results is very important. Many existing methods, however, discover either models that are difficult to read, or return so many results interpretation becomes impossible. Here,…

数据结构与算法 · 计算机科学 2019-02-11 Nikolaj Tatti , Jilles Vreeken

Without access to large compute clusters, building random forests on large datasets is still a challenging problem. This is, in particular, the case if fully-grown trees are desired. We propose a simple yet effective framework that allows…

机器学习 · 计算机科学 2018-02-20 Fabian Gieseke , Christian Igel

Connected acyclic graphs (trees) are data objects that hierarchically organize categories. Collections of trees arise in a diverse variety of fields, including evolutionary biology, public health, machine learning, social sciences and…

统计方法学 · 统计学 2025-12-01 Maria Alejandra Valdez Cabrera , Amy D Willis , Armeen Taeb

Classification and Regression Trees (CARTs) are off-the-shelf techniques in modern Statistics and Machine Learning. CARTs are traditionally built by means of a greedy procedure, sequentially deciding the splitting predictor variable(s) and…

We study the minimax estimation of $\alpha$-divergences between discrete distributions for integer $\alpha\ge 1$, which include the Kullback--Leibler divergence and the $\chi^2$-divergences as special examples. Dropping the usual…

信息论 · 计算机科学 2021-03-04 Yanjun Han , Jiantao Jiao , Tsachy Weissman

We develop Clustered Random Forests, a random forests algorithm for clustered data, arising from independent groups that exhibit within-cluster dependence. The leaf-wise predictions for each decision tree making up clustered random forests…

统计方法学 · 统计学 2026-01-26 Elliot H. Young , Peter Bühlmann

The nonparametric regression with a random design model is considered. We want to recover the regression function at a point x where the design density is vanishing or exploding. Depending on assumptions on the regression function local…

统计理论 · 数学 2016-08-16 Stéphane Gaiffas

Time series are difficult to monitor, summarize and predict. Segmentation organizes time series into few intervals having uniform characteristics (flatness, linearity, modality, monotonicity and so on). For scalability, we require fast…

数据库 · 计算机科学 2007-05-23 Daniel Lemire

We study the problem of nonparametric estimation under $\bL_p$-loss, $p\in [1,\infty)$, in the framework of the convolution structure density model on $\bR^d$. This observation scheme is a generalization of two classical statistical models,…

统计理论 · 数学 2017-04-17 Oleg Lepski , Thomas Willer

We consider supervised learning with random decision trees, where the tree construction is completely random. The method is popularly used and works well in practice despite the simplicity of the setting, but its statistical mechanism is…

机器学习 · 计算机科学 2015-02-06 Mariusz Bojarski , Anna Choromanska , Krzysztof Choromanski , Yann LeCun

We develop a new methodology for the fitting of nonstationary time series that exhibit nonlinearity, asymmetry, local persistence and changes in location scale and shape of the underlying distribution. In order to achieve this goal, we…

统计理论 · 数学 2016-09-29 Alexander Aue , Rex C. Y. Cheung , Thomas C. M. Lee , Ming Zhong

This paper studies Minimum Spanning Trees under incomplete information for its vertices. We assume that no information is available on the precise placement of vertices so that it is only known that vertices belong to some neighborhoods…

最优化与控制 · 数学 2016-11-10 Víctor Blanco , Elena Fernández , Justo Puerto

We study a non-parametric approach to multivariate density estimation. The estimators are piecewise constant density functions supported by binary partitions. The partition of the sample space is learned by maximizing the likelihood of the…

统计理论 · 数学 2015-08-21 Linxi Liu , Wing Hung Wong

This paper proposes an efficient hypergraph partitioning framework based on a novel multi-objective non-convex constrained relaxation model. A modified accelerated proximal gradient algorithm is employed to generate diverse $k$-dimensional…

机器学习 · 计算机科学 2025-09-29 Yingying Li , Mingxuan Xie , Hailong You , Yongqiang Yao , Hongwei Liu

In this paper we study the problem of pointwise density estimation from observations with multiplicative measurement errors. We elucidate the main feature of this problem: the influence of the estimation point on the estimation accuracy. In…

统计方法学 · 统计学 2018-07-13 Denis Belomestny , Alexander Goldenshluger

We introduce a convex approach for mixed linear regression over $d$ features. This approach is a second-order cone program, based on L1 minimization, which assigns an estimate regression coefficient in $\mathbb{R}^{d}$ for each data point.…

最优化与控制 · 数学 2019-01-09 Paul Hand , Babhru Joshi

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

机器学习 · 统计学 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Airborne discrete return light detection and ranging (LiDAR) point clouds covering forested areas can be processed to segment individual trees and retrieve their morphological attributes. Segmenting individual trees in natural deciduous…

计算机视觉与模式识别 · 计算机科学 2017-08-01 Hamid Hamraz , Marco A. Contreras

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

统计方法学 · 统计学 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou