English
Related papers

Related papers: Autoencoding Random Forests

200 papers

We study the problem of sharing as many branching conditions of a given forest classifier or regressor as possible while keeping classification performance. As a constraint for preventing from accuracy degradation, we first consider the one…

Machine Learning · Computer Science 2022-12-15 Atsuyoshi Nakamura , Kento Sakurada

Inspired by the success of deep learning techniques in the physical and chemical sciences, we apply a modification of an autoencoder type deep neural network to the task of dimension reduction of molecular dynamics data. We can show that…

Machine Learning · Statistics 2018-04-04 Christoph Wehmeyer , Frank Noé

Recent developments in high throughput profiling of individual neurons have spurred data driven exploration of the idea that there exist natural groupings of neurons referred to as cell types. The promise of this idea is that the immense…

Neurons and Cognition · Quantitative Biology 2019-11-14 Rohan Gala , Nathan Gouwens , Zizhen Yao , Agata Budzillo , Osnat Penn , Bosiljka Tasic , Gabe Murphy , Hongkui Zeng , Uygar Sümbül

This work develops formal statistical inference procedures for machine learning ensemble methods. Ensemble methods based on bootstrapping, such as bagging and random forests, have improved the predictive accuracy of individual trees, but…

Machine Learning · Statistics 2015-09-11 Lucas Mentch , Giles Hooker

Since its introduction, unsupervised representation learning has attracted a lot of attention from the research community, as it is demonstrated to be highly effective and easy-to-apply in tasks such as dimension reduction, clustering,…

Machine Learning · Computer Science 2018-11-07 Chin-Chia Michael Yeh , Yan Zhu , Evangelos E. Papalexakis , Abdullah Mueen , Eamonn Keogh

We propose a general framework for end-to-end learning of data structures. Our framework adapts to the underlying data distribution and provides fine-grained control over query and space complexity. Crucially, the data structure is learned…

Machine Learning · Computer Science 2024-11-06 Omar Salemohamed , Laurent Charlin , Shivam Garg , Vatsal Sharan , Gregory Valiant

In this book chapter, we discuss recent advances in data-driven approaches for inverse problems. In particular, we focus on the \emph{paired autoencoder} framework, which has proven to be a powerful tool for solving inverse problems in…

Machine Learning · Computer Science 2025-08-20 Matthias Chung , Bas Peters , Michael Solomon

We develop Clustered Random Forests, a random forests algorithm for clustered data, arising from independent groups that exhibit within-cluster dependence. The leaf-wise predictions for each decision tree making up clustered random forests…

Methodology · Statistics 2026-01-26 Elliot H. Young , Peter Bühlmann

Scale-space representation has been popular in computer vision community due to its theoretical foundation. The motivation for generating a scale-space representation of a given data set originates from the basic observation that real-world…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Qilu Zhao , Zongmin Li

Random forests are an ensemble method relevant for many problems, such as regression or classification. They are popular due to their good predictive performance (compared to, e.g., decision trees) requiring only minimal tuning of…

Methodology · Statistics 2022-10-20 Nikolaus Umlauf , Nadja Klein

Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control and downstream task performance in Natural Language Processing. Currently, most disentanglement methods are unsupervised…

Computation and Language · Computer Science 2023-02-17 Danilo S. Carvalho , Giangiacomo Mercatali , Yingji Zhang , Andre Freitas

In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from…

Machine Learning · Statistics 2017-02-09 Michael Kampffmeyer , Sigurd Løkse , Filippo Maria Bianchi , Robert Jenssen , Lorenzo Livi

We introduce a novel self-supervised learning framework that automatically learns representations from input computer-aided design (CAD) models for downstream tasks, including part classification, modeling segmentation, and machining…

Graphics · Computer Science 2026-03-18 Yifei Li , Kang Wu , Wenming Wu , Xiao-Ming Fu

In this paper, we introduce the Fixed Topology Minimum-Length Tree with Neighborhood Problem, which aims to embed a rooted tree-shaped graph into a $d$-dimensional metric space while minimizing its total length provided that the nodes must…

Optimization and Control · Mathematics 2024-09-09 Víctor Blanco , Gabriel González , Justo Puerto

We propose a procedure to build a decision tree which approximates the performance of complex machine learning models. This single approximation tree can be used to interpret and simplify the predicting pattern of random forests (RFs) and…

Methodology · Statistics 2016-10-31 Yichen Zhou , Giles Hooker

Unsupervised clustering is one of the most fundamental challenges in machine learning. A popular hypothesis is that data are generated from a union of low-dimensional nonlinear manifolds; thus an approach to clustering is identifying and…

Machine Learning · Computer Science 2017-12-27 Dejiao Zhang , Yifan Sun , Brian Eriksson , Laura Balzano

We study various types of consistency of honest decision trees and random forests in the regression setting. In contrast to related literature, our proofs are elementary and follow the classical arguments used for smoothing methods. Under…

Methodology · Statistics 2026-05-21 Martin Bladt , Rasmus Frigaard Lemvig

Autoencoders exhibit impressive abilities to embed the data manifold into a low-dimensional latent space, making them a staple of representation learning methods. However, without explicit supervision, which is often unavailable, the…

Machine Learning · Computer Science 2023-01-12 Felix Leeb , Stefan Bauer , Michel Besserve , Bernhard Schölkopf

The algorithm "automated compression of environments" (ACE) [Nat. Phys. 18, 662 (2022)] provides a versatile way of simulating an extremely broad class of open quantum systems. This is achieved by encapsulating the influence of the…

Quantum Physics · Physics 2025-05-01 Moritz Cygorek , Brendon W. Lovett , Jonathan Keeling , Erik M. Gauger

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been…

Fluid Dynamics · Physics 2022-10-18 Alberto Olmo , Ahmed Zamzam , Andrew Glaws , Ryan King