English
Related papers

Related papers: Back To The Roots: Tree-Based Algorithms for Weakl…

200 papers

We propose a supervised anomaly detection method based on neural density estimators, where the negative log likelihood is used for the anomaly score. Density estimators have been widely used for unsupervised anomaly detection. By the recent…

Machine Learning · Statistics 2019-04-15 Tomoharu Iwata , Yuki Yamanaka

Gradient boosted trees are competition-winning, general-purpose, non-parametric regressors, which exploit sequential model fitting and gradient descent to minimize a specific loss function. The most popular implementations are tailored to…

Machine Learning · Computer Science 2022-08-23 Lorenzo Nespoli , Vasco Medici

Gradient boosted decision trees are a popular machine learning technique, in part because of their ability to give good accuracy with small models. We describe two extensions to the standard tree boosting algorithm designed to increase this…

Machine Learning · Statistics 2017-11-01 Natalia Ponomareva , Thomas Colthurst , Gilbert Hendry , Salem Haykal , Soroush Radpour

Anomaly detectors are often used to produce a ranked list of statistical anomalies, which are examined by human analysts in order to extract the actual anomalies of interest. Unfortunately, in realworld applications, this process can be…

Machine Learning · Computer Science 2017-09-01 Shubhomoy Das , Weng-Keen Wong , Alan Fern , Thomas G. Dietterich , Md Amran Siddiqui

We propose a robust method to identify anomalous jets by vetoing QCD-jets. The robustness of this method ensures that the distribution of the proposed discriminating variable (which allows us to veto QCD-jets) remains unaffected by the…

High Energy Physics - Phenomenology · Physics 2020-08-11 Tuhin S. Roy , Aravind H. Vijay

Gradient boosted decision trees are some of the most popular algorithms in applied machine learning. They are a flexible and powerful tool that can robustly fit to any tabular dataset in a scalable and computationally efficient way. One of…

Machine Learning · Computer Science 2023-01-26 Daniel de Marchi , Matthew Welch , Michael Kosorok

Often machine learning methods are applied and results reported in cases where there is little to no information concerning accuracy of the output. Simply because a computer program returns a result does not insure its validity. If…

Machine Learning · Statistics 2022-05-25 Jerome H. Friedman

In the real world, data is often noisy, affecting not only the quality of features but also the accuracy of labels. Current research on mitigating label errors stems primarily from advances in deep learning, and a gap exists in exploring…

Machine Learning · Computer Science 2024-05-29 Lukasz Sztukiewicz , Jack Henry Good , Artur Dubrawski

Tree-based models are widely recognized for their interpretability and have proven effective in various application domains, particularly in high-stakes domains. However, learning decision trees (DTs) poses a significant challenge due to…

Machine Learning · Computer Science 2026-03-13 Sascha Marton

Understanding sleep and activity patterns plays a crucial role in physical and mental health. This study introduces a novel approach for sleep detection using weakly supervised learning for scenarios where reliable ground truth labels are…

Machine Learning · Computer Science 2024-07-09 Matthias Boeker , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Hugo L. Hammer

Anomaly detection - identifying deviations from Standard Model predictions - is a key challenge at the Large Hadron Collider due to the size and complexity of its datasets. This is typically addressed by transforming high-dimensional…

High Energy Physics - Experiment · Physics 2025-12-03 Kyle Metzger , Lana Xu , Mia Sodini , Thea K. Arrestad , Katya Govorkova , Gaia Grosso , Philip Harris

Most classification algorithms used in high energy physics fall under the category of supervised machine learning. Such methods require a training set containing both signal and background events and are prone to classification errors…

Data Analysis, Statistics and Probability · Physics 2015-06-03 Mikael Kuusela , Tommi Vatanen , Eric Malmi , Tapani Raiko , Timo Aaltonen , Yoshikazu Nagai

In this work, a novel deep neural network, designed to enhance the efficiency and effectiveness of unsupervised sound anomaly detection, is presented. The proposed model exploits an attention module and separable convolutions to identify…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Michael Neri , Marco Carli

Gamma hadron classification, a central machine learning task in gamma ray astronomy, is conventionally tackled with supervised learning. However, the supervised approach requires annotated training data to be produced in sophisticated and…

Machine Learning · Computer Science 2021-08-31 Lukas Pfahler , Mirko Bunse , Katharina Morik

Interest in deep learning in collider physics has been growing in recent years, specifically in applying these methods in jet classification, anomaly detection, particle identification etc. Among those, jet classification using neural…

High Energy Physics - Phenomenology · Physics 2024-08-05 Camellia Bose , Amit Chakraborty , Shreecheta Chowdhury , Saunak Dutta

Neural networks have proved to be very robust at processing unstructured data like images, text, videos, and audio. However, it has been observed that their performance is not up to the mark in tabular data; hence tree-based models are…

Machine Learning · Computer Science 2022-04-25 Tushar Sarkar

Anomaly detection is referred to as a process in which the aim is to detect data points that follow a different pattern from the majority of data points. Anomaly detection methods suffer from several well-known challenges that hinder their…

Machine Learning · Computer Science 2021-08-31 Kasra Babaei , Zhi Yuan Chen , Tomas Maul

Pricing actuaries typically operate within the framework of generalized linear models (GLMs). With the upswing of data analytics, our study puts focus on machine learning methods to develop full tariff plans built from both the frequency…

Applications · Statistics 2020-03-04 Roel Henckaerts , Marie-Pier Côté , Katrien Antonio , Roel Verbelen

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

To understand how well a large language model captures certain semantic or syntactic features, researchers typically apply probing classifiers. However, the accuracy of these classifiers is critical for the correct interpretation of the…

Computation and Language · Computer Science 2023-12-19 Sergey A. Saltykov