English
Related papers

Related papers: Evaluating the Effectiveness of Ensembles of Decis…

200 papers

Tree ensemble models like random forests and gradient boosting machines are widely used in machine learning due to their excellent predictive performance. However, a high-performance ensemble consisting of a large number of decision trees…

Machine Learning · Statistics 2024-10-28 Zebin Yang , Agus Sudjianto , Xiaoming Li , Aijun Zhang

An ensemble method should cleverly combine a group of base classifiers to yield an improved classifier. The majority vote is an example of a methodology used to combine classifiers in an ensemble method. In this paper, we propose to combine…

Machine Learning · Computer Science 2020-09-21 Rodolfo Anibal Lobo , Marcos Eduardo Valle

We present and empirically evaluate an efficient algorithm that learns to aggregate the predictions of an ensemble of binary classifiers. The algorithm uses the structure of the ensemble predictions on unlabeled data to yield significant…

Machine Learning · Computer Science 2015-11-12 Akshay Balsubramani , Yoav Freund

This paper describes the winning contribution to SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection (Subtask 2) handed in by team UG Student Intern. We present an ensemble model that makes predictions based on context-free…

Computation and Language · Computer Science 2020-10-07 Martin Pömsl , Roman Lyapin

We introduce SentEval, a toolkit for evaluating the quality of universal sentence representations. SentEval encompasses a variety of tasks, including binary and multi-class classification, natural language inference and sentence similarity.…

Computation and Language · Computer Science 2018-03-16 Alexis Conneau , Douwe Kiela

Decision trees and their ensembles are very popular models of supervised machine learning. In this paper we merge the ideas underlying decision trees, their ensembles and FCA by proposing a new supervised machine learning model which can be…

Machine Learning · Computer Science 2021-06-02 Egor Dudyrev , Sergei O. Kuznetsov

Ren et al. recently introduced a method for aggregating multiple decision trees into a strong predictor by interpreting a path taken by a sample down each tree as a binary vector and performing linear regression on top of these vectors…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Nenad Markuš , Ivan Gogić , Igor S. Pandžić , Jörgen Ahlberg

In lexical semantics, full-sentence segmentation and segment labeling of various phenomena are generally treated separately, despite their interdependence. We hypothesize that a unified lexical semantic recognition task is an effective way…

Computation and Language · Computer Science 2021-06-09 Nelson F. Liu , Daniel Hershcovich , Michael Kranzlein , Nathan Schneider

In this paper, we propose an attention-based classifier that predicts multiple emotions of a given sentence. Our model imitates human's two-step procedure of sentence understanding and it can effectively represent and classify sentences.…

Computation and Language · Computer Science 2018-04-18 Yanghoon Kim , Hwanhee Lee , Kyomin Jung

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

Stakeholders make various types of decisions with respect to requirements, design, management, and so on during the software development life cycle. Nevertheless, these decisions are typically not well documented and classified due to…

Software Engineering · Computer Science 2021-05-05 Liming Fu , Peng Liang , Xueying Li , Chen Yang

Despite recent advances in large language models, open-source models often struggle to consistently perform well on complex reasoning tasks. Existing ensemble methods, whether applied at the token or output levels, fail to address these…

Computation and Language · Computer Science 2024-12-23 Sungjin Park , Xiao Liu , Yeyun Gong , Edward Choi

Speech emotion recognition has evolved from research to practical applications. Previous studies of emotion recognition from speech have focused on developing models on certain datasets like IEMOCAP. The lack of data in the domain of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Bagus Tris Atmaja , Akira Sasou

In this paper, we address an issue of finding explainable clusters of class-uniform data in labelled datasets. The issue falls into the domain of interpretable supervised clustering. Unlike traditional clustering, supervised clustering aims…

Machine Learning · Computer Science 2023-07-18 Natallia Kokash , Leonid Makhnist

This study introduces an ensemble framework for unstructured text categorization using large language models (LLMs). By integrating multiple models, the ensemble large language model (eLLM) framework addresses common weaknesses of…

Artificial Intelligence · Computer Science 2025-11-21 Ariel Kamen , Yakov Kamen

The article describes an attempt to apply an ensemble of binary classifiers to solve the problem of speech assessment in medicine. A dataset was compiled based on quantitative and expert assessments of syllable pronunciation quality.…

Sound · Computer Science 2025-01-03 G. Belokrylov , A. Korenev , B. Lodonova , A. Novokhrestov

This paper presents six document classification models using the latest transformer encoders and a high-performing ensemble model for a task of offensive language identification in social media. For the individual models, deep transformer…

Computation and Language · Computer Science 2020-07-22 Xiangjue Dong , Jinho D. Choi

Online learning algorithms have become a ubiquitous tool in the machine learning toolbox and are frequently used in small, resource-constraint environments. Among the most successful online learning methods are Decision Tree (DT) ensembles.…

Machine Learning · Computer Science 2021-12-08 Sebastian Buschjäger , Sibylle Hess , Katharina Morik

A range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatical sentences with high accuracy. However, these studies are based primarily on monolingual evidence from English. To…

Computation and Language · Computer Science 2020-05-22 Aaron Mueller , Garrett Nicolai , Panayiota Petrou-Zeniou , Natalia Talmina , Tal Linzen

In this paper, we investigate the use of selectional restriction -- the constraints a predicate imposes on its arguments -- in a language model for speech recognition. We use an un-tagged corpus, followed by a public domain tagger and a…

cmp-lg · Computer Science 2008-02-03 Joerg P. Ueberla