English
Related papers

Related papers: Boosted Ensemble Learning based on Randomized NNs …

200 papers

Ensemble learning is a popular technique to improve the accuracy of machine learning models. It traditionally hinges on the rationale that aggregating multiple weak models can lead to better models with lower variance and hence higher…

Optimization and Control · Mathematics 2026-01-06 Huajie Qian , Donghao Ying , Henry Lam , Wotao Yin

Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based methods such as DeepAr,…

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

Machine Learning · Computer Science 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko

Machine Reading Comprehension (MRC) is an active field in natural language processing with many successful developed models in recent years. Despite their high in-distribution accuracy, these models suffer from two issues: high training…

Computation and Language · Computer Science 2021-07-16 Razieh Baradaran , Hossein Amirkhani

Convolutional Neural Networks have achieved state-of-the-art performance on a wide range of tasks. Most benchmarks are led by ensembles of these powerful learners, but ensembling is typically treated as a post-hoc procedure implemented by…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Stefan Lee , Senthil Purushwalkam , Michael Cogswell , David Crandall , Dhruv Batra

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

Quantifying uncertainty in weather forecasts is critical, especially for predicting extreme weather events. This is typically accomplished with ensemble prediction systems, which consist of many perturbed numerical weather simulations, or…

Machine Learning · Computer Science 2021-03-17 Peter Grönquist , Chengyuan Yao , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Shigang Li , Torsten Hoefler

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

Ensembles, where multiple neural networks are trained individually and their predictions are averaged, have been shown to be widely successful for improving both the accuracy and predictive uncertainty of single neural networks. However, an…

Machine Learning · Computer Science 2020-02-21 Yeming Wen , Dustin Tran , Jimmy Ba

Amounts of historical data collected increase and business intelligence applicability with automatic forecasting of time series are in high demand. While no single time series modeling method is universal to all types of dynamics,…

Machine Learning · Statistics 2022-04-18 Evaldas Vaiciukynas , Paulius Danenas , Vilius Kontrimas , Rimantas Butleris

Deep Neural Networks (DNNs) have become increasingly popular in computer vision, natural language processing, and other areas. However, training and fine-tuning a deep learning model is computationally intensive and time-consuming. We…

Machine Learning · Computer Science 2018-07-04 Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

Artificial Intelligence · Computer Science 2023-04-07 Neelesh Mungoli

An approach to evolutionary ensemble learning for classification is proposed in which boosting is used to construct a stack of programs. Each application of boosting identifies a single champion and a residual dataset, i.e. the training…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Zhilei Zhou , Ziyu Qiu , Brad Niblett , Andrew Johnston , Jeffrey Schwartzentruber , Nur Zincir-Heywood , Malcolm Heywood

Ensemble prediction systems are an invaluable tool for weather forecasting. Practically, ensemble predictions are obtained by running several perturbations of the deterministic control forecast. However, ensemble prediction is associated…

Machine Learning · Computer Science 2023-02-22 Rüdiger Brecht , Alex Bihlo

This paper addresses the problem of short-term traffic prediction for signalized traffic operations management. Specifically, we focus on predicting sensor states in high-resolution (second-by-second). This contrasts with traditional…

Optimization and Control · Mathematics 2022-04-12 Wenqing Li , Chuhan Yang , Saif Eddin Jabari

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

Neural network ensembles, such as Bayesian neural networks (BNNs), have shown success in the areas of uncertainty estimation and robustness. However, a crucial challenge prohibits their use in practice. BNNs require a large number of…

Machine Learning · Computer Science 2022-07-15 Namuk Park , Songkuk Kim