English
Related papers

Related papers: Deep Neural Networks Guided Ensemble Learning for …

200 papers

Current deep neural networks suffer from two problems; first, they are hard to interpret, and second, they suffer from overfitting. There have been many attempts to define interpretability in neural networks, but they typically lack…

Machine Learning · Computer Science 2019-08-15 Sean Tao

This paper demonstrates how to construct ensembles of spiking neural networks producing state-of-the-art results, achieving classification accuracies of 98.71%, 100.0%, and 99.09%, on the MNIST, NMNIST and DVS Gesture datasets respectively.…

Neural and Evolutionary Computing · Computer Science 2021-09-07 Georgiana Neculae , Oliver Rhodes , Gavin Brown

Continual learning with an increasing number of classes is a challenging task. The difficulty rises when each example is presented exactly once, which requires the model to learn online. Recent methods with classic parameter optimization…

Machine Learning · Computer Science 2023-08-22 Mateusz Wójcik , Witold Kościukiewicz , Tomasz Kajdanowicz , Adam Gonczarek

Recent advances in both theory and methods have created opportunities to simulate biomolecular processes more efficiently using adaptive ensemble simulations. Ensemble-based simulations are used widely to compute a number of individual…

Computational Engineering, Finance, and Science · Computer Science 2020-09-14 Vivek Balasubramanian , Travis Jensen , Matteo Turilli , Peter Kasson , Michael Shirts , Shantenu Jha

Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on…

Econometrics · Economics 2022-11-16 Qizhao Chen , Vasilis Syrgkanis , Morgane Austern

Objective: This paper investigates the potential of ensemble learning for variants of adjustment methods used in analogy-based effort estimation. The number k of analogies to be used is also investigated. Method We perform a large scale…

Software Engineering · Computer Science 2017-03-20 Mohammad Azzeh , Ali Bou Nassif , Leandro L Minku

Deep Neural Networks (DNN's) are a widely-used solution for a variety of machine learning problems. However, it is often necessary to invest a significant amount of a data scientist's time to pre-process input data, test different neural…

Machine Learning · Computer Science 2022-05-27 Anish Thite , Mohan Dodda , Pulak Agarwal , Jason Zutty

Graph matching is a commonly used technique in computer vision and pattern recognition. Recent data-driven approaches have improved the graph matching accuracy remarkably, whereas some traditional algorithm-based methods are more robust to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haoru Tan , Chuang Wang , Sitong Wu , Xu-Yao Zhang , Fei Yin , Cheng-Lin Liu

Ensemble modeling has been widely used to solve complex problems as it helps to improve overall performance and generalization. In this paper, we propose a novel TemporalAugmenter approach based on ensemble modeling for augmenting the…

Machine Learning · Computer Science 2024-01-17 Nelly Elsayed , Constantinos L. Zekios , Navid Asadizanjani , Zag ElSayed

We investigate an algorithm named histogram transform ensembles (HTE) density estimator whose effectiveness is supported by both solid theoretical analysis and significant experimental performance. On the theoretical side, by decomposing…

Statistics Theory · Mathematics 2019-11-27 Hanyuan Hang

A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The…

Machine Learning · Computer Science 2015-09-25 Craig Wilson , Venugopal V. Veeravalli

Machine learning techniques always aim to reduce the generalized prediction error. In order to reduce it, ensemble methods present a good approach combining several models that results in a greater forecasting capacity. The Random Machines…

Machine Learning · Statistics 2020-03-31 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

Autonomous driving depends on perception systems to understand the environment and to inform downstream decision-making. While advanced perception systems utilizing black-box Deep Neural Networks (DNNs) demonstrate human-like comprehension,…

Artificial Intelligence · Computer Science 2024-03-26 Xiao Li , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

Deep Ensembles, as a type of Bayesian Neural Networks, can be used to estimate uncertainty on the prediction of multiple neural networks by collecting votes from each network and computing the difference in those predictions. In this paper,…

Machine Learning · Computer Science 2023-07-10 Illia Oleksiienko , Alexandros Iosifidis

Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Kashyap Chitta , Jose M. Alvarez , Adam Lesnikowski

Ensemble methods have played a crucial role in achieving state-of-the-art (SOTA) performance across various machine learning tasks by leveraging the diversity of features learned by individual models. In Time Series Classification (TSC),…

Machine Learning · Computer Science 2026-02-10 Javidan Abdullayev , Maxime Devanne , Cyril Meyer , Ali Ismail-Fawaz , Jonathan Weber , Germain Forestier

Estimating causal effects from observational data informs us about which factors are important in an autonomous system, and enables us to take better decisions. This is important because it has applications in selecting a treatment in…

Machine Learning · Computer Science 2021-10-29 Plabon Shaha , Talha Islam Zadid , Ismat Rahman , Md. Mosaddek Khan

This study designs an adaptive experiment for efficiently estimating average treatment effects (ATEs). In each round of our adaptive experiment, an experimenter sequentially samples an experimental unit, assigns a treatment, and observes…

Methodology · Statistics 2024-06-21 Masahiro Kato , Akihiro Oga , Wataru Komatsubara , Ryo Inokuchi

Estimation of the Average Treatment Effect (ATE) is often carried out in 2 steps, wherein the first step, the treatment and outcome are modeled, and in the second step the predictions are inserted into the ATE estimator. In the first steps,…

Methodology · Statistics 2023-07-21 Mehdi Rostami , Olli Saarela

We analyze an online learning algorithm that adaptively combines outputs of two constituent algorithms (or the experts) running in parallel to model an unknown desired signal. This online learning algorithm is shown to achieve (and in some…

Machine Learning · Computer Science 2012-10-01 Mehmet A. Donmez , Sait Tunc , Suleyman S. Kozat