English
Related papers

Related papers: Ensemble Neural Networks (ENN): A gradient-free st…

200 papers

Machine learning qualifies computers to assimilate with data, without being solely programmed [1, 2]. Machine learning can be classified as supervised and unsupervised learning. In supervised learning, computers learn an objective that…

Deep learning approaches such as convolutional neural nets have consistently outperformed previous methods on challenging tasks such as dense, semantic segmentation. However, the various proposed networks perform differently, with behaviour…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Konstantinos Kamnitsas , Wenjia Bai , Enzo Ferrante , Steven McDonagh , Matthew Sinclair , Nick Pawlowski , Martin Rajchl , Matthew Lee , Bernhard Kainz , Daniel Rueckert , Ben Glocker

This work proposes ensemble Kalman randomized maximum likelihood estimation, a new derivative-free method for performing randomized maximum likelihood estimation, which is a method that can be used to generate approximate samples from…

Numerical Analysis · Mathematics 2025-07-08 Pavlos Stavrinides , Elizabeth Qian

Extreme learning machine (ELM) is an extremely fast learning method and has a powerful performance for pattern recognition tasks proven by enormous researches and engineers. However, its good generalization ability is built on large numbers…

Machine Learning · Computer Science 2015-02-05 Wentao Zhu , Jun Miao , Laiyun Qing

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

Expectation maximisation (EM) is an unsupervised learning method for estimating the parameters of a finite mixture distribution. It works by introducing "hidden" or "latent" variables via Baum's auxiliary function $Q$ that allow the joint…

Machine Learning · Computer Science 2022-05-19 Graham W. Pulford

Convolutional Neural Networks (CNNs) have shown remarkable performance in general object recognition tasks. In this paper, we propose a new model called EnsNet which is composed of one base CNN and multiple Fully Connected SubNetworks…

Machine Learning · Computer Science 2023-07-19 Daiki Hirata , Norikazu Takahashi

Recent advancements in low-cost ensemble learning have demonstrated improved efficiency for image classification. However, the existing low-cost ensemble methods show relatively lower accuracy compared to conventional ensemble learning. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hojung Lee , Jong-Seok Lee

The existence of adversarial examples underscores the importance of understanding the robustness of machine learning models. Bayesian neural networks (BNNs), due to their calibrated uncertainty, have been shown to posses favorable…

Machine Learning · Computer Science 2020-12-24 Matthew Yuan , Matthew Wicker , Luca Laurenti

In this paper, we propose the exponential Levy neural network (ELNN) for option pricing, which is a new non-parametric exponential Levy model using artificial neural networks (ANN). The ELNN fully integrates the ANNs with the exponential…

Pricing of Securities · Quantitative Finance 2018-09-18 Jeonggyu Huh

Training an energy-based model (EBM) with maximum likelihood is challenging due to the intractable normalisation constant. Traditional methods rely on expensive Markov chain Monte Carlo (MCMC) sampling to estimate the gradient of logartihm…

Machine Learning · Computer Science 2025-03-11 Hugo Senetaire , Paul Jeha , Pierre-Alexandre Mattei , Jes Frellsen

Learning in uncertain, noisy, or adversarial environments is a challenging task for deep neural networks (DNNs). We propose a new theoretically grounded and efficient approach for robust learning that builds upon Bayesian estimation and…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya , Lyudmila Mihaylova

This paper presents a novel probabilistic forecasting method called ensemble conformalized quantile regression (EnCQR). EnCQR constructs distribution-free and approximately marginally valid prediction intervals (PIs), which are suitable for…

Machine Learning · Computer Science 2022-11-08 Vilde Jensen , Filippo Maria Bianchi , Stian Norman Anfinsen

Dropout and similar stochastic neural network regularization methods are often interpreted as implicitly averaging over a large ensemble of models. We propose STE (stochastically trained ensemble) layers, which enhance the averaging…

Machine Learning · Computer Science 2019-11-22 Alex Labach , Shahrokh Valaee

Expectation maximization (EM) algorithm is to find maximum likelihood solution for models having latent variables. A typical example is Gaussian Mixture Model (GMM) which requires Gaussian assumption, however, natural images are highly…

Machine Learning · Computer Science 2018-12-04 Wentian Zhao , Shaojie Wang , Zhihuai Xie , Jing Shi , Chenliang Xu

Evolving Cascade Neural Networks (ECNNs) and a new training algorithm capable of selecting informative features are described. The ECNN initially learns with one input node and then evolves by adding new inputs as well as new hidden…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Vitaly Schetinin

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as…

Machine Learning · Statistics 2016-12-07 Tan Nguyen , Wanjia Liu , Ethan Perez , Richard G. Baraniuk , Ankit B. Patel

Traditional deep neural networks (NNs) have significantly contributed to the state-of-the-art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data…

Machine Learning · Computer Science 2021-05-05 Yibo Hu , Yuzhe Ou , Xujiang Zhao , Jin-Hee Cho , Feng Chen

With the maturation of quantum computing technology, research has gradually shifted towards exploring its applications. Alongside the rise of artificial intelligence, various machine learning methods have been developed into quantum…

Quantum Physics · Physics 2025-03-14 Abel C. H. Chen

We introduce a methodology for designing and training deep neural networks (DNN) that we call "Deep Regression Ensembles" (DRE). It bridges the gap between DNN and two-layer neural networks trained with random feature regression. Each layer…

Machine Learning · Statistics 2022-03-11 Antoine Didisheim , Bryan Kelly , Semyon Malamud