English
Related papers

Related papers: Classification by Ensembles of Neural Networks

200 papers

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

We present a new algorithm for learning unknown governing equations from trajectory data, using and ensemble of neural networks. Given samples of solutions $x(t)$ to an unknown dynamical system $\dot{x}(t)=f(t,x(t))$, we approximate the…

Machine Learning · Computer Science 2021-10-19 Elisa Negrini , Giovanna Citti , Luca Capogna

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

Traditional machine learning approaches assume that data comes from a single generating mechanism, which may not hold for most real life data. In these cases, the single mechanism assumption can result in suboptimal performance. We…

Machine Learning · Computer Science 2025-01-31 Mehmet Efe Lorasdagi , Ahmet Berker Koc , Ali Taha Koc , Suleyman Serdar Kozat

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

A typical deep neural network (DNN) has a large number of trainable parameters. Choosing a network with proper capacity is challenging and generally a larger network with excessive capacity is trained. Pruning is an established approach to…

Neural and Evolutionary Computing · Computer Science 2021-03-01 Hojjat Salehinejad , Shahrokh Valaee

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

In this article, we propose the approach to procedural optimization of a neural network, based on the combination of information theory and braid theory. The network studied in the article implemented with the intersections between the…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Olga Lukyanova , Oleg Nikitin , Alex Kunin

Linear Regression and neural networks are widely used to model data. Neural networks distinguish themselves from linear regression with their use of activation functions that enable modeling nonlinear functions. The standard argument for…

Machine Learning · Computer Science 2024-01-02 Anish Lakkapragada

We develop a novel optical neural network (ONN) framework which introduces a degree of scalar invariance to image classification estima- tion. Taking a hint from the human eye, which has higher resolution near the center of the retina,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Grant Fennessy , Yevgeniy Vorobeychik

Graph matching is a commonly used technique in computer vision and pattern recognition. Recent data-driven approaches have improved the graph matching accuracy remarkably, whereas some traditional algorithm-based methods are more robust to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haoru Tan , Chuang Wang , Sitong Wu , Xu-Yao Zhang , Fei Yin , Cheng-Lin Liu

Ensemble learning is a technique where multiple component learners are combined through a protocol. We propose an Ensemble Neural Network (ENN) that uses the combined latent-feature space of multiple neural network classifiers to improve…

High Energy Physics - Phenomenology · Physics 2021-05-06 Jack Y. Araz , Michael Spannowsky

Improving model performance is always the key problem in machine learning including deep learning. However, stand-alone neural networks always suffer from marginal effect when stacking more layers. At the same time, ensemble is an useful…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Yuan Gao , Zixiang Cai , Lei Yu

Neuronal ensemble inference is one of the significant problems in the study of biological neural networks. Various methods have been proposed for ensemble inference from their activity data taken experimentally. Here we focus on Bayesian…

Disordered Systems and Neural Networks · Physics 2020-03-30 Shun Kimura , Koujin Takeda

We proposed a framework for solving inverse problems in differential equations based on neural networks and automatic differentiation. Neural networks are used to approximate hidden fields. We analyze the source of errors in the framework…

Numerical Analysis · Mathematics 2024-12-20 Kailai Xu , Eric Darve

It is impossible today to pretend that the practice of machine learning is always compatible with the idea that training and testing data follow the same distribution. Several authors have recently used ensemble techniques to show how…

Machine Learning · Computer Science 2025-03-03 Jianyu Zhang , Léon Bottou

Animals perform near-optimal probabilistic inference in a wide range of psychophysical tasks. Probabilistic inference requires trial-to-trial representation of the uncertainties associated with task variables and subsequent use of this…

Neurons and Cognition · Quantitative Biology 2017-04-25 A. Emin Orhan , Wei Ji Ma

Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long time prediction of the evolution of the unknown system. Training a DNN with low…

Machine Learning · Computer Science 2022-12-28 Victor Churchill , Steve Manns , Zhen Chen , Dongbin Xiu

Artificial neural networks have advanced due to scaling dimensions, but conventional computing faces inefficiency due to the von Neumann bottleneck. In-memory computation architectures, like memristors, offer promise but face challenges due…