English
Related papers

Related papers: A General Framework for Hypercomplex-valued Extrem…

200 papers

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

Despite the number of successful applications of the Extreme Learning Machine (ELM), we show that its underlying foundational principles do not have a rigorous mathematical justification. Specifically, we refute the proofs of two main…

Machine Learning · Computer Science 2024-06-26 Irina Perfilievaa , Nicolas Madrid , Manuel Ojeda-Aciego , Piotr Artiemjew , Agnieszka Niemczynowicz

The extreme learning machine (ELM) method can yield highly accurate solutions to linear/nonlinear partial differential equations (PDEs), but requires the last hidden layer of the neural network to be wide to achieve a high accuracy. If the…

Numerical Analysis · Mathematics 2022-05-17 Naxian Ni , Suchuan Dong

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

Optimization and Control · Mathematics 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

ELM (Extreme Learning Machine) is a single hidden layer feed-forward network, where the weights between input and hidden layer are initialized randomly. ELM is efficient due to its utilization of the analytical approach to compute weights…

Machine Learning · Computer Science 2016-06-21 Qiuyan Yan , Qifa Sun , Xinming Yan

Hypercomplex algebras have recently been gaining prominence in the field of deep learning owing to the advantages of their division algebras over real vector spaces and their superior results when dealing with multidimensional signals in…

Machine Learning · Computer Science 2024-05-14 Danilo Comminiello , Eleonora Grassucci , Danilo P. Mandic , Aurelio Uncini

A fully tensorial theoretical framework for hypercomplex-valued neural networks is presented. The proposed approach enables neural network architectures to operate on data defined over arbitrary finite-dimensional algebras. The central…

Machine Learning · Computer Science 2026-01-27 Agnieszka Niemczynowicz , Radosław Antoni Kycia

Efficient and accurate joint representation of a collection of images, that belong to the same class, is a major research challenge for practical image set classification. Existing methods either make prior assumptions about the data…

Computer Vision and Pattern Recognition · Computer Science 2015-04-02 Muhammad Uzair , Faisal Shafait , Bernard Ghanem , Ajmal Mian

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

In this paper we examine learning methods combining the Random Neural Network, a biologically inspired neural network and the Extreme Learning Machine that achieve state of the art classification performance while requiring much shorter…

Neural and Evolutionary Computing · Computer Science 2016-09-27 Athanasios Vlontzos

An extreme learning machine (ELM) is a three-layered feed-forward neural network having untrained parameters, which are randomly determined before training. Inspired by the idea of ELM, a probabilistic untrained layer called a…

Machine Learning · Computer Science 2022-10-28 Yuri Kanno , Muneki Yasuda

This paper is concerned with the sparsification of the input-hidden weights of ELM (Extreme Learning Machine). For ordinary feedforward neural networks, the sparsification is usually done by introducing certain regularization technique into…

Machine Learning · Computer Science 2018-01-23 Feng Li , Sibo Yang , Huanhuan Huang , Wei Wu

Extreme Learning Machine (ELM) is an emerging learning paradigm for nonlinear regression problems and has shown its effectiveness in the machine learning community. An important feature of ELM is that the learning speed is extremely fast…

Systems and Control · Computer Science 2012-11-08 Vijay Manikandan Janakiraman , Dennis Assanis

The inverse-free extreme learning machine (ELM) algorithm proposed in [4] was based on an inverse-free algorithm to compute the regularized pseudo-inverse, which was deduced from an inverse-free recursive algorithm to update the inverse of…

Machine Learning · Computer Science 2019-11-13 Hufei Zhu , Chenghao Wei

Random functional-linked types of neural networks (RFLNNs), e.g., the extreme learning machine (ELM) and broad learning system (BLS), which avoid suffering from a time-consuming training process, offer an alternative way of learning in deep…

Machine Learning · Computer Science 2023-04-04 Guang-Yong Chen , Yong-Hang Yu , Min Gan , C. L. Philip Chen , Wenzhong Guo

The phenomena of Spectral Bias, where the higher frequency components of a function being learnt in a feedforward Artificial Neural Network (ANN) are seen to converge more slowly than the lower frequencies, is observed ubiquitously across…

Machine Learning · Computer Science 2023-07-20 Kaumudi Joshi , Vukka Snigdha , Arya Kumar Bhattacharya

We present a neural network-based method for solving linear and nonlinear partial differential equations, by combining the ideas of extreme learning machines (ELM), domain decomposition and local neural networks. The field solution on each…

Numerical Analysis · Mathematics 2021-09-22 Suchuan Dong , Zongwei Li

Representation learning is currently a very hot topic in modern machine learning, mostly due to the great success of the deep learning methods. In particular low-dimensional representation which discriminates classes can not only enhance…

Machine Learning · Computer Science 2015-04-13 Wojciech Marian Czarnecki , Rafał Józefowicz , Jacek Tabor

The goal of this paper is to test three classes of neural network (NN) architectures based on four-dimensional (4D) hypercomplex algebras for time series prediction. We evaluate different architectures, varying the input layers to include…

Neural and Evolutionary Computing · Computer Science 2024-02-14 Radosław Kycia , Agnieszka Niemczynowicz

In this paper, an Extreme Learning Machine (ELM) based technique for Multi-label classification problems is proposed and discussed. In multi-label classification, each of the input data samples belongs to one or more than one class labels.…

Machine Learning · Computer Science 2016-09-06 Rajasekar Venkatesan , Meng Joo Er