English
Related papers

Related papers: On Computing the Hyperparameter of Extreme Learnin…

200 papers

In this paper, we consider a class of finite-sum convex optimization problems defined over a distributed multiagent network with $m$ agents connected to a central server. In particular, the objective function consists of the average of $m$…

Optimization and Control · Mathematics 2017-11-17 Guanghui Lan , Yi Zhou

We compare the Finite Element Method (FEM) simulation of a standard Partial Differential Equation thermal problem of a plate with a hole with a Neural Network (NN) simulation. The largest deviation from the true solution obtained from FEM…

Computational Engineering, Finance, and Science · Computer Science 2022-04-11 Andrea Sacchetti , Benjamin Bachmann , Kaspar Löffel , Urs-Martin Künzi , Beatrice Paoli

The family of Expectation-Maximization (EM) algorithms provides a general approach to fitting flexible models for large and complex data. The expectation (E) step of EM-type algorithms is time-consuming in massive data applications because…

Computation · Statistics 2018-06-21 Sanvesh Srivastava , Glen DePalma , Chuanhai Liu

Machine Learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption by the level of trust that models afford users. Human vs. machine performance…

In this paper, based on the combination of finite element mesh and neural network, a novel type of neural network element space and corresponding machine learning method are designed for solving partial differential equations. The…

Numerical Analysis · Mathematics 2025-04-24 Yifan Wang , Zhongshuo Lin , Hehu Xie

Combinatorial optimization problems are notoriously challenging due to their discrete structure and exponentially large solution space. Recent advances in deep reinforcement learning (DRL) have enabled the learning heuristics directly from…

Machine Learning · Computer Science 2025-06-12 Shengda Gu , Kai Li , Junliang Xing , Yifan Zhang , Jian Cheng

Domain-decomposed variants of physics-informed neural networks (PINNs) such as finite basis PINNs (FBPINNs) mitigate some of PINNs' issues like slow convergence and spectral bias through localisation, but still rely on iterative nonlinear…

Numerical Analysis · Mathematics 2026-05-20 Samuel Anderson , Victorita Dolean , Ben Moseley , Jennifer Pestana

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

Machine Learning · Computer Science 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

Uncertainty quantification is crucial to assess prediction quality of a machine learning model. In the case of Extreme Learning Machines (ELM), most methods proposed in the literature make strong assumptions on the data, ignore the…

Machine Learning · Statistics 2020-11-04 Fabian Guignard , Federico Amato , Mikhail Kanevski

In this work, two machine learning (ML)-based structures for joint detection-channel estimation in OFDM systems are proposed and extensively characterized. Both ML architectures, namely Deep Neural Network (DNN) and Extreme Learning Machine…

Information Theory · Computer Science 2023-04-25 Wilson de Souza Junior , Taufik Abrao

Short-term traffic volume prediction models have been extensively studied in the past few decades. However, most of the previous studies only focus on single-value prediction. Considering the uncertain and chaotic nature of the…

Neural and Evolutionary Computing · Computer Science 2017-11-15 Lei Lin , John Handley , Adel Sadek

Partial-differential-equation (PDE)-constrained optimization is a well-worn technique for acquiring optimal parameters of systems governed by PDEs. However, this approach is limited to providing a single set of optimal parameters per…

Computational Physics · Physics 2024-10-17 Archis S. Joglekar

Preference optimization, particularly through Reinforcement Learning from Human Feedback (RLHF), has achieved significant success in aligning Large Language Models (LLMs) to adhere to human intentions. Unlike offline alignment with a fixed…

Machine Learning · Computer Science 2024-11-06 Shenao Zhang , Donghan Yu , Hiteshi Sharma , Han Zhong , Zhihan Liu , Ziyi Yang , Shuohang Wang , Hany Hassan , Zhaoran Wang

Kernel extreme learning machine (KELM) is a novel feedforward neural network, which is widely used in classification problems. To some extent, it solves the existing problems of the invalid nodes and the large computational complexity in…

Machine Learning · Computer Science 2019-03-14 Jie Wang , Yi-Fan Song , Tian-Lei Ma

Channel interpolation is an essential technique for providing high-accuracy estimation of the channel state information (CSI) for wireless systems design where the frequency-space structural correlations of multi-antenna channel are…

Signal Processing · Electrical Eng. & Systems 2019-05-21 Han Zhang , Bo Ai , Wenjun Xu , Li Xu , Shuguang Cui

In this work, we present a study combining two approaches in the context of solving PDEs: the continuous finite element method (FEM) and more recent techniques based on neural networks. In recent years, physics-informed neural networks…

We show that an optimal finite element mesh refinement algorithm for a prototypical elliptic PDE can be learned by a recurrent neural network with a fixed number of trainable parameters independent of the desired accuracy and the input…

Numerical Analysis · Mathematics 2020-08-10 Jan Bohn , Michael Feischl

Recurrent neural networks (RNN) have been successfully applied to various sequential decision-making tasks, natural language processing applications, and time-series predictions. Such networks are usually trained through back-propagation…

Machine Learning · Computer Science 2019-12-02 Julia El Zini , Yara Rizk , Mariette Awad

A new optimized extreme learning machine- (ELM-) based method for power system transient stability prediction (TSP) using synchrophasors is presented in this paper. First, the input features symbolizing the transient stability of power…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Yanjun Zhang , Tie Li , Guangyu Na , Guoqing Li , Yang Li

Efficient and accurate joint representation of a collection of images, that belong to the same class, is a major research challenge for practical image set classification. Existing methods either make prior assumptions about the data…

Computer Vision and Pattern Recognition · Computer Science 2015-04-02 Muhammad Uzair , Faisal Shafait , Bernard Ghanem , Ajmal Mian