English
Related papers

Related papers: BF-APNN: A Low-Memory Method for Accelerating the …

200 papers

We introduce BumpNet, a sparse multilayer perceptron (MLP) framework for PDE numerical solution and operator learning. BumpNet is based on basis function expansion, which makes them superficially similar to radial-basis function (RBF)…

Machine Learning · Computer Science 2026-03-05 Shao-Ting Chiu , Ioannis G. Kevrekidis , Ulisses Braga-Neto

In this paper, an Artificial Neural Network (ANN) technique is developed to find solution of celebrated Fractional order Differential Equations (FDE). Compared to integer order differential equation, FDE has the advantage that it can better…

Analysis of PDEs · Mathematics 2018-10-15 Susmita Mall , S. Chakraverty

Accurately characterizing non-linear functional manifolds with singularities is a fundamental challenge in scientific computing. While Multi-Layer Perceptrons (MLPs) dominate, their spectral bias hinders resolving high-curvature features…

Machine Learning · Computer Science 2026-03-24 Chao Wang , Xuancheng Zhou , Ruilin Hou , Xiaoyu Cheng , Ruiyi Ding

Conventional numerical solvers for the radiative transfer equation (RTE) exhibit severe sensitivity to medium parameters. To address this, we propose an operator learning framework that approximates the RTE solution map as a function of…

Numerical Analysis · Mathematics 2026-04-28 Qinchen Song , Xinliang Liu , Lei Zhang

Deep complex-valued neural networks (CVNNs) provide a powerful way to leverage complex number operations and representations and have succeeded in several phase-based applications. However, previous networks have not fully explored the…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Yanting Yang , Yiren Zhang , Zongyu Li , Jeffery Siyuan Tian , Matthieu Dagommer , Jia Guo

Recurrent Neural Networks (RNNs) are a key technology for applications such as automatic speech recognition or machine translation. Unlike conventional feed-forward DNNs, RNNs remember past information to improve the accuracy of future…

Neural and Evolutionary Computing · Computer Science 2022-02-16 Franyell Silfa , Jose-Maria Arnau , Antonio González

Active learning optimizes the exploration of large parameter spaces by strategically selecting which experiments or simulations to conduct, thus reducing resource consumption and potentially accelerating scientific discovery. A key…

Machine Learning · Computer Science 2024-05-20 Maxim Ziatdinov

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Recurrent Neural Networks (RNNs) are powerful sequence modeling tools. However, when dealing with high dimensional inputs, the training of RNNs becomes computational expensive due to the large number of model parameters. This hinders RNNs…

Machine Learning · Computer Science 2018-05-23 Jinmian Ye , Linnan Wang , Guangxi Li , Di Chen , Shandian Zhe , Xinqi Chu , Zenglin Xu

Randomized neural network (RaNN) methods have been proposed for solving various partial differential equations (PDEs), demonstrating high accuracy and efficiency. However, initializing the fixed parameters remains challenging. Additionally,…

Numerical Analysis · Mathematics 2025-11-25 Haoning Dang , Fei Wang , Song Jiang

Binary neural network (BNN) is an extreme quantization version of convolutional neural networks (CNNs) with all features and weights mapped to just 1-bit. Although BNN saves a lot of memory and computation demand to make CNN applicable on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xulong Shi , Zhi Qi , Jiaxuan Cai , Keqi Fu , Yaru Zhao , Zan Li , Xuanyu Liu , Hao Liu

Anomaly detection is a challenging problem in machine learning, and is even more so when dealing with instances that are captured in low-level, raw data representations without a well-behaved set of engineered features. The Radial Basis…

Machine Learning · Computer Science 2021-02-01 Mehran H. Z. Bazargani , Arjun Pakrashi , Brian Mac Namee

This paper proposes an Adaptive-Growth Randomized Neural Network (AG-RaNN) method for computing multivalued solutions of nonlinear first-order PDEs with hyperbolic characteristics, including quasilinear hyperbolic balance laws and…

Numerical Analysis · Mathematics 2026-03-03 Haoning Dang , Shi Jin , Fei Wang

While artificial neural networks are known as universal approximators for continuous functions, many modern approaches rely on overparameterized architectures with high computational cost. In this work, we introduce the Barycentric Neural…

Machine Learning · Computer Science 2025-10-10 Victor Toscano-Duran , Rocio Gonzalez-Diaz , Miguel A. Gutiérrez-Naranjo

In this paper, we propose a novel neural network approach, termed DeepRTE, to address the steady-state Radiative Transfer Equation (RTE). The RTE is a differential-integral equation that governs the propagation of radiation through a…

Machine Learning · Computer Science 2025-10-30 Yekun Zhu , Min Tang , Zheng Ma

Randomized neural networks (RaNNs) are attractive for partial differential equations (PDEs) because they replace expensive end-to-end training with a linear least-squares solve over randomized hidden features. Their practical performance,…

Numerical Analysis · Mathematics 2026-04-28 You Yang , Fei Wang

A simple yet effective architectural design of radial basis function neural networks (RBFNN) makes them amongst the most popular conventional neural networks. The current generation of radial basis function neural network is equipped with…

Machine Learning · Computer Science 2020-07-07 Syed Muhammad Atif , Shujaat Khan , Imran Naseem , Roberto Togneri , Mohammed Bennamoun

Phase-field models have been widely used to investigate the phase transformation phenomena. However, it is difficult to solve the problems numerically due to their strong nonlinearities and higher-order terms. This work is devoted to…

Numerical Analysis · Mathematics 2024-07-23 Gang Bao , Chang Ma , Yuxuan Gong

When investigating epidemic dynamics through differential models, the parameters needed to understand the phenomenon and to simulate forecast scenarios require a delicate calibration phase, often made even more challenging by the scarcity…

Numerical Analysis · Mathematics 2023-09-11 Giulia Bertaglia , Chuan Lu , Lorenzo Pareschi , Xueyu Zhu

We propose tensorial neural networks (TNNs), a generalization of existing neural networks by extending tensor operations on low order operands to those on high order ones. The problem of parameter learning is challenging, as it corresponds…

Machine Learning · Statistics 2018-12-11 Jiahao Su , Jingling Li , Bobby Bhattacharjee , Furong Huang