English
Related papers

Related papers: Algorithmically Designed Artificial Neural Network…

200 papers

We investigate methods for learning partial differential equation (PDE) models from spatiotemporal data under biologically realistic levels and forms of noise. Recent progress in learning PDEs from data have used sparse regression to select…

Dynamical Systems · Mathematics 2021-04-28 John Lagergren , John T. Nardini , G. Michael Lavigne , Erica M. Rutter , Kevin B. Flores

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Artificial neural networks (ANNs) have been successfully applied to solve a variety of classification and function approximation problems. Although ANNs can generally predict better than decision trees for pattern classification problems,…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Md. Monirul Islam

We introduce an Artificial Neural Network (ANN) quantization methodology for platforms without wide accumulation registers. This enables fixed-point model deployment on embedded compute platforms that are not specifically designed for large…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Barry de Bruin , Zoran Zivkovic , Henk Corporaal

Artificial neural networks (ANNs) have very successfully been used in numerical simulations for a series of computational problems ranging from image classification/image recognition, speech recognition, time series analysis, game…

Numerical Analysis · Mathematics 2023-08-02 Philipp Grohs , Fabian Hornung , Arnulf Jentzen , Philippe von Wurstemberger

Given an existing trained neural network, it is often desirable to learn new capabilities without hindering performance of those already learned. Existing approaches either learn sub-optimal solutions, require joint training, or incur a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Amir Rosenfeld , John K. Tsotsos

Deep neural networks (DNNs) are vulnerable to adversarial examples obtained by adding small perturbations to original examples. The added perturbations in existing attacks are mainly determined by the gradient of the loss function with…

Cryptography and Security · Computer Science 2023-06-06 Chen Wan , Fangjun Huang

Artificial Neural Networks (ANNs) became popular due to their successful application difficult problems such image and speech recognition. However, when practitioners want to design an ANN they need to undergo laborious process of selecting…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Pedro Carvalho , Nuno Lourenço , Penousal Machado

This paper establishes an approximation theorem for randomized neural networks (RaNNs) whose hidden-layer parameters are uniformly sampled from a prescribed bounded domain. Our analysis shows that, for RaNNs of the form $\mathop{\sum}_i W_i…

Numerical Analysis · Mathematics 2026-04-13 Ran Bi , Weibing Deng

Traditionally, an artificial neural network (ANN) is trained slowly by a gradient descent algorithm such as the backpropagation algorithm since a large number of hyperparameters of the ANN need to be fine-tuned with many training epochs. To…

Machine Learning · Computer Science 2020-01-27 Luna M. Zhang

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem…

Numerical Analysis · Mathematics 2023-02-10 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen , Benno Kuckuck

We present a numerical framework for deep neural network (DNN) modeling of unknown time-dependent partial differential equations (PDE) using their trajectory data. Unlike the recent work of [Wu and Xiu, J. Comput. Phys. 2020], where the…

Machine Learning · Computer Science 2021-11-24 Zhen Chen , Victor Churchill , Kailiang Wu , Dongbin Xiu

Physics-informed neural networks (PINNs) have recently emerged as an alternative way of solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In…

Analysis of PDEs · Mathematics 2019-09-04 Dongkun Zhang , Lu Lu , Ling Guo , George Em Karniadakis

The field of machine learning has taken a dramatic twist in recent times, with the rise of the Artificial Neural Network (ANN). These biologically inspired computational models are able to far exceed the performance of previous forms of…

Neural and Evolutionary Computing · Computer Science 2015-12-03 Keiron O'Shea , Ryan Nash

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Automated neural network design has received ever-increasing attention with the evolution of deep convolutional neural networks (CNNs), especially involving their deployment on embedded and mobile platforms. One of the biggest problems that…

Machine Learning · Computer Science 2021-03-04 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Spectral methods employing non-standard polynomial bases, such as M\"untz polynomials, have proven effective for accurately solving problems with solutions exhibiting low regularity, notably including sub-diffusion equations. However, due…

Numerical Analysis · Mathematics 2025-05-22 Wei Zeng , Chuanju Xu , Yiming Lu , Qian Wang

In the present paper a newer application of Artificial Neural Network (ANN) has been developed i.e., predicting response-function results of electrical-mechanical system through ANN. This method is specially useful to complex systems for…

Neural and Evolutionary Computing · Computer Science 2011-11-09 R. C. Gupta , Ankur Agarwal , Ruchi Gupta , Sanjay Gupta