English
Related papers

Related papers: Multi-scale Deep Neural Networks for Solving High …

200 papers

This paper introduces a directional multiscale algorithm for the two dimensional $N$-body problem of the Helmholtz kernel with applications to high frequency scattering. The algorithm follows the approach in [Engquist and Ying, SIAM Journal…

Numerical Analysis · Mathematics 2008-02-29 Björn Engquist , Lexing Ying

Multidimensional scaling is a statistical process that aims to embed high dimensional data into a lower-dimensional space; this process is often used for the purpose of data visualisation. Common multidimensional scaling algorithms tend to…

Machine Learning · Computer Science 2022-02-25 Pierre Lambert , Cyril de Bodt , Michel Verleysen , John Lee

Fractional and tempered fractional partial differential equations (PDEs) are effective models of long-range interactions, anomalous diffusion, and non-local effects. Traditional numerical methods for these problems are mesh-based, thus…

Numerical Analysis · Mathematics 2025-01-09 Zheyuan Hu , Kenji Kawaguchi , Zhongqiang Zhang , George Em Karniadakis

We propose a numerical method for solving high dimensional fully nonlinear partial differential equations (PDEs). Our algorithm estimates simultaneously by backward time induction the solution and its gradient by multi-layer neural…

Optimization and Control · Mathematics 2021-01-27 Huyen Pham , Xavier Warin , Maximilien Germain

In this review, we survey the latest approaches and techniques developed to overcome the spectral bias towards low frequency of deep neural network learning methods in learning multiple-frequency solutions of partial differential equations.…

Numerical Analysis · Mathematics 2025-01-20 Zhi-Qin John Xu , Lulu Zhang , Wei Cai

We introduce a deep residual recurrent neural network (DR-RNN) as an efficient model reduction technique for nonlinear dynamical systems. The developed DR-RNN is inspired by the iterative steps of line search methods in finding the residual…

Computational Engineering, Finance, and Science · Computer Science 2017-09-05 J. Nagoor Kani , Ahmed H. Elsheikh

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Methods based on convolutional neural network (CNN) have demonstrated tremendous improvements on single image super-resolution. However, the previous methods mainly restore images from one single area in the low resolution (LR) input, which…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Xiaoyi Jia , Xiangmin Xu , Bolun Cai , Kailing Guo

It is a challenging topic in applied mathematics to solve high-dimensional nonlinear partial differential equations (PDEs). Standard approximation methods for nonlinear PDEs suffer under the curse of dimensionality (COD) in the sense that…

Machine Learning · Computer Science 2024-06-18 Julia Ackermann , Arnulf Jentzen , Benno Kuckuck , Joshua Lee Padgett

Recently, deep convolutional neural networks (CNNs) have achieved many eye-catching results. However, deploying CNNs on resource-constrained edge devices is constrained by limited memory bandwidth for transmitting large intermediated data…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Yu-Shan Tai , Cheng-Yang Chang , Chieh-Fang Teng , AnYeu , Wu

Deep neural networks (DNNs) on Riemannian manifolds have garnered increasing interest in various applied areas. For instance, DNNs on spherical and hyperbolic manifolds have been designed to solve a wide range of computer vision and nature…

Machine Learning · Statistics 2026-01-06 Xuan Son Nguyen , Shuo Yang , Aymeric Histace

High-dimensional partial differential equations (PDE) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment (CVA) models, or portfolio optimization models. The PDEs in…

Numerical Analysis · Mathematics 2020-07-15 Christian Beck , Weinan E , Arnulf Jentzen

Most singer identification methods are processed in the frequency domain, which potentially leads to information loss during the spectral transformation. In this paper, instead of the frequency domain, we propose an end-to-end architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-24 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

A state-of-the-art deep domain decomposition method (D3M) based on the variational principle is proposed for partial differential equations (PDEs). The solution of PDEs can be formulated as the solution of a constrained optimization…

Machine Learning · Computer Science 2020-04-03 Ke Li , Kejun Tang , Tianfan Wu , Qifeng Liao

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

Machine Learning · Computer Science 2022-05-26 Wei Zhang , Yu Bao

We use Deep Operator Networks (DeepONets) to perform super-resolution reconstruction of the solutions of two types of partial differential equations and compare the model predictions with the results obtained using conventional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Siyuan Yang

Spiking Neural Networks (SNNs) have received considerable attention not only for their superiority in energy efficiency with discrete signal processing but also for their natural suitability to integrate multi-scale biological plasticity.…

Neural and Evolutionary Computing · Computer Science 2023-11-08 Wenxuan Pan , Feifei Zhao , Guobin Shen , Yi Zeng

Deep neural networks (DNNs) have been deployed in myriad machine learning applications. However, advances in their accuracy are often achieved with increasingly complex and deep network architectures. These large, deep models are often…

Machine Learning · Computer Science 2020-04-22 Wenhan Xia , Hongxu Yin , Niraj K. Jha

On the forefront of scientific computing, Deep Learning (DL), i.e., machine learning with Deep Neural Networks (DNNs), has emerged a powerful new tool for solving Partial Differential Equations (PDEs). It has been observed that DNNs are…

Machine Learning · Computer Science 2025-11-12 Simone Brugiapaglia , Nick Dexter , Samir Karam , Weiqi Wang

Compared with conventional numerical approaches to solving partial differential equations (PDEs), physics-informed neural networks (PINN) have manifested the capability to save development effort and computational cost, especially in…

Machine Learning · Computer Science 2022-09-19 Shihong Zhang , Chi Zhang , Bosen Wang