English
Related papers

Related papers: A Multiple Transferable Neural Network Method with…

200 papers

Deep learning method is of great importance in solving partial differential equations. In this paper, inspired by the failure-informed idea proposed by Gao et.al. (SIAM Journal on Scientific Computing 45(4)(2023)) and as an improvement, a…

Numerical Analysis · Mathematics 2024-04-30 Jingyong Ying , Yaqi Xie , Jiao Li , Hongqiao Wang

Despite the remarkable success of deep learning in pattern recognition, deep network models face the problem of training a large number of parameters. In this paper, we propose and evaluate a novel multi-path wavelet neural network…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 D. D. N. De Silva , H. W. M. K. Vithanage , K. S. D. Fernando , I. T. S. Piyatilake

We propose an efficient hybrid least squares/gradient descent method to accelerate DeepONet training. Since the output of DeepONet can be viewed as linear with respect to the last layer parameters of the branch network, these parameters can…

Machine Learning · Computer Science 2025-08-22 Jun Choi , Chang-Ock Lee , Minam Moon

Domain decomposition methods (DDMs) are popular solvers for discretized systems of partial differential equations (PDEs), with one-level and multilevel variants. These solvers rely on several algorithmic and mathematical parameters,…

Machine Learning · Computer Science 2023-03-03 Ali Taghibakhshi , Nicolas Nytko , Tareq Uz Zaman , Scott MacLachlan , Luke Olson , Matthew West

In this paper, we propose a cusp-capturing physics-informed neural network (PINN) to solve discontinuous-coefficient elliptic interface problems whose solution is continuous but has discontinuous first derivatives on the interface. To find…

Numerical Analysis · Mathematics 2023-08-09 Yu-Hau Tseng , Te-Sheng Lin , Wei-Fan Hu , Ming-Chih Lai

This paper is concerned with the approximation of the solution of partial differential equations by means of artificial neural networks. Here a feedforward neural network is used to approximate the solution of the partial differential…

Numerical Analysis · Mathematics 2019-04-10 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

In recent years, Deep Learning models have shown a great performance in complex optimization problems. They generally require large training datasets, which is a limitation in most practical cases. Transfer learning allows importing the…

Neural and Evolutionary Computing · Computer Science 2024-02-06 Javier Poyatos , Daniel Molina , Aritz. D. Martinez , Javier Del Ser , Francisco Herrera

Evolutionary Computation algorithms have been used to solve optimization problems in relation with architectural, hyper-parameter or training configuration, forging the field known today as Neural Architecture Search. These algorithms have…

Neural and Evolutionary Computing · Computer Science 2024-02-06 Javier Poyatos , Daniel Molina , Aitor Martínez , Javier Del Ser , Francisco Herrera

Multiplex network embedding is an effective technique to jointly learn the low-dimensional representations of nodes across network layers. However, the number of edges among layers may vary significantly. This data imbalance will lead to…

Social and Information Networks · Computer Science 2023-01-02 Kejia Chen , Yinchu Qiu , Zheng Liu

Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer…

Machine Learning · Computer Science 2021-04-22 Wen Tang , Emilie Chouzenoux , Jean-Christophe Pesquet , Hamid Krim

We present a novel global compression framework for deep neural networks that automatically analyzes each layer to identify the optimal per-layer compression ratio, while simultaneously achieving the desired overall compression. Our…

Machine Learning · Computer Science 2021-11-22 Lucas Liebenwein , Alaa Maalouf , Oren Gal , Dan Feldman , Daniela Rus

A new penalty-free neural network method, PFNN-2, is presented for solving partial differential equations, which is a subsequent improvement of our previously proposed PFNN method [1]. PFNN-2 inherits all advantages of PFNN in handling the…

Numerical Analysis · Mathematics 2022-05-03 Hailong Sheng , Chao Yang

Most of the existing multi-relational network embedding methods, e.g., TransE, are formulated to preserve pair-wise connectivity structures in the networks. With the observations that significant triangular connectivity structures and…

Social and Information Networks · Computer Science 2018-06-11 Xin Li , Huiting Hong , Lin Liu , William K. Cheung

A classic approach for solving differential equations with neural networks builds upon neural forms, which employ the differential equation with a discretisation of the solution domain. Making use of neural forms for time-dependent…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Toni Schneidereit , Michael Breuß

We introduce a novel neural operator architecture designed to approximate solutions of linear elliptic partial differential equations with high-contrast, spatially varying coefficients. The network, termed the Iterated V-shaped Net…

Numerical Analysis · Mathematics 2026-05-26 Shan Zhong , George Biros

Deep Unfolding Network-based methods have emerged as effective solutions for multi-source image fusion by combining model-driven iterative optimization with data-driven deep learning. However, most existing deep unfolding image fusion…

Image and Video Processing · Electrical Eng. & Systems 2026-05-04 Ge Luo , Jun-Jie Huang , Qi Yu , Tianrui Liu , Ke Liang , Yuming Xiang , Wentao Zhao , Xinwang Liu , Meng Wang

Deep learning models are used to minimize the number of polyps that goes unnoticed by the experts and to accurately segment the detected polyps during interventions. Although state-of-the-art models are proposed, it remains a challenge to…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Tugberk Erol , Duygu Sarikaya

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

DeepONet has recently been proposed as a representative framework for learning nonlinear mappings between function spaces. However, when it comes to approximating solution operators of partial differential equations (PDEs) with…

Numerical Analysis · Mathematics 2024-08-09 Yameng Zhu , Jingrun Chen , Weibing Deng

Many tasks in natural language understanding require learning relationships between two sequences for various tasks such as natural language inference, paraphrasing and entailment. These aforementioned tasks are similar in nature, yet they…

Machine Learning · Statistics 2018-09-18 James O' Neill , Danushka Bollegala