English
Related papers

Related papers: Deep Neural Networks and PIDE discretizations

200 papers

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs. Our key idea is to leverage the prior of ``translational similarity'' of numerical PDE differential…

Machine Learning · Computer Science 2023-03-14 Ziqian Wu , Xingzhe He , Yijun Li , Cheng Yang , Rui Liu , Shiying Xiong , Bo Zhu

Neural operators have been applied in various scientific fields, such as solving parametric partial differential equations, dynamical systems with control, and inverse problems. However, challenges arise when dealing with input functions…

Numerical Analysis · Mathematics 2023-10-31 Zecheng Zhang , Christian Moya , Lu Lu , Guang Lin , Hayden Schaeffer

Approximating solutions to partial differential equations (PDEs) is fundamental for the modeling of dynamical systems in science and engineering. Physics-informed neural networks (PINNs) are a recent machine learning-based approach, for…

Verification of Neural Networks (NNs) that approximate the solution of Partial Differential Equations (PDEs) is a major milestone towards enhancing their trustworthiness and accelerating their deployment, especially for safety-critical…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Petros Ellinas , Rahul Nellikath , Ignasi Ventura , Jochen Stiasny , Spyros Chatzivasileiadis

Analyzing the worst-case performance of deep neural networks against input perturbations amounts to solving a large-scale non-convex optimization problem, for which several past works have proposed convex relaxations as a promising…

Machine Learning · Computer Science 2022-07-11 Shaoru Chen , Eric Wong , J. Zico Kolter , Mahyar Fazlyab

Solving constrained nonlinear optimization problems (CNLPs) is a longstanding problem that arises in various fields, e.g., economics, computer science, and engineering. We propose optimization-informed neural networks (OINN), a deep…

Optimization and Control · Mathematics 2023-06-27 Dawen Wu , Abdel Lisser

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

Physics-informed neural networks (PINNs) have emerged as a promising numerical method based on deep learning for modeling boundary value problems, showcasing promising results in various fields. In this work, we use PINNs to discretize…

Computational Physics · Physics 2024-06-10 Michel Nohra , Steven Dufour

The recently developed physics-informed machine learning has made great progress for solving nonlinear partial differential equations (PDEs), however, it may fail to provide reasonable approximations to the PDEs with discontinuous…

Numerical Analysis · Mathematics 2021-12-06 Chunyue Lv , Lei Wang , Chenming Xie

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domains. Several…

Machine Learning · Computer Science 2021-02-24 Jianlin Li , Pengfei Yang , Jiangchao Liu , Liqian Chen , Xiaowei Huang , Lijun Zhang

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

Machine Learning · Computer Science 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

A common approach to solve inverse imaging problems relies on finding a maximum a posteriori (MAP) estimate of the original unknown image, by solving a minimization problem. In thiscontext, iterative proximal algorithms are widely used,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hoang Trieu Vy Le , Audrey Repetti , Nelly Pustelnik

Deep learning has become a pivotal technology in fields such as computer vision, scientific computing, and dynamical systems, significantly advancing these disciplines. However, neural Networks persistently face challenges related to…

Machine Learning · Computer Science 2025-10-14 Yongshuai Liu , Lianfang Wang , Kuilin Qin , Qinghua Zhang , Faqiang Wang , Li Cui , Jun Liu , Yuping Duan , Tieyong Zeng

PDEs arise ubiquitously in science and engineering, where solutions depend on parameters (physical properties, boundary conditions, geometry). Traditional numerical methods require re-solving the PDE for each parameter, making parameter…

Machine Learning · Statistics 2026-02-02 Zhuo Zhang , Xiong Xiong , Sen Zhang , Yuan Zhao , Xi Yang

We develop a distributed framework for the physics-informed neural networks (PINNs) based on two recent extensions, namely conservative PINNs (cPINNs) and extended PINNs (XPINNs), which employ domain decomposition in space and in…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-09 Khemraj Shukla , Ameya D. Jagtap , George Em Karniadakis

We propose a novel deep network architecture for grayscale and color image denoising that is based on a non-local image model. Our motivation for the overall design of the proposed network stems from variational methods that exploit the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 Stamatios Lefkimmiatis

Although Convolutional Neural Networks (CNNs) have achieved promising results in image classification, they still are vulnerable to affine transformations including rotation, translation, flip and shuffle. The drawback motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Zijie Tan , Guanfang Dong , Chenqiu Zhao , Anup Basu

In recent years a large literature on deep learning based methods for the numerical solution partial differential equations has emerged; results for integro-differential equations on the other hand are scarce. In this paper we study deep…

Numerical Analysis · Mathematics 2021-09-27 Rüdiger Frey , Verena Köck