English
Related papers

Related papers: Towards fast weak adversarial training to solve hi…

200 papers

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

The numerical approximation of partial differential equations (PDEs) poses formidable challenges in high dimensions since classical grid-based methods suffer from the so-called curse of dimensionality. Recent attempts rely on a combination…

Machine Learning · Computer Science 2023-07-31 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

We study the Evolutionary Deep Neural Network (EDNN) framework for accelerating numerical solvers of time-dependent partial differential equations (PDEs). We introduce a Low-Rank Evolutionary Deep Neural Network (LR-EDNN), which constrains…

Machine Learning · Statistics 2025-09-23 Jiahao Zhang , Shiheng Zhang , Guang Lin

Deep operator networks (DeepONets) represent a powerful class of data-driven methods for operator learning, demonstrating strong approximation capabilities for a wide range of linear and nonlinear operators. They have shown promising…

Machine Learning · Computer Science 2025-03-04 Zhaoxi Jiang , Fei Wang

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

In this work, we describe a novel approach to building a neural PDE solver leveraging recent advances in transformer based neural network architectures. Our model can provide solutions for different values of PDE parameters without any need…

Machine Learning · Computer Science 2024-07-10 Varun Madhavan , Amal S Sebastian , Bharath Ramsundar , Venkatasubramanian Viswanathan

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Learned graph neural networks (GNNs) have recently been established as fast and accurate alternatives for principled solvers in simulating the dynamics of physical systems. In many application domains across science and engineering,…

Machine Learning · Computer Science 2022-06-03 Qingqing Zhao , David B. Lindell , Gordon Wetzstein

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

As deep neural networks (DNNs) are widely applied in the physical world, many researches are focusing on physical-world adversarial examples (PAEs), which introduce perturbations to inputs and cause the model's incorrect outputs. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yichen Wang , Yuxuan Chou , Ziqi Zhou , Hangtao Zhang , Wei Wan , Shengshan Hu , Minghui Li

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Gradient-based adversarial attacks on deep neural networks pose a serious threat, since they can be deployed by adding imperceptible perturbations to the test data of any network, and the risk they introduce cannot be assessed through the…

Cryptography and Security · Computer Science 2021-04-06 Rehana Mahfuz , Rajeev Sahay , Aly El Gamal

Conventional solvers are often computationally expensive for constrained optimization, particularly in large-scale and time-critical problems. While this leads to a growing interest in using neural networks (NNs) as fast optimal solution…

Optimization and Control · Mathematics 2024-09-24 Minsoo Kim , Hongseok Kim

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the…

Numerical Analysis · Mathematics 2025-05-14 Nunzio Dimola , Nicola Rares Franco , Paolo Zunino

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao

The weighted essentially non-oscillatory (WENO) schemes are a popular class of high order accurate numerical methods for solving hyperbolic partial differential equations (PDEs). However when the spatial dimensions are high, the number of…

Numerical Analysis · Mathematics 2020-07-21 Xiaozhi Zhu , Yong-Tao Zhang

In recent years, deep learning technology has been used to solve partial differential equations (PDEs), among which the physics-informed neural networks (PINNs) emerges to be a promising method for solving both forward and inverse PDE…

Machine Learning · Computer Science 2021-11-03 Xiang Huang , Hongsheng Liu , Beiji Shi , Zidong Wang , Kang Yang , Yang Li , Bingya Weng , Min Wang , Haotian Chu , Jing Zhou , Fan Yu , Bei Hua , Lei Chen , Bin Dong

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak