English
Related papers

Related papers: Accelerated replica exchange stochastic gradient L…

200 papers

In the present work, we introduce a novel approach to enhance the precision of reduced order models by exploiting a multi-fidelity perspective and DeepONets. Reduced models provide a real-time numerical approximation by simplifying the…

Numerical Analysis · Mathematics 2023-11-21 Nicola Demo , Marco Tezzele , Gianluigi Rozza

In this work, we aim to establish a Bayesian adaptive learning framework by focusing on estimating latent variables in deep neural network (DNN) models. Latent variables indeed encode both transferable distributional information and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Hu Hu , Sabato Marco Siniscalchi , Chin-Hui Lee

We develop a novel physics informed deep learning approach for solving nonlinear drift-diffusion equations on metric graphs. These models represent an important model class with a large number of applications in areas ranging from transport…

Machine Learning · Computer Science 2025-05-08 Jan Blechschmidt , Tom-Christian Riemer , Max Winkler , Martin Stoll , Jan-F. Pietschmann

We present a new framework for computing fine-scale solutions of multiscale Partial Differential Equations (PDEs) using operator learning tools. Obtaining fine-scale solutions of multiscale PDEs can be challenging, but there are many…

Numerical Analysis · Mathematics 2023-08-29 Zecheng Zhang , Christian Moya , Wing Tat Leung , Guang Lin , Hayden Schaeffer

We propose a trainable-by-parts surrogate model for solving forward and inverse parameterized nonlinear partial differential equations. Like several other surrogate and operator learning models, the proposed approach employs an encoder to…

Machine Learning · Computer Science 2025-08-07 Yifei Zong , Alexandre M. Tartakovsky

In the pursuit of accurate experimental and computational data while minimizing effort, there is a constant need for high-fidelity results. However, achieving such results often requires significant computational resources. To address this…

Machine Learning · Computer Science 2023-11-08 Amirhossein Mollaali , Izzet Sahin , Iqrar Raza , Christian Moya , Guillermo Paniagua , Guang Lin

Neural surrogates for stiff differential-algebraic equations (DAEs) face two barriers: soft-constraint methods leave algebraic residuals that stiffness amplifies into errors, and hard-constraint methods require trajectory data from stiff…

Machine Learning · Computer Science 2026-04-28 Huy Hoang Le , Haoguang Wang , Christian Moya , Marcos Netto , Guang Lin

Diffusion models have recently emerged as powerful stochastic frameworks for high-dimensional inference and generation. However, existing applications to partial differential equations (PDEs) predominantly rely on physics-informed training…

Numerical Analysis · Mathematics 2026-04-03 Yi Bing , Liu Jia , Fu Jinyang , Peng Xiang

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple…

Numerical Analysis · Mathematics 2021-07-15 Guang Lin , Yating Wang , Zecheng Zhang

Scientific machine learning has been successfully applied to inverse problems and PDE discovery in computational physics. One caveat concerning current methods is the need for large amounts of ("clean") data, in order to characterize the…

Numerical Analysis · Mathematics 2021-11-30 Christophe Bonneville , Christopher J. Earls

Traditional numerical methods, such as the finite element method and finite volume method, adress partial differential equations (PDEs) by discretizing them into algebraic equations and solving these iteratively. However, this process is…

Computational Physics · Physics 2025-07-22 Jianghang Gu , Ling Wen , Yuntian Chen , Shiyi Chen

In diverse microscopy modalities, sensors measure only real-valued intensities. Additionally, the sensor readouts are affected by Poissonian-distributed photon noise. Traditional restoration algorithms typically aim to minimize the mean…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Nadav Torem , Roi Ronen , Yoav Y. Schechner , Michael Elad

Contemporary Deep Neural Network (DNN) contains millions of synaptic connections with tens to hundreds of layers. The large computation and memory requirements pose a challenge to the hardware design. In this work, we leverage the intrinsic…

Machine Learning · Computer Science 2017-11-07 Jingyang Zhu , Jingbo Jiang , Xizi Chen , Chi-Ying Tsui

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying…

Machine Learning · Computer Science 2026-02-26 Nick Winovich , Mitchell Daneker , Lu Lu , Guang Lin

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

Solving parametric partial differential equations (PDEs) and associated PDE-based, inverse problems is a central task in engineering and physics, yet existing neural operator methods struggle with high-dimensional, discontinuous inputs and…

Machine Learning · Computer Science 2025-07-03 Yaohua Zang , Phaedon-Stelios Koutsourelakis

Scientific computing using deep learning has seen significant advancements in recent years. There has been growing interest in models that learn the operator from the parameters of a partial differential equation (PDE) to the corresponding…

Machine Learning · Computer Science 2024-02-14 Sung Woong Cho , Jae Yong Lee , Hyung Ju Hwang

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

Improving performance of deep learning models and reducing their training times are ongoing challenges in deep neural networks. There are several approaches proposed to address these challenges one of which is to increase the depth of the…

Machine Learning · Computer Science 2020-06-20 Sunitha Basodi , Chunyan Ji , Haiping Zhang , Yi Pan