English
Related papers

Related papers: TI-DeepONet: Learnable Time Integration for Stable…

200 papers

Nonlinear physical phenomena often show complex multiscale interactions; motivated by the principles of multiscale modeling in scientific computing, we propose PAS-Net, a physics-informed Adaptive-Scale Deep Operator Network for learning…

Computational Physics · Physics 2025-11-20 Changhong Mou , Yeyu Zhang , Xuewen Zhu , Qiao Zhuang

We consider the neural ODE perspective of supervised learning and study the impact of the final time $T$ (which may indicate the depth of a corresponding ResNet) in training. For the classical $L^2$--regularized empirical risk minimization…

Optimization and Control · Mathematics 2021-03-31 Carlos Esteve , Borjan Geshkovski , Dario Pighin , Enrique Zuazua

Modern machine learning systems based on neural networks have shown great success in learning complex data patterns while being able to make good predictions on unseen data points. However, the limited interpretability of these systems…

Machine Learning · Computer Science 2020-07-22 Sarath Shekkizhar , Antonio Ortega

Vision-based regression tasks, such as hand pose estimation, have achieved higher accuracy and faster convergence through representation learning. However, existing representation learning methods often encounter the following issues: the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Kaiwen Ren , Lei Hu , Zhiheng Zhang , Yongjing Ye , Shihong Xia

Deep neural networks have shown promising results for various clinical prediction tasks. However, training deep networks such as those based on Recurrent Neural Networks (RNNs) requires large labeled data, significant hyper-parameter tuning…

Machine Learning · Computer Science 2021-03-05 Priyanka Gupta , Pankaj Malhotra , Jyoti Narwariya , Lovekesh Vig , Gautam Shroff

Neural surrogates for stiff differential-algebraic equations (DAEs) face two barriers: soft-constraint methods leave algebraic residuals that stiffness amplifies into errors, and hard-constraint methods require trajectory data from stiff…

Machine Learning · Computer Science 2026-04-28 Huy Hoang Le , Haoguang Wang , Christian Moya , Marcos Netto , Guang Lin

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

Machine Learning · Computer Science 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

In this work, we consider the non-invasive medical imaging modality of Electrical Impedance Tomography (EIT), where the goal is to recover the conductivity in a medium from boundary current-to-voltage measurements, i.e., the…

Machine Learning · Computer Science 2026-04-15 Anuj Abhishek , Thilo Strauss

Operator learning has emerged as a promising tool for accelerating the solution of partial differential equations (PDEs). The Deep Operator Networks (DeepONets) represent a pioneering framework in this area: the "vanilla" DeepONet is valued…

Machine Learning · Computer Science 2025-09-03 Zhi-Feng Wei , Wenqian Chen , Panos Stinis

Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise,…

Machine Learning · Computer Science 2021-03-23 Sifan Wang , Hanwen Wang , Paris Perdikaris

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

Purpose: We propose a novel method for continual learning based on the increasing depth of neural networks. This work explores whether extending neural network depth may be beneficial in a life-long learning setting. Methods: We propose a…

Machine Learning · Computer Science 2023-05-09 Jędrzej Kozal , Michał Woźniak

Poroelasticity -- coupled fluid flow and elastic deformation in porous media -- often involves spatially variable permeability, especially in subsurface systems. In such cases, simulations with random permeability fields are widely used for…

Machine Learning · Computer Science 2025-09-16 Sangjoon Park , Yeonjong Shin , Jinhyun Choo

In the present work, we introduce a novel approach to enhance the precision of reduced order models by exploiting a multi-fidelity perspective and DeepONets. Reduced models provide a real-time numerical approximation by simplifying the…

Numerical Analysis · Mathematics 2023-11-21 Nicola Demo , Marco Tezzele , Gianluigi Rozza

Dynamical systems play a key role in modeling, forecasting, and decision-making across a wide range of scientific domains. However, variations in system parameters, also referred to as parametric variability, can lead to drastically…

Machine Learning · Computer Science 2026-03-24 Pantelis R. Vlachas , Konstantinos Vlachas , Eleni Chatzi

We propose a new deflation strategy to accelerate the convergence of the preconditioned conjugate gradient(PCG) method for solving parametric large-scale linear systems of equations. Unlike traditional deflation techniques that rely on…

Numerical Analysis · Mathematics 2025-08-04 Alena Kopaničáková , Youngkyu Lee , George Em Karniadakis

Physics-Informed Neural Networks (PINNs) are deep learning models that incorporate the governing physical laws of a system into the learning process, making them well-suited for solving complex scientific and engineering problems. Recently,…

Machine Learning · Computer Science 2025-07-18 Athanasios Papastathopoulos-Katsaros , Alexandra Stavrianidi , Zhandong Liu

Parametric PDEs power modern simulation, design, and digital-twin systems, yet their many-query workloads still hinge on repeatedly solving large finite-element systems. Existing operator-learning approaches accelerate this process but…

Machine Learning · Computer Science 2025-11-25 Yueqi Wang , Guang Lin

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Predicting the evolution of systems that exhibit spatio-temporal dynamics in response to external stimuli is a key enabling technology fostering scientific innovation. Traditional equations-based approaches leverage first principles to…

Machine Learning · Computer Science 2023-05-02 Francesco Regazzoni , Stefano Pagani , Matteo Salvador , Luca Dede' , Alfio Quarteroni