English
Related papers

Related papers: A Physics-preserved Transfer Learning Method for D…

200 papers

We define a digital twin (DT) of a physical system governed by partial differential equations (PDEs) as a model for real-time simulations and control of the system behavior under changing conditions. We construct DTs using the…

Machine Learning · Computer Science 2025-01-14 Yifei Zong , Alexandre Tartakovsky

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

The traditional paradigm for developing machine prognostics usually relies on generalization from data acquired in experiments under controlled conditions prior to deployment of the equipment. Detecting or predicting failures and estimating…

Machine Learning · Computer Science 2019-10-02 Yuantao Fan , Sławomir Nowaczyk , Thorsteinn Rögnvaldsson

In many unpaired image domain translation problems, e.g., style transfer or super-resolution, it is important to keep the translated image similar to its respective input image. We propose the extremal transport (ET) which is a mathematical…

Machine Learning · Computer Science 2023-11-03 Milena Gazdieva , Alexander Korotin , Daniil Selikhanovych , Evgeny Burnaev

We propose gradient-enhanced PINNs based on transfer learning (TL-gPINNs) for inverse problems of the function coefficient discovery in order to overcome deficiency of the discrete characterization of the PDE loss in neural networks and…

Numerical Analysis · Mathematics 2023-05-16 Shuning Lin , Yong Chen

To remedy the drawbacks of full-mass or fixed-mass constraints in classical optimal transport, we propose adaptive optimal transport which is distinctive from the classical optimal transport in its ability of adaptive-mass preserving. It…

Machine Learning · Computer Science 2025-03-10 Pei Yang , Qi Tan , Guihua Wen

Modeling the dynamics of flexible objects has become an emerging topic in the community as these objects become more present in many applications, e.g., soft robotics. Due to the properties of flexible materials, the movements of soft…

Machine Learning · Computer Science 2024-06-18 Kaiyuan Tan , Peilun Li , Thomas Beckers

Optimal Transport (OT) has established itself as a robust framework for quantifying differences between distributions, with applications that span fields such as machine learning, data science, and computer vision. This paper offers a…

Data Structures and Algorithms · Computer Science 2025-01-14 Sina Moradi

The transferable neural network (TransNet) is a two-layer shallow neural network with pre-determined and uniformly distributed neurons in the hidden layer, and the least-squares solvers can be particularly used to compute the parameters of…

Numerical Analysis · Mathematics 2025-02-28 Tianzheng Lu , Lili Ju , Liyong Zhu

We present a flow-based approach to the optimal transport (OT) problem between two continuous distributions $\pi_0,\pi_1$ on $\mathbb{R}^d$, of minimizing a transport cost $\mathbb{E}[c(X_1-X_0)]$ in the set of couplings $(X_0,X_1)$ whose…

Machine Learning · Statistics 2022-09-30 Qiang Liu

Adapting large pre-trained models to unseen tasks under tight data and compute budgets remains challenging. Meta-learning approaches explicitly learn good initializations, but they require an additional meta-training phase over many tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Junghwan Park , Woojin Cho , Junhyuk Heo , Darongsae Kwon , Kookjin Lee

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Transfer learning is widely used for training deep neural networks (DNN) for building a powerful representation. Even after the pre-trained model is adapted for the target task, the representation performance of the feature extractor is…

Machine Learning · Computer Science 2023-08-22 Seunghee Koh , Hyounguk Shon , Janghyeon Lee , Hyeong Gwon Hong , Junmo Kim

Causal abstraction offers a principled framework for mechanistic interpretability, aligning a high-level causal model with the low-level computation realized by a neural network through counterfactual intervention analysis. Existing methods…

Machine Learning · Computer Science 2026-05-11 Jonathn Chang , Arya Datla , Ziv Goldfeld

Modeling distributions that depend on external control parameters is a common scenario in diverse applications like molecular simulations, where system properties like temperature affect molecular configurations. Despite the relevance of…

Machine Learning · Computer Science 2025-03-10 Stefan Wahl , Armand Rousselot , Felix Draxler , Henrik Schopmans , Ullrich Köthe

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

Operator learning for Partial Differential Equations (PDEs) is rapidly emerging as a promising approach for surrogate modeling of intricate systems. Transformers with the self-attention mechanism$\unicode{x2013}$a powerful tool originally…

Machine Learning · Computer Science 2024-05-17 Junfeng Chen , Kailiang Wu

Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional object. We draw…

Machine Learning · Computer Science 2022-11-21 Wenxuan Guo , YoonHaeng Hur , Tengyuan Liang , Christopher Ryan

The application of transfer learning, leveraging knowledge from source domains to enhance model performance in a target domain, has significantly grown, supporting diverse real-world applications. Its success often relies on shared…

Machine Learning · Computer Science 2024-07-19 Runxue Bao , Yiming Sun , Yuhe Gao , Jindong Wang , Qiang Yang , Zhi-Hong Mao , Ye Ye

Optimal transport (OT) has gained popularity due to its various applications in fields such as machine learning, statistics, and signal processing. However, the balanced mass requirement limits its performance in practical problems. To…

Machine Learning · Computer Science 2024-04-24 Yikun Bai , Ivan Medri , Rocio Diaz Martin , Rana Muhammad Shahroz Khan , Soheil Kolouri