English

NLP Inspired Training Mechanics For Modeling Transient Dynamics

Machine Learning 2022-11-08 v1

Abstract

In recent years, Machine learning (ML) techniques developed for Natural Language Processing (NLP) have permeated into developing better computer vision algorithms. In this work, we use such NLP-inspired techniques to improve the accuracy, robustness and generalizability of ML models for simulating transient dynamics. We introduce teacher forcing and curriculum learning based training mechanics to model vortical flows and show an enhancement in accuracy for ML models, such as FNO and UNet by more than 50%.

Keywords

Cite

@article{arxiv.2211.02716,
  title  = {NLP Inspired Training Mechanics For Modeling Transient Dynamics},
  author = {Lalit Ghule and Rishikesh Ranade and Jay Pathak},
  journal= {arXiv preprint arXiv:2211.02716},
  year   = {2022}
}
R2 v1 2026-06-28T05:13:33.607Z