Hyperparameters searches are computationally expensive. This paper studies some general choices of hyperparameters and training methods specifically for operator learning. It considers the architectures DeepONets, Fourier neural operators and Koopman autoencoders for several differential equations to find robust trends. Some options considered are activation functions, dropout and stochastic weight averaging.
@article{arxiv.2412.06686,
title = {Some Best Practices in Operator Learning},
author = {Dustin Enyeart and Guang Lin},
journal= {arXiv preprint arXiv:2412.06686},
year = {2024}
}
Comments
arXiv admin note: substantial text overlap with arXiv:2412.04578