English
Related papers

Related papers: Temperature-Aware Recurrent Neural Operator for Te…

200 papers

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

In scientific machine learning (SciML), a key challenge is learning unknown, evolving physical processes and making predictions across spatio-temporal scales. For example, in real-world manufacturing problems like additive manufacturing,…

Machine Learning · Computer Science 2025-06-16 Vispi Karkaria , Doksoo Lee , Yi-Ping Chen , Yue Yu , Wei Chen

Recurrent Neural Network (RNN) and its variations such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), have become standard building blocks for learning online data of sequential nature in many research areas, including…

Computation and Language · Computer Science 2020-05-12 Enmao Diao , Jie Ding , Vahid Tarokh

Tensor-power (TP) recurrent model is a family of non-linear dynamical systems, of which the recurrence relation consists of a p-fold (a.k.a., degree-p) tensor product. Despite such the model frequently appears in the advanced recurrent…

Machine Learning · Computer Science 2021-03-03 Hejia Qiu , Chao Li , Ying Weng , Zhun Sun , Xingyu He , Qibin Zhao

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a…

Machine Learning · Computer Science 2024-05-29 Ze Cheng , Zhongkai Hao , Xiaoqiang Wang , Jianing Huang , Youjia Wu , Xudan Liu , Yiru Zhao , Songming Liu , Hang Su

During the curing process of composites, the temperature history heavily determines the evolutions of the field of degree of cure as well as the residual stress, which will further influence the mechanical properties of composite, thus it…

Materials Science · Physics 2021-11-22 Gengxiang Chen , Yingguang Li , Xu liu , Qinglu Meng , Jing Zhou , Xiaozhong Hao

Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during…

Machine Learning · Computer Science 2023-06-13 Peter DelMastro , Rushiv Arora , Edward Rietman , Hava T. Siegelmann

Partial differential equations (PDEs) are fundamental to modeling complex and nonlinear physical phenomena, but their numerical solution often requires significant computational resources, particularly when a large number of forward full…

Computational Physics · Physics 2025-07-08 Qibang Liu , Seid Koric

Emerging analog resistive random access memory (RRAM) based on HfOx is an attractive device for non-von Neumann neuromorphic computing systems. The differences in temperature dependent conductance drift among cells hamper computing…

Emerging Technologies · Computer Science 2021-11-17 Heng Xu , Yue Sun , Yangyang Zhu , Xiaohu Wang , Guoxuan Qin

In this paper we compare different types of recurrent units in recurrent neural networks (RNNs). Especially, we focus on more sophisticated units that implement a gating mechanism, such as a long short-term memory (LSTM) unit and a recently…

Neural and Evolutionary Computing · Computer Science 2014-12-12 Junyoung Chung , Caglar Gulcehre , KyungHyun Cho , Yoshua Bengio

This article expands on research that has been done to develop a recurrent neural network (RNN) capable of predicting aircraft engine vibrations using long short-term memory (LSTM) neurons. LSTM RNNs can provide a more generalizable and…

Neural and Evolutionary Computing · Computer Science 2017-10-12 AbdElRahman ElSaid , Travis Desell , Fatima El Jamiy , James Higgins , Brandon Wild

Continuum robots enable dexterous manipulation in constrained environments, but require accurate and efficient models for real-time manipulation and control. Traditional physics-based models can be computationally expensive and may suffer…

Robotics · Computer Science 2026-05-20 Branden Frieden , James M. Ferguson , Alan Kuntz , Varun Shankar

Anisotropic material properties, such as the thermal conductivities of engineering composites, exhibit variability due to inherent material heterogeneity and manufacturing-related uncertainties. Mathematically, these properties are modeled…

Computational Engineering, Finance, and Science · Computer Science 2025-08-08 Wouter J. Schuttert , Mohammed Iqbal Abdul Rasheed , Bojana Rosić

Here we assess the applicability of graph neural networks (GNNs) for predicting the grain-scale elastic response of polycrystalline metallic alloys. Using GNN surrogate models, grain-averaged stresses during uniaxial elastic tension in Low…

Materials Science · Physics 2022-09-01 Darren C. Pagan , Calvin R. Pash , Austin R. Benson , Matthew P. Kasemer

Accurate long-term forecasting of spatiotemporal dynamics remains a fundamental challenge across scientific and engineering domains. Existing machine learning methods often neglect governing physical laws and fail to quantify inherent…

Machine Learning · Computer Science 2025-10-27 Qingsong Xu , Jonathan L Bamber , Nils Thuerey , Niklas Boers , Paul Bates , Gustau Camps-Valls , Yilei Shi , Xiao Xiang Zhu

Recurrent Neural Network (RNN) are a popular choice for modeling temporal and sequential tasks and achieve many state-of-the-art performance on various complex problems. However, most of the state-of-the-art RNNs have millions of parameters…

Machine Learning · Computer Science 2017-10-31 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Data-driven convective parameterization aims to accurately represent convective adjustments to large-scale forcings in a computationally economic manner. While previous studies have demonstrated success using various model architectures,…

Atmospheric and Oceanic Physics · Physics 2025-06-02 Qiyu Song , Zhiming Kuang

Neural operators (NOs) have emerged as effective tools for modeling complex physical systems in scientific machine learning. In NOs, a central characteristic is to learn the governing physical laws directly from data. In contrast to other…

Machine Learning · Computer Science 2024-06-06 Ning Liu , Yiming Fan , Xianyi Zeng , Milan Klöwer , Lu Zhang , Yue Yu

We demonstrate a machine learning based approach which can learn the time-dependent electronic excitation dynamics of small molecules subjected to ion irradiation. Ensembles of recurrent neural networks are trained on data generated by…

Chemical Physics · Physics 2024-09-24 Ethan P. Shapera , Cheng-Wei Lee

The perpendicular shape anisotropy-spin transfer torque-magnetic random access memories (PSASTT-MRAMs) takes advantage of the nanopillar free-layer geometry for securing a good thermal stability factor from the shape anisotropy of the…

Mesoscale and Nanoscale Physics · Physics 2021-06-30 Wei Zhang , Zihan Tong , Yuzan Xiong , Weigang Wang , Qiming Shao