English
Related papers

Related papers: Multi-fidelity surrogate modeling using long short…

200 papers

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning…

Machine Learning · Computer Science 2021-02-17 Qi Wang , Herke van Hoof

Long short-term memory (LSTM) based acoustic modeling methods have recently been shown to give state-of-the-art performance on some speech recognition tasks. To achieve a further performance improvement, in this research, deep extensions on…

Computation and Language · Computer Science 2015-05-12 Xiangang Li , Xihong Wu

Inspired by multi-fidelity methods in computer simulations, this article introduces procedures to design surrogates for the input/output relationship of a high-fidelity code. These surrogates should be learned from runs of both the…

Numerical Analysis · Mathematics 2024-06-21 Simon Foucart , Nicolas Hengartner

Multi-fidelity surrogate modeling aims to learn an accurate surrogate at the highest fidelity level by combining data from multiple sources. Traditional methods relying on Gaussian processes can hardly scale to high-dimensional data. Deep…

Machine Learning · Computer Science 2024-06-25 Ruijia Niu , Dongxia Wu , Kai Kim , Yi-An Ma , Duncan Watson-Parris , Rose Yu

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

Optimization and Control · Mathematics 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

Reliability is an important tool for evaluating the performance of modern networks. Currently, it is NP-hard and #P-hard to calculate the exact reliability of a binary-state network when the reliability of each component is assumed to be…

Systems and Control · Electrical Eng. & Systems 2022-02-17 Wei-Chang Yeh

Data-driven surrogate models are widely used for applications such as design optimization and uncertainty quantification, where repeated evaluations of an expensive simulator are required. For most partial differential equation (PDE)…

Computational Physics · Physics 2019-10-18 Wei Xing , Robert M. Kirby , Shandian Zhe

The advantage of recurrent neural networks (RNNs) in learning dependencies between time-series data has distinguished RNNs from other deep learning models. Recently, many advances are proposed in this emerging field. However, there is a…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Hojjat Salehinejad

To incorporate prior knowledge as well as measurement uncertainties in the traditional long short term memory (LSTM) neural networks, an efficient sparse Bayesian training algorithm is introduced to the network architecture. The proposed…

Machine Learning · Computer Science 2021-06-25 Bram van de Weg , Lars Greve , Bojana Rosic

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

Machine Learning · Computer Science 2020-11-03 Frank Xiao

Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear…

Machine Learning · Statistics 2026-03-31 Vignesh Sella , Julie Pham , Karen Willcox , Anirban Chaudhuri

Reliable traffic flow prediction is crucial to creating intelligent transportation systems. Many big-data-based prediction approaches have been developed but they do not reflect complicated dynamic interactions between roads considering…

Machine Learning · Computer Science 2023-06-21 Won Kyung Lee , Deuk Sin Kwon , So Young Sohn

A multi-fidelity (MF) active learning method is presented for design optimization problems characterized by noisy evaluations of the performance metrics. Namely, a generalized MF surrogate model is used for design-space exploration,…

Optimization and Control · Mathematics 2022-07-12 Riccardo Pellegrini , Jeroen Wackers , Riccardo Broglia , Andrea Serani , Michel Visonneau , Matteo Diez

Science and engineering fields use computer simulation extensively. These simulations are often run at multiple levels of sophistication to balance accuracy and efficiency. Multi-fidelity surrogate modeling reduces the computational cost by…

Machine Learning · Computer Science 2022-06-13 Dongxia Wu , Matteo Chinazzi , Alessandro Vespignani , Yi-An Ma , Rose Yu

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

Highly accurate numerical or physical experiments are often time-consuming or expensive to obtain. When time or budget restrictions prohibit the generation of additional data, the amount of available samples may be too limited to provide…

Numerical Analysis · Mathematics 2021-12-22 Mengwu Guo , Andrea Manzoni , Maurice Amendt , Paolo Conti , Jan S. Hesthaven

The Extended Long Short-Term Memory (xLSTM) network has demonstrated strong capability in modeling complex long-term dependencies in time series data. Despite its success, the deterministic architecture of xLSTM limits its representational…

Machine Learning · Computer Science 2026-01-23 Zihao Wang , Yunjie Li , Lingmin Zan , Zheng Gong , Mengtao Zhu

Many scientific areas, from computer science to the environmental sciences and finance, give rise to multivariate time series which exhibit long memory, or loosely put, a slow decay in their autocorrelation structure. Efficient modelling…

Methodology · Statistics 2025-12-12 Chiara Boetti , Matthew A. Nunes , Marina I. Knight

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored…

Machine Learning · Computer Science 2023-08-14 Artyom Sorokin , Nazar Buzun , Leonid Pugachev , Mikhail Burtsev

Long short-term memory (LSTM) is a robust recurrent neural network architecture for learning spatiotemporal sequential data. However, it requires significant computational power for learning and implementing from both software and hardware…

Machine Learning · Computer Science 2022-10-26 Nelly Elsayed , Zag ElSayed , Anthony S. Maida