English
Related papers

Related papers: Analyzing the Performance of Deep Encoder-Decoder …

200 papers

Even though sequence-to-sequence neural machine translation (NMT) model have achieved state-of-art performance in the recent fewer years, but it is widely concerned that the recurrent neural network (RNN) units are very hard to capture the…

Computation and Language · Computer Science 2018-05-28 Wen Zhang , Jiawei Hu , Yang Feng , Qun Liu

A Theory-guided Auto-Encoder (TgAE) framework is proposed for surrogate construction and is further used for uncertainty quantification and inverse modeling tasks. The framework is built based on the Auto-Encoder (or Encoder-Decoder)…

Machine Learning · Computer Science 2021-09-14 Nanzhe Wang , Haibin Chang , Dongxiao Zhang

Evolutionary algorithms are increasingly recognised as a viable computational approach for the automated optimisation of deep neural networks (DNNs) within artificial intelligence. This method extends to the training of DNNs, an approach…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Fergal Stapleton , Brendan Cody-Kenny , Edgar Galván

We integrate neural operators with diffusion models to address the spectral limitations of neural operators in surrogate modeling of turbulent flows. While neural operators offer computational efficiency, they exhibit deficiencies in…

Machine Learning · Computer Science 2025-02-14 Vivek Oommen , Aniruddha Bora , Zhen Zhang , George Em Karniadakis

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

In the paper, a multi-objective evolutionary surrogate-assisted approach for the fast and effective generative design of coastal breakwaters is proposed. To approximate the computationally expensive objective functions, the deep…

Neural and Evolutionary Computing · Computer Science 2022-10-28 Nikita O. Starodubcev , Nikolay O. Nikitin , Anna V. Kalyuzhnaya

Hyperbolic conservation laws govern a wide range of transport-driven dynamics featuring shocks, contact discontinuities, and complex wave interactions, posing distinct challenges for deep-learning-based surrogate modeling. While classical…

Computational Physics · Physics 2026-04-20 Jiamin Jiang , Shanglin Lv , Jingrun Chen

Convolutional neural networks (CNNs) are one of the most widely used neural network architectures, showcasing state-of-the-art performance in computer vision tasks. Although larger CNNs generally exhibit higher accuracy, their size can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Sukhbinder Singh , Saeed S. Jahromi , Roman Orus

To reduce uploading bandwidth and address privacy concerns, deep learning at the network edge has been an emerging topic. Typically, edge devices collaboratively train a shared model using real-time generated data through the Parameter…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-11 Shangming Cai , Dongsheng Wang , Haixia Wang , Yongqiang Lyu , Guangquan Xu , Xi Zheng , Athanasios V. Vasilakos

Neural networks have promise as surrogate partial differential equation (PDE) solvers, but it remains a challenge to use these concepts to solve problems with high accuracy and scalability. In this work, we show that neural network…

Computational Physics · Physics 2025-09-05 Chenkai Mao , Jonathan A. Fan

Spiking Neural Networks (SNNs) offer a promising alternative to traditional deep learning frameworks, since they provide higher computational efficiency due to event-driven information processing. SNNs distribute the analog values of pixel…

Machine Learning · Computer Science 2020-10-06 Isha Garg , Sayeed Shafayet Chowdhury , Kaushik Roy

Trained with a sufficiently large training and testing dataset, Deep Neural Networks (DNNs) are expected to generalize. However, inputs may deviate from the training dataset distribution in real deployments. This is a fundamental issue with…

Machine Learning · Computer Science 2021-10-07 Yan Xiao , Yun Lin , Ivan Beschastnikh , Changsheng Sun , David S. Rosenblum , Jin Song Dong

Compared to conventional artificial neurons that produce dense and real-valued responses, biologically-inspired spiking neurons transmit sparse and binary information, which can also lead to energy-efficient implementations. Recent research…

Computation and Language · Computer Science 2023-02-17 Alexandre Bittar , Philip N. Garner

Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly…

Image and Video Processing · Electrical Eng. & Systems 2018-09-27 Yunzhe Li , Yujia Xue , Lei Tian

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Developing accurate, data-efficient surrogate models is central to advancing AI for Science. Neural operators (NOs), which approximate mappings between infinite-dimensional function spaces using conventional neural architectures, have…

Machine Learning · Computer Science 2025-09-26 Dibyajyoti Nayak , Somdatta Goswami

Motivated by recent work on deep neural network (DNN)-based image compression methods showing potential improvements in image quality, savings in storage, and bandwidth reduction, we propose to perform image understanding tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Robert Torfason , Fabian Mentzer , Eirikur Agustsson , Michael Tschannen , Radu Timofte , Luc Van Gool

Low-dose computed tomography (CT) has attracted a major attention in the medical imaging field, since CT-associated x-ray radiation carries health risks for patients. The reduction of CT radiation dose, however, compromises the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Hongming Shan , Yi Zhang , Qingsong Yang , Uwe Kruger , Mannudeep K. Kalra , Ling Sun , Wenxiang Cong , Ge Wang

Deep neural networks have been applied to improve the image quality of fluorescence microscopy imaging. Previous methods are based on convolutional neural networks (CNNs) which generally require more time-consuming training of separate…

This study presents an integrated computational framework that, given synthesis parameters, predicts the resulting microstructural morphology and mechanical response of ceramic aerogel porous materials by combining physics-based simulations…

Computational Engineering, Finance, and Science · Computer Science 2025-06-10 Md Azharul Islam , Dwyer Deighan , Shayan Bhattacharjee , Daniel Tantalo , Pratyush Kumar Singh , David Salac , Danial Faghihi