English
Related papers

Related papers: Deep Neural Networks to Correct Sub-Precision Erro…

200 papers

This invention addresses fixed-point representations of convolutional neural networks (CNN) in integrated circuits. When quantizing a CNN for a practical implementation there is a trade-off between the precision used for operations between…

Neural and Evolutionary Computing · Computer Science 2018-07-27 Mo'taz Al-Hami , Marcin Pietron , Rishi Kumar , Raul A. Casas , Samer L. Hijazi , Chris Rowen

The immense computational cost of simulating turbulence has motivated the use of machine learning approaches for super-resolving turbulent flows. A central challenge is ensuring that learned models respect physical symmetries, such as…

Variational Physics-Informed Neural Networks often suffer from poor convergence when using stochastic gradient-descent-based optimizers. By introducing a Least Squares solver for the weights of the last layer of the neural network, we…

Numerical Analysis · Mathematics 2025-03-20 Carlos Uriarte , Manuela Bastidas , David Pardo , Jamie M. Taylor , Sergio Rojas

Recent years have witnessed the great advance of deep learning in a variety of vision tasks. Many state-of-the-art deep neural networks suffer from large size and high complexity, which makes it difficult to deploy in resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Zhengguang Zhou , Wengang Zhou , Xutao Lv , Xuan Huang , Xiaoyu Wang , Houqiang Li

This work presents a deep learning-based framework for the solution of partial differential equations on complex computational domains described with computer-aided design tools. To account for the underlying distribution of the training…

Computational Engineering, Finance, and Science · Computer Science 2022-03-18 Moritz von Tresckow , Stefan Kurz , Herbert De Gersem , Dimitrios Loukrezis

Simulation of turbulent flows at high Reynolds number is a computationally challenging task relevant to a large number of engineering and scientific applications in diverse fields such as climate science, aerodynamics, and combustion.…

Computational Physics · Physics 2020-10-06 Jaideep Pathak , Mustafa Mustafa , Karthik Kashinath , Emmanuel Motheau , Thorsten Kurth , Marcus Day

With rapid progress in deep learning, neural networks have been widely used in scientific research and engineering applications as surrogate models. Despite the great success of neural networks in fitting complex systems, two major…

Machine Learning · Computer Science 2023-06-13 Yuwen Deng , Wang Kang , Wei W. Xing

Data-driven methods for computer simulations are blooming in many scientific areas. The traditional approach to simulating physical behaviors relies on solving partial differential equations (PDE). Since calculating these iterative…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-01 Sergio Iserte , Alejandro González-Barberá , Paloma Barreda , Krzysztof Rojek

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Low precision training is one of the most popular strategies for deploying the deep model on limited hardware resources. Fixed point implementation of DCNs has the potential to alleviate complexities and facilitate potential deployment on…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Zehua Cheng , Weiyang Wang , Yan Pan , Thomas Lukasiewicz

Partial differential equations frequently appear in the natural sciences and related disciplines. Solving them is often challenging, particularly in high dimensions, due to the "curse of dimensionality". In this work, we explore the…

Quantum Physics · Physics 2023-05-30 Lukas Mouton , Florentin Reiter , Ying Chen , Patrick Rebentrost

The operations used for neural network computation map favorably onto simple analog circuits, which outshine their digital counterparts in terms of compactness and efficiency. Nevertheless, such implementations have been largely supplanted…

Neural and Evolutionary Computing · Computer Science 2020-02-24 Jonathan Binas , Daniel Neil , Giacomo Indiveri , Shih-Chii Liu , Michael Pfeiffer

Implicit methods are attractive for hybrid quantum-classical CFD solvers as the flow equations are combined into a single coupled matrix that is solved on the quantum device, leaving only the CFD discretisation and matrix assembly on the…

Quantum Physics · Physics 2022-09-19 Leigh Lapworth

We compare the Finite Element Method (FEM) simulation of a standard Partial Differential Equation thermal problem of a plate with a hole with a Neural Network (NN) simulation. The largest deviation from the true solution obtained from FEM…

Computational Engineering, Finance, and Science · Computer Science 2022-04-11 Andrea Sacchetti , Benjamin Bachmann , Kaspar Löffel , Urs-Martin Künzi , Beatrice Paoli

We present a Fourier neural operator network, designed to correct dispersion errors in numerical wave simulations. The neural dispersion corrector enables the replacement of a computationally expensive high-accuracy simulation by a less…

In this paper, we numerically examine the precision challenges that emerge in automatic differentiation and numerical integration in various tasks now tackled by physics-informed neural networks (PINNs). Specifically, we illustrate how…

Numerical Analysis · Mathematics 2025-07-29 Josef Daněk , Jan Pospíšil

We explore techniques to significantly improve the compute efficiency and performance of Deep Convolution Networks without impacting their accuracy. To improve the compute efficiency, we focus on achieving high accuracy with extremely…

Machine Learning · Computer Science 2016-10-04 Ganesh Venkatesh , Eriko Nurvitadhi , Debbie Marr

This article presents an innovative study in exploring, evaluating, and implementing deep learning architectures for the calibration of multi-modal sensor systems. The focus behind this is to leverage the use of sensor fusion to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Venkat Karramreddy , Liam Mitchell

In scientific computing, the formulation of numerical discretisations of partial differential equations (PDEs) as untrained convolutional layers within Convolutional Neural Networks (CNNs), referred to by some as Neural Physics, has…

Atmospheric turbulence deteriorates the quality of images captured by long-range imaging systems by introducing blur and geometric distortions to the captured scene. This leads to a drastic drop in performance when computer vision…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Nithin Gopalakrishnan Nair , Kangfu Mei , Vishal M. Patel