English
Related papers

Related papers: Uncertainty Quantification for Deep Neural Network…

200 papers

We propose a numerical method for discovering unknown parameterized dynamical systems by using observational data of the state variables. Our method is built upon and extends the recent work of discovering unknown dynamical systems, in…

Numerical Analysis · Mathematics 2020-03-11 Tong Qin , Zhen Chen , John Jakeman , Dongbin Xiu

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

Machine Learning · Computer Science 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Several areas have been improved with Deep Learning during the past years. For non-safety related products adoption of AI and ML is not an issue, whereas in safety critical applications, robustness of such approaches is still an issue. A…

Deep neural networks (DNNs), are widely used in many industries such as image recognition, supply chain, medical diagnosis, and autonomous driving. However, prior work has shown the high accuracy of a DNN model does not imply high…

Machine Learning · Computer Science 2022-11-28 Guanqin Zhang , Jiankun Sun , Feng Xu , H. M. N. Dilum Bandara , Shiping Chen , Yulei Sui , Tim Menzies

Physics-informed neural networks (PINNs) have recently emerged as an alternative way of solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In…

Analysis of PDEs · Mathematics 2019-09-04 Dongkun Zhang , Lu Lu , Ling Guo , George Em Karniadakis

Deep Neural Network(DNN) techniques have been prevalent in software engineering. They are employed to faciliatate various software engineering tasks and embedded into many software applications. However, analyzing and understanding their…

Software Engineering · Computer Science 2019-06-04 Xufan Zhang , Ziyue Yin , Yang Feng , Qingkai Shi , Jia Liu , Zhenyu Chen

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with…

Machine Learning · Computer Science 2023-02-08 Apostolos F Psaros , Xuhui Meng , Zongren Zou , Ling Guo , George Em Karniadakis

When deploying deep neural networks on robots or other physical systems, the learned model should reliably quantify predictive uncertainty. A reliable uncertainty allows downstream modules to reason about the safety of its actions. In this…

Machine Learning · Computer Science 2024-10-30 Simon Kristoffersson Lind , Ziliang Xiong , Per-Erik Forssén , Volker Krüger

Deep neural networks can be roughly divided into deterministic neural networks and stochastic neural networks.The former is usually trained to achieve a mapping from input space to output space via maximum likelihood estimation for the…

Emerging deep-learning (DL)-based techniques have significant potential to revolutionize biomedical imaging. However, one outstanding challenge is the lack of reliability assessment in the DL predictions, whose errors are commonly revealed…

Image and Video Processing · Electrical Eng. & Systems 2019-05-07 Yujia Xue , Shiyi Cheng , Yunzhe Li , Lei Tian

Virtual Diagnostic (VD) is a computational tool based on deep learning that can be used to predict a diagnostic output. VDs are especially useful in systems where measuring the output is invasive, limited, costly or runs the risk of…

Accelerator Physics · Physics 2021-08-04 Owen Convery , Lewis Smith , Yarin Gal , Adi Hanuka

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz

We propose in this work the gradient-enhanced deep neural networks (DNNs) approach for function approximations and uncertainty quantification. More precisely, the proposed approach adopts both the function evaluations and the associated…

Machine Learning · Computer Science 2022-11-09 Xiaodong Feng , Li Zeng

Deep neural networks (DNNs) have become integral to a wide range of scientific and practical applications due to their flexibility and strong predictive performance. Despite their accuracy, however, DNNs frequently exhibit poor calibration,…

Machine Learning · Computer Science 2026-03-12 Sanne Ruijs , Alina Kosiakova , Farrukh Javed

Models are often given in terms of differential equations to represent physical systems. In the presence of uncertainty, accurate prediction of the behavior of these systems using the models requires understanding the effect of uncertainty…

Computational Physics · Physics 2020-08-12 Subhayan De

With the wide development of black-box machine learning algorithms, particularly deep neural network (DNN), the practical demand for the reliability assessment is rapidly rising. On the basis of the concept that `Bayesian deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Kenta Hama , Takashi Matsubara , Kuniaki Uehara , Jianfei Cai

Unsupervised Deep Learning (DL) techniques have been widely used in various security-related anomaly detection applications, owing to the great promise of being able to detect unforeseen threats and superior performance provided by Deep…

Cryptography and Security · Computer Science 2021-09-24 Dongqi Han , Zhiliang Wang , Wenqi Chen , Ying Zhong , Su Wang , Han Zhang , Jiahai Yang , Xingang Shi , Xia Yin

Inference accuracy of deep neural networks (DNNs) is a crucial performance metric, but can vary greatly in practice subject to actual test datasets and is typically unknown due to the lack of ground truth labels. This has raised significant…

Machine Learning · Computer Science 2020-07-06 Zhihui Shao , Jianyi Yang , Shaolei Ren

Deep neural network (DNN) is a popular model implemented in many systems to handle complex tasks such as image classification, object recognition, natural language processing etc. Consequently DNN structural vulnerabilities become part of…

Machine Learning · Computer Science 2021-07-02 Juan Shu , Bowei Xi , Charles Kamhoua