English
Related papers

Related papers: Uncertainty Propagation in Deep Neural Networks Us…

200 papers

Uncertainty quantification (UQ) in scientific machine learning is increasingly critical as neural networks are widely adopted to tackle complex problems across diverse scientific disciplines. For physics-informed neural networks (PINNs), a…

Machine Learning · Statistics 2025-10-20 Frank Shih , Zhenghao Jiang , Faming Liang

This technical note addresses the UD factorization based Kalman filtering (KF) algorithms. Using this important class of numerically stable KF schemes, we extend its functionality and develop an elegant and simple method for computation of…

Systems and Control · Computer Science 2016-11-28 Julia V. Tsyganova , Maria V. Kulikova

Parameter estimation in cognitive communications can be formulated as a multi-user estimation problem, which is solvable under maximum likelihood solution but involves high computational complexity. This paper presents a time-sharing and…

Information Theory · Computer Science 2011-11-17 Pengkai Zhao , Cong Shen

Uncertainty in large language model (LLM)-based systems is often studied at the level of a single model output, yet deployed LLM applications are compound systems in which uncertainty is transformed and reused across model internals,…

Software Engineering · Computer Science 2026-04-28 Boming Xia , Liming Zhu , Erdun Gao , Qinghua Lu , Minhui Xue , Dino Sejdinovic

One hidden yet important issue for developing neural network potentials (NNPs) is the choice of training algorithm. Here we compare the performance of two popular training algorithms, the adaptive moment estimation algorithm (Adam) and the…

Chemical Physics · Physics 2021-12-15 Yunqi Shao , Florian M. Dietrich , Carl Nettelblad , Chao Zhang

Statistical learning algorithms provide a generally-applicable framework to sidestep time-consuming experiments, or accurate physics-based modeling, but they introduce a further source of error on top of the intrinsic limitations of the…

Chemical Physics · Physics 2024-05-17 Matthias Kellner , Michele Ceriotti

Simulation-based Dynamic Traffic Assignment models have important applications in real-time traffic management and control. The efficacy of these systems rests on the ability to generate accurate estimates and predictions of traffic states,…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Haizheng Zhang , Ravi Seshadri , A. Arun Prakash , Constantinos Antoniou , Francisco C. Pereira , Moshe Ben-Akiva

Uncertainty quantification in digital twins is critical to enable reliable and credible predictions beyond available data. A key challenge is that ensemble-based approaches can become prohibitively expensive when embedded in control and…

Numerical Analysis · Mathematics 2025-11-04 Zhiyang Ning , Benjamin Peherstorfer

While deep neural networks (DNNs) are used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN estimator under…

Machine Learning · Statistics 2026-03-18 Xuran Meng , Yi Li

Quantifying uncertainty in deep regression models is important both for understanding the confidence of the model and for safe decision-making in high-risk domains. Existing approaches that yield prediction intervals overlook distributional…

Machine Learning · Computer Science 2025-12-02 Adriel Sosa Marco , John Daniel Kirwan , Alexia Toumpa , Simos Gerasimou

In this paper, we analyze the adverse effects of cyber-physical attacks as well as mitigate their impacts on the event-triggered distributed Kalman filter (DKF). We first show that although event-triggered mechanisms are highly desirable,…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Aquib Mustafa , Majid Mazouchi , Hamidreza Modares

We propose a novel deep neural network (DNN) based approximation architecture to learn estimates of measurements. We detail an algorithm that enables training of the DNN. The DNN estimator only uses measurements, if and when they are…

Machine Learning · Computer Science 2022-09-13 Shivangi Agarwal , Sanjit K. Kaul , Saket Anand , P. B. Sujit

Orientation estimation for 3D objects is a common problem that is usually tackled with traditional nonlinear filtering techniques such as the extended Kalman filter (EKF) or the unscented Kalman filter (UKF). Most of these techniques assume…

Systems and Control · Computer Science 2016-08-19 Igor Gilitschenski , Gerhard Kurz , Simon J. Julier , Uwe D. Hanebeck

The iterative ensemble Kalman filter (IEnKF) in a deterministic framework was introduced in Sakov et al. (2012) to extend the ensemble Kalman filter (EnKF) and improve its performance in mildly up to strongly nonlinear cases. However, the…

Atmospheric and Oceanic Physics · Physics 2018-10-17 Pavel Sakov , Jean-Matthieu Haussaire , Marc Bocquet

Complex nonlinear models such as deep neural network (DNNs) have become an important tool for image classification, speech recognition, natural language processing, and many other fields of application. These models however lack…

Individual treatment effect estimation has gained significant attention in recent data science literature. This work introduces the Double Neural Network (Double-NN) method to address this problem within the framework of extended fiducial…

Machine Learning · Statistics 2025-05-06 Sehwan Kim , Faming Liang

In robotics, designing robust algorithms in the face of estimation uncertainty is a challenging task. Indeed, controllers often do not consider the estimation uncertainty and only rely on the most likely estimated state. Consequently,…

Robotics · Computer Science 2023-05-22 Armand Jordana , Avadesh Meduri , Etienne Arlaud , Justin Carpentier , Ludovic Righetti

We consider the filtering of continuous-time finite-state hidden Markov models, where the rate and observation matrices depend on unknown time-dependent parameters, for which no prior or stochastic model is available. We quantify and…

Probability · Mathematics 2021-03-17 Andrew L. Allan

Ensemble Kalman filter (EnKF) is an important data assimilation method for high dimensional geophysical systems. Efficient implementation of EnKF in practice often involves the localization technique, which updates each component using only…

Probability · Mathematics 2018-04-04 Xin T. Tong

Optimal decision-making under partial observability requires reasoning about the uncertainty of the environment's hidden state. However, most reinforcement learning architectures handle partial observability with sequence models that have…

Machine Learning · Computer Science 2025-02-20 Carlos E. Luis , Alessandro G. Bottero , Julia Vinogradska , Felix Berkenkamp , Jan Peters