English
Related papers

Related papers: Learning Constitutive Relations from Indirect Obse…

200 papers

Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such…

Machine Learning · Computer Science 2019-12-06 Peter Grönquist , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Luca Lavarini , Shigang Li , Torsten Hoefler

Uncertainty estimation in machine learning has traditionally focused on the prediction stage, aiming to quantify confidence in model outputs while treating learned representations as deterministic and reliable by default. In this work, we…

Machine Learning · Statistics 2026-02-20 Yiyao Yang

Existing procedures for model validation have been deemed inadequate for many engineering systems. The reason of this inadequacy is due to the high degree of complexity of the mechanisms that govern these systems. It is proposed in this…

Artificial Intelligence · Computer Science 2007-05-23 A. Guergachi

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

The internal representations learned by deep networks are often sensitive to architecture-specific choices, raising questions about the stability, alignment, and transferability of learned structure across models. In this paper, we…

Machine Learning · Computer Science 2025-08-06 Saleh Nikooroo , Thomas Engel

The mathematical formulation of constitutive models to describe the path-dependent, i.e., inelastic, behavior of materials is a challenging task and has been a focus in mechanics research for several decades. There have been increased…

Computational Engineering, Finance, and Science · Computer Science 2023-09-06 Max Rosenkranz , Karl A. Kalina , Jörg Brummund , Markus Kästner

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Constitutive relations close the balance laws of continuum mechanics and serves as the surrogate for a material in the design and engineering process. The problem of obtaining the constitutive relations is an indirect inverse problem where…

Materials Science · Physics 2025-04-02 Adeline Wihardja , Kaushik Bhattacharya

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

While the last five years have seen considerable progress in understanding the internal representations of deep learning models, many questions remain. This is especially true when trying to understand the impact of model design choices,…

Machine Learning · Computer Science 2023-12-08 Henry Kvinge , Grayson Jorgenson , Davis Brown , Charles Godfrey , Tegan Emerson

This paper presents a deep learning based model predictive control algorithm for control affine nonlinear discrete time systems with matched and bounded state-dependent uncertainties of unknown structure. Since the structure of…

Systems and Control · Electrical Eng. & Systems 2023-02-28 Prabhat K. Mishra , Mateus V. Gasparino , Andres E. B. Velasquez , Girish Chowdhary

We leverage probabilistic models of neural representations to investigate how residual networks fit classes. To this end, we estimate class-conditional density models for representations learned by deep ResNets. We then use these models to…

Machine Learning · Computer Science 2022-12-02 Michał Jamroż , Marcin Kurdziel

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

Neural networks are a promising tool for characterizing intermediate-scale quantum devices from limited amounts of measurement data. A challenging problem in this area is to learn the action of an unknown quantum process on an ensemble of…

Quantum Physics · Physics 2023-12-06 Yan Zhu , Ya-Dong Wu , Qiushi Liu , Yuexuan Wang , Giulio Chiribella

Representations of the world environment play a crucial role in artificial intelligence. It is often inefficient to conduct reasoning and inference directly in the space of raw sensory representations, such as pixel values of images.…

Machine Learning · Computer Science 2022-04-12 Kenji Kawaguchi , Linjun Zhang , Zhun Deng

Deep learning algorithms demonstrate a surprising ability to learn high-dimensional tasks from limited examples. This is commonly attributed to the depth of neural networks, enabling them to build a hierarchy of abstract, low-dimensional…

Machine Learning · Computer Science 2024-07-04 Francesco Cagnetta , Leonardo Petrini , Umberto M. Tomasini , Alessandro Favero , Matthieu Wyart

Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden…

Machine Learning · Computer Science 2023-01-31 Gianluigi Pillonetto , Aleksandr Aravkin , Daniel Gedon , Lennart Ljung , Antônio H. Ribeiro , Thomas B. Schön

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-29 Laurence Perreault Levasseur , Yashar D. Hezaveh , Risa H. Wechsler