English
Related papers

Related papers: Mutual Information for Explainable Deep Learning o…

200 papers

Assessing the safety and environmental impacts of subsurface resource exploitation and management is critical and requires robust geomechanical modeling. However, uncertainties stemming from model assumptions, intrinsic variability of…

Numerical Analysis · Mathematics 2025-02-19 Caterina Millevoi , Claudia Zoccarato , Massimiliano Ferronato

A key goal of unsupervised learning is to go beyond density estimation and sample generation to reveal the structure inherent within observed data. Such structure can be expressed in the pattern of interactions between explanatory latent…

Machine Learning · Computer Science 2022-11-11 Changmin Yu , Hugo Soulat , Neil Burgess , Maneesh Sahani

Self supervised learning (SSL) is a machine learning paradigm where models learn to understand the underlying structure of data without explicit supervision from labeled samples. The acquired representations from SSL have demonstrated…

Machine Learning · Computer Science 2025-12-11 Yunshan Duan , Sinead Williamson

Meta-materials are an important emerging class of engineered materials in which complex macroscopic behaviour--whether electromagnetic, thermal, or mechanical--arises from modular substructure. Simulation and optimization of these materials…

Machine Learning · Computer Science 2020-05-18 Alex Beatson , Jordan T. Ash , Geoffrey Roeder , Tianju Xue , Ryan P. Adams

Uncertainty Quantification (UQ) is essential for the reliable application of computational models in engineering and science. Among surrogate modeling techniques, Gaussian Process Regression (GPR) is particularly valuable for its…

Computation · Statistics 2025-12-15 Jinglai Li , Hongqiao Wang

Predictive estimation, which comprises model calibration, model prediction, and validation, is a common objective when performing inverse uncertainty quantification (UQ) in diverse scientific applications. These techniques typically require…

Numerical Analysis · Mathematics 2024-07-17 Ningxin Yang , Truong Le , Lidija Zdravković , David M. Potts

We study the problem of community detection when there is covariate information about the node labels and one observes multiple correlated networks. We provide an asymptotic upper bound on the per-node mutual information as well as a…

Information Theory · Computer Science 2019-12-12 Vaishakhi Mayya , Galen Reeves

Robust machine learning for regulatory genomics is studied under biologically and technically induced distribution shifts. Deep convolutional and attention based models achieve strong in distribution performance on DNA regulatory sequence…

Genomics · Quantitative Biology 2026-02-20 Yiyao Yang

Humans explain inter-object relationships with semantic labels that demonstrate a high-level understanding required to perform complex Vision-Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Moshiur Farazi , Salman Khan , Nick Barnes

Accurately and proactively alerting drivers or automated systems to emerging collisions is crucial for road safety, particularly in highly interactive and complex urban environments. Existing methods either require labour-intensive…

Robotics · Computer Science 2026-03-26 Yiru Jiao , Simeon C. Calvert , Sander van Cranenburgh , Hans van Lint

We present a computational framework for dimension reduction and surrogate modeling to accelerate uncertainty quantification in computationally intensive models with high-dimensional inputs and function-valued outputs. Our driving…

Numerical Analysis · Mathematics 2021-06-30 Helen Cleaves , Alen Alexanderian , Bilal Saad

Machine learning classification techniques have been used widely to recognize the feasible design domain and discover hidden patterns in engineering design. An accurate classification model needs a large dataset; however, generating a large…

Data Analysis, Statistics and Probability · Physics 2021-07-13 Xianping Du , Kai Zhang , Onur Bilgen , Laurent Burlion , Hongyi Xu

Surrogate models are essential for efficient exploration of large-scale ensemble simulations. Implicit neural representations (INRs) provide a compact and continuous framework for modeling spatially structured data, but they often struggle…

Machine Learning · Computer Science 2026-04-01 Ziwei Li , Yuhan Duan , Tianyu Xiong , Yi-Tang Chen , Wei-Lun Chao , Han-Wei Shen

Transposable data represents interactions among two sets of entities, and are typically represented as a matrix containing the known interaction values. Additional side information may consist of feature vectors specific to entities…

Machine Learning · Statistics 2014-04-29 Oluwasanmi Koyejo , Cheng Lee , Joydeep Ghosh

We examine a class of deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) We show how entropies and mutual informations can be derived from heuristic statistical…

Machine Learning · Computer Science 2020-01-22 Marylou Gabrié , Andre Manoel , Clément Luneau , Jean Barbier , Nicolas Macris , Florent Krzakala , Lenka Zdeborová

Spatial and visual connectivity are important metrics when developing workplace layouts. Calculating those metrics in real-time can be difficult, depending on the size of the floor plan being analysed and the resolution of the analyses.…

Machine Learning · Computer Science 2020-01-01 Sherif Tarabishy , Stamatios Psarras , Marcin Kosicki , Martha Tsigkari

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

We consider optimal experimental design for parameter estimation in dynamical systems governed by controlled ordinary differential equations. In such problems, Fisher-based criteria are attractive because they lead to time-additive…

Optimization and Control · Mathematics 2026-04-08 Luc de Montella , Sebastian Sager

Designing models that produce accurate predictions is the fundamental objective of machine learning (ML). This work presents methods demonstrating that when the derivatives of target variables (outputs) with respect to inputs can be…

Machine Learning · Computer Science 2022-01-17 Chris McDonagh , Xi Chen