English
Related papers

Related papers: Mathematical Foundation of Interpretable Equivaria…

200 papers

An essential goal in mechanistic interpretability to decode a network, i.e., to convert a neural network's raw weights to an interpretable algorithm. Given the difficulty of the decoding problem, progress has been made to understand the…

Machine Learning · Computer Science 2023-12-07 Isaac Liao , Ziming Liu , Max Tegmark

Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks by mapping the entities and relations from a knowledge graph into a geometric space (usually a vector space). Ultimately, the plausibility of the…

Machine Learning · Computer Science 2020-10-20 Mojtaba Nayyeri , Chengjin Xu , Jens Lehmann , Sahar Vahdati

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

With the growing popularity of artificial intelligence used for scientific applications, the ability of attribute a result to a reasoning process from the network is in high demand for robust scientific generalizations to hold. In this work…

High Energy Physics - Experiment · Physics 2025-09-18 Margaret Voetberg , Vitor F. Grizzi , Giuseppe Cerati , Hadi Meidani , V Hewes

The very challenging task of learning solution operators of PDEs on arbitrary domains accurately and efficiently is of vital importance to engineering and industrial simulations. Despite the existence of many operator learning algorithms to…

Machine Learning · Computer Science 2026-01-14 Shizheng Wen , Arsh Kumbhat , Levi Lingsch , Sepehr Mousavi , Yizhou Zhao , Praveen Chandrashekar , Siddhartha Mishra

Nonlinear manifolds are pervasive in deep visual features, where Euclidean distances can misrepresent true similarity. This mismatch is particularly detrimental to prototype-based interpretable fine-grained recognition, where even subtle…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Junhao Jia , Yunyou Liu , Yifei Sun , Huangwei Chen , Feiwei Qin , Changmiao Wang , Yong Peng

Modern high-throughput biological datasets with thousands of perturbations provide the opportunity for large-scale discovery of causal graphs that represent the regulatory interactions between genes. Differentiable causal graphical models…

Machine Learning · Computer Science 2025-11-14 Zaikang Lin , Sei Chang , Aaron Zweig , Minseo Kang , Elham Azizi , David A. Knowles

Advances in machine learning have led to graph neural network-based methods for drug discovery, yielding promising results in molecular design, chemical synthesis planning, and molecular property prediction. However, current graph neural…

Quantitative Methods · Quantitative Biology 2021-07-13 Jiahua Rao , Shuangjia Zheng , Yuedong Yang

Scientific machine learning has seen significant progress with the emergence of operator learning. However, existing methods encounter difficulties when applied to problems on unstructured grids and irregular domains. Spatial graph neural…

Machine Learning · Computer Science 2024-09-04 Subhankar Sarkar , Souvik Chakraborty

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Operator learning offers a powerful paradigm for solving parametric partial differential equations (PDEs), but scaling probabilistic neural operators such as the recently proposed Gaussian Processes Operators (GPOs) to high-dimensional,…

Machine Learning · Statistics 2025-06-23 Sawan Kumar , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

Explainability in Graph Neural Networks (GNNs) is a new field growing in the last few years. In this publication we address the problem of determining how important is each neighbor for the GNN when classifying a node and how to measure the…

Graph neural networks (GNNs) provide a powerful and scalable solution for modeling continuous spatial data. However, they often rely on Euclidean distances to construct the input graphs. This assumption can be improbable in many real-world…

Machine Learning · Computer Science 2023-02-20 Konstantin Klemmer , Nathan Safir , Daniel B. Neill

Generative Adversarial Networks (GANs) have recently achieved impressive results for many real-world applications, and many GAN variants have emerged with improvements in sample quality and training stability. However, they have not been…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Bolei Zhou , Joshua B. Tenenbaum , William T. Freeman , Antonio Torralba

The study of $G$-equivariant operators is of great interest to explain and understand the architecture of neural networks. In this paper we show that each linear $G$-equivariant operator can be produced by a suitable permutant measure,…

Group Theory · Mathematics 2022-03-11 Giovanni Bocchi , Stefano Botteghi , Martina Brasini , Patrizio Frosini , Nicola Quercioli

Graph Neural Networks (GNNs) have achieved outstanding performance across a wide range of graph-related tasks. However, their "black-box" nature poses significant challenges to their explainability, and existing methods often fail to…

Machine Learning · Computer Science 2025-07-25 Lijun Wu , Dong Hao , Zhiyi Fan

Learning semantically meaningful image transformations (i.e. rotation, thickness, blur) directly from examples can be a challenging task. Recently, the Manifold Autoencoder (MAE) proposed using a set of Lie group operators to learn image…

Image and Video Processing · Electrical Eng. & Systems 2025-04-22 Brighton Ancelin , Yenho Chen , Peimeng Guan , Chiraag Kaushik , Belen Martin-Urcelay , Alex Saad-Falcon , Nakul Singh

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li