English
Related papers

Related papers: GINN-LP: A Growing Interpretable Neural Network fo…

200 papers

Our algorithm GNN: Graph Neural Network and Large Language Model for Data Discovery inherit the benefits of \cite{hoang2024plod} (PLOD: Predictive Learning Optimal Data Discovery), \cite{Hoang2024BODBO} (BOD: Blindly Optimal Data Discovery)…

Databases · Computer Science 2024-08-28 Thomas Hoang

Pretrained transformer-based Language Models (LMs) are well-known for their ability to achieve significant improvement on NLP tasks, but their black-box nature, which leads to a lack of interpretability, has been a major concern. My…

Computation and Language · Computer Science 2024-12-06 Ximing Wen

In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Bo Zhang , Chao Yang

Implicit Neural Representation (INR) has gained increasing popularity as a data representation method, serving as a prerequisite for innovative generation models. Unlike gradient-based methods, which exhibit lower efficiency in inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shuyi Zhang , Ke Liu , Jingjun Gu , Xiaoxu Cai , Zhihua Wang , Jiajun Bu , Haishuai Wang

Graph Neural Networks (GNNs) have emerged as the predominant approach for learning over graph-structured data. However, most GNNs operate as black-box models and require post-hoc explanations, which may not suffice in high-stakes scenarios…

Machine Learning · Computer Science 2025-10-14 Maya Bechler-Speicher , Amir Globerson , Ran Gilad-Bachrach

This work aims to provide an effective deep learning framework to predict the vector-soliton solutions of the coupled nonlinear equations and their interactions. The method we propose here is a physics-informed neural network (PINN)…

Numerical Analysis · Mathematics 2022-11-23 Shu-Mei Qin , Min Li , Tao Xu , Shao-Qun Dong

Symbolic regression is a powerful technique that can discover analytical equations that describe data, which can lead to explainable models and generalizability outside of the training data set. In contrast, neural networks have achieved…

Machine Learning · Computer Science 2022-03-10 Samuel Kim , Peter Y. Lu , Srijon Mukherjee , Michael Gilbert , Li Jing , Vladimir Čeperić , Marin Soljačić

Implicit neural representations (INR) have gained significant popularity for signal and image representation for many end-tasks, such as superresolution, 3D modeling, and more. Most INR architectures rely on sinusoidal positional encoding,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Rajhans Singh , Ankita Shukla , Pavan Turaga

Solving constrained nonlinear optimization problems (CNLPs) is a longstanding problem that arises in various fields, e.g., economics, computer science, and engineering. We propose optimization-informed neural networks (OINN), a deep…

Optimization and Control · Mathematics 2023-06-27 Dawen Wu , Abdel Lisser

Mathematical equations have been unreasonably effective in describing complex natural phenomena across various scientific disciplines. However, discovering such insightful equations from data presents significant challenges due to the…

Machine Learning · Computer Science 2025-03-21 Parshin Shojaee , Kazem Meidani , Shashank Gupta , Amir Barati Farimani , Chandan K Reddy

Interpreting complex neural networks is crucial for understanding their decision-making processes, particularly in applications where transparency and accountability are essential. This proposed method addresses this need by focusing on…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Deepshikha Bhati , Fnu Neha , Md Amiruzzaman , Angela Guercio , Deepak Kumar Shukla , Ben Ward

We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent…

Machine Learning · Computer Science 2020-11-19 Miles Cranmer , Alvaro Sanchez-Gonzalez , Peter Battaglia , Rui Xu , Kyle Cranmer , David Spergel , Shirley Ho

A mechanistic understanding of how MLPs do computation in deep neural networks remains elusive. Current interpretability work can extract features from hidden activations over an input dataset but generally cannot explain how MLP weights…

Machine Learning · Computer Science 2025-06-26 Michael T. Pearce , Thomas Dooms , Alice Rigg , Jose M. Oramas , Lee Sharkey

Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed…

Machine Learning · Computer Science 2025-05-30 Chang Yue , Niraj K. Jha

Recent advances in machine learning have led to a surge in adoption of neural networks for various tasks, but lack of interpretability remains an issue for many others in which an understanding of the features influencing the prediction is…

Graph Neural Networks (GNNs) have emerged as a prominent framework for graph mining, leading to significant advances across various domains. Stemmed from the node-wise representations of GNNs, existing explanation studies have embraced the…

Machine Learning · Computer Science 2024-07-03 Yuwen Wang , Shunyu Liu , Tongya Zheng , Kaixuan Chen , Mingli Song

When neural networks are used to solve differential equations, they usually produce solutions in the form of black-box functions that are not directly mathematically interpretable. We introduce a method for generating symbolic expressions…

Machine Learning · Computer Science 2020-11-05 Maysum Panju , Ali Ghodsi

Many recent studies focus on developing mechanisms to explain the black-box behaviors of neural networks (NNs). However, little work has been done to extract the potential hidden semantics (mathematical representation) of a neural network.…

Machine Learning · Computer Science 2022-04-25 Yuanzhen Luo , Qiang Lu , Xilei Hu , Jake Luo , Zhiguang Wang

We introduce a class of Sparse, Physics-based, and partially Interpretable Neural Networks (SPINN) for solving ordinary and partial differential equations (PDEs). By reinterpreting a traditional meshless representation of solutions of PDEs…

Machine Learning · Computer Science 2021-08-13 Amuthan A. Ramabathiran , Prabhu Ramachandran

The capability of making interpretable and self-explanatory decisions is essential for developing responsible machine learning systems. In this work, we study the learning to explain problem in the scope of inductive logic programming…

Artificial Intelligence · Computer Science 2020-02-20 Yuan Yang , Le Song