English
Related papers

Related papers: Jacobian-Based Interpretation of Nonlinear Neural …

200 papers

Neuron Interpretation has gained traction in the field of interpretability, and have provided fine-grained insights into what a model learns and how language knowledge is distributed amongst its different components. However, the lack of…

Computation and Language · Computer Science 2023-11-07 Yimin Fan , Fahim Dalvi , Nadir Durrani , Hassan Sajjad

Deep learning based methods hold state-of-the-art results in low-level image processing tasks, but remain difficult to interpret due to their black-box construction. Unrolled optimization networks present an interpretable alternative to…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang

Current linearizing encoding models that predict neural responses to sensory input typically neglect neuroscience-inspired constraints that could enhance model efficiency and interpretability. To address this, we propose a new method called…

Physics-Informed Neural Networks (PINNs) offer a powerful framework for solving PDEs by embedding physical laws into the learning process. However, when applied to domains with irregular boundaries, PINNs often suffer from instability and…

Machine Learning · Computer Science 2026-05-29 Xi Chen , Jianchuan Yang , Junjie Zhang , Runnan Yang , Xu Liu , Hong Wang , Tinghui Zheng , Ziyu Ren , Wenqi Hu

jNO (jax Neural Operators) is a JAX-native library for neural operators and foundation models with unified support for both data-driven and physics-informed training. Its core design is a tracing system in which domains, model calls,…

Machine Learning · Computer Science 2026-05-12 Leon Armbruster , Rathan Ramesh , Georg Kruse , Christopher Straub

Animal brains flexibly and efficiently achieve many behavioral tasks with a single neural network. A core goal in modern neuroscience is to map the mechanisms of the brain's flexibility onto the dynamics underlying neural populations.…

Neurons and Cognition · Quantitative Biology 2026-03-12 Anirudh Jamkhandi , Ali Korojy , Olivier Codol , Guillaume Lajoie , Matthew G. Perich

We introduce Variational Joint Embedding (VJE), a reconstruction-free latent-variable framework for non-contrastive self-supervised learning in representation space. VJE maximizes a symmetric conditional evidence lower bound (ELBO) on…

Machine Learning · Computer Science 2026-04-27 Amin Oji , Paul Fieguth

Adversarial examples are crafted with imperceptible perturbations with the intent to fool neural networks. Against such attacks, adversarial training and its variants stand as the strongest defense to date. Previous studies have pointed out…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Alvin Chan , Yi Tay , Yew Soon Ong , Jie Fu

Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of the brain has long been an intriguing pursuit…

Neurons and Cognition · Quantitative Biology 2022-07-26 Hejie Cui , Wei Dai , Yanqiao Zhu , Xiaoxiao Li , Lifang He , Carl Yang

Neural operators have recently become popular tools for designing solution maps between function spaces in the form of neural networks. Differently from classical scientific machine learning approaches that learn parameters of a known…

Machine Learning · Computer Science 2022-09-07 Huaiqian You , Yue Yu , Marta D'Elia , Tian Gao , Stewart Silling

Characterizing the cellular properties of neurons is fundamental to understanding their function in the brain. In this quest, the generation of bio-realistic models is central towards integrating multimodal cellular data sets and…

Encoding models are used for predicting brain activity in response to sensory stimuli with the objective of elucidating how sensory information is represented in the brain. Encoding models typically comprise a nonlinear transformation of…

Neurons and Cognition · Quantitative Biology 2017-03-13 Umut Güçlü , Marcel A. J. van Gerven

Psychiatric questionnaires are highly context sensitive and often only weakly predict subsequent symptom severity, which makes the prognostic relationship difficult to learn. Although flexible nonlinear models can improve predictive…

Machine Learning · Computer Science 2026-03-02 Eric V. Strobl

We describe, implement and test a novel method for training neural networks to estimate the Jacobian matrix $J$ of an unknown multivariate function $F$. The training set is constructed from finitely many pairs $(x,F(x))$ and it contains no…

Machine Learning · Computer Science 2022-04-04 Frédéric Latrémolière , Sadananda Narayanappa , Petr Vojtěchovský

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters…

Machine Learning · Statistics 2021-11-10 Pedro L. C. Rodrigues , Thomas Moreau , Gilles Louppe , Alexandre Gramfort

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

Modeling the behavior of coupled networks is challenging due to their intricate dynamics. For example in neuroscience, it is of critical importance to understand the relationship between the functional neural processes and anatomical…

Machine Learning · Computer Science 2021-04-20 Hongyuan You , Sikun Lin , Ambuj K. Singh

In standard clinical within-subject analyses of event-related fMRI data, two steps are usually performed separately: detection of brain activity and estimation of the hemodynamic response. Because these two steps are inherently linked, we…

Applications · Statistics 2012-02-08 Lotfi Chaari , Thomas Vincent , Florence Forbes , Michel Dojat , Philippe Ciuciu

Despite substantial efforts, neural network interpretability remains an elusive goal, with previous research failing to provide succinct explanations of most single neurons' impact on the network output. This limitation is due to the…

Machine Learning · Computer Science 2024-02-01 Simon C. Marshall , Jan H. Kirchner

Accelerated multi-coil magnetic resonance imaging reconstruction has seen a substantial recent improvement combining compressed sensing with deep learning. However, most of these methods rely on estimates of the coil sensitivity profiles,…

Signal Processing · Electrical Eng. & Systems 2021-04-13 Marius Arvinte , Sriram Vishwanath , Ahmed H. Tewfik , Jonathan I. Tamir