English
Related papers

Related papers: The Local Interaction Basis: Identifying Computati…

200 papers

There is currently a large gap in performance between the statistically rigorous methods like linear regression or additive splines and the powerful deep methods using neural networks. Previous works attempting to close this gap have failed…

Machine Learning · Computer Science 2023-11-08 James Enouen , Yan Liu

Local model interpretation methods explain individual predictions by assigning an importance value to each input feature. This value is often determined by measuring the change in confidence when a feature is removed. However, the…

Computation and Language · Computer Science 2018-11-08 Eric Wallace , Shi Feng , Jordan Boyd-Graber

The dynamics of neuron populations commonly evolve on low-dimensional manifolds. Thus, we need methods that learn the dynamical processes over neural manifolds to infer interpretable and consistent latent representations. We introduce a…

Machine Learning · Computer Science 2025-01-31 Adam Gosztolai , Robert L. Peach , Alexis Arnaudon , Mauricio Barahona , Pierre Vandergheynst

Inspired by cognitive neuroscience studies, we introduce a novel `decoding probing' method that uses minimal pairs benchmark (BLiMP) to probe internal linguistic characteristics in neural language models layer by layer. By treating the…

Computation and Language · Computer Science 2024-03-27 Linyang He , Peili Chen , Ercong Nie , Yuanning Li , Jonathan R. Brennan

Understanding how information is represented in neural networks is a fundamental challenge in both neuroscience and artificial intelligence. Despite their nonlinear architectures, recent evidence suggests that neural networks encode…

Machine Learning · Computer Science 2025-03-04 David Klindt , Charles O'Neill , Patrik Reizinger , Harald Maurer , Nina Miolane

Many risk-sensitive applications require Machine Learning (ML) models to be interpretable. Attempts to obtain interpretable models typically rely on tuning, by trial-and-error, hyper-parameters of model complexity that are only loosely…

Machine Learning · Computer Science 2020-05-29 Marco Virgolin , Andrea De Lorenzo , Eric Medvet , Francesca Randone

We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph. Unlike existing multi-task learning methodologies, the graph structure is not assumed…

Machine Learning · Computer Science 2020-09-15 Shujian Yu , Francesco Alesiani , Ammar Shaker , Wenzhe Yin

Understanding the function of individual neurons within language models is essential for mechanistic interpretability research. We propose $\textbf{Neuron to Graph (N2G)}$, a tool which takes a neuron and its dataset examples, and…

Machine Learning · Computer Science 2023-04-26 Alex Foote , Neel Nanda , Esben Kran , Ionnis Konstas , Fazl Barez

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Content-based image retrieval (CBIR) systems have emerged as crucial tools in the field of computer vision, allowing for image search based on visual content rather than relying solely on metadata. This survey paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Hamed Qazanfari , Mohammad M. AlyanNezhadi , Zohreh Nozari Khoshdaregi

The interpretability of neural networks (NNs) is a challenging but essential topic for transparency in the decision-making process using machine learning. One of the reasons for the lack of interpretability is random weight initialization,…

Machine Learning · Computer Science 2021-03-01 Shohei Kubota , Hideaki Hayashi , Tomohiro Hayase , Seiichi Uchida

We present a reusable dataset and accompanying infrastructure for studying human search behavior in Interactive Information Retrieval (IIR). The dataset combines detailed interaction logs from 61 participants (122 sessions) with user…

Information Retrieval · Computer Science 2026-01-15 Jana Isabelle Friese , Andreas Konstantin Kruff , Philipp Schaer , Norbert Fuhr , Nicola Ferro

Joint representation of geometry, colour and semantics using a 3D neural field enables accurate dense labelling from ultra-sparse interactions as a user reconstructs a scene in real-time using a handheld RGB-D sensor. Our iLabel system…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Shuaifeng Zhi , Edgar Sucar , Andre Mouton , Iain Haughton , Tristan Laidlow , Andrew J. Davison

Token interaction operation is one of the core modules in MLP-based models to exchange and aggregate information between different spatial locations. However, the power of token interaction on the spatial dimension is highly dependent on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Guiping Cao , Shengda Luo , Wenjian Huang , Xiangyuan Lan , Dongmei Jiang , Yaowei Wang , Jianguo Zhang

Masked Image Modeling (MIM) achieves outstanding success in self-supervised representation learning. Unfortunately, MIM models typically have huge computational burden and slow learning process, which is an inevitable obstacle for their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haoqing Wang , Yehui Tang , Yunhe Wang , Jianyuan Guo , Zhi-Hong Deng , Kai Han

Text-based person search is a sub-task in the field of image retrieval, which aims to retrieve target person images according to a given textual description. The significant feature gap between two modalities makes this task very…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Yuhao Chen , Guoqing Zhang , Yujiang Lu , Zhenxing Wang , Yuhui Zheng , Ruili Wang

An important problem in the field of bioinformatics is to identify interactive effects among profiled variables for outcome prediction. In this paper, a logistic regression model with pairwise interactions among a set of binary covariates…

Artificial Intelligence · Computer Science 2016-12-30 Easton Li Xu , Xiaoning Qian , Tie Liu , Shuguang Cui

Advanced machine learning algorithms are increasingly utilized to provide data-based prediction and decision-making support in Industry 4.0. However, the prediction accuracy achieved by the existing models is insufficient to warrant…

Machine Learning · Computer Science 2024-03-06 Zhipeng Ma , Bo Nørregaard Jørgensen , Zheng Grace Ma

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

Machine Learning · Computer Science 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

Today's autonomous agents, largely driven by foundation models (FMs), can understand natural language instructions and solve long-horizon tasks with human-like reasoning. However, current human-robot interaction largely follows a one-way…

Robotics · Computer Science 2026-03-17 Linus Nwankwo , Bjoern Ellensohn , Christian Rauch , Elmar Rueckert