English
Related papers

Related papers: An NMF-Based Building Block for Interpretable Neur…

200 papers

Matrix factorization (MF) is a simple collaborative filtering technique that achieves superior recommendation accuracy by decomposing the user-item interaction matrix into user and item latent matrices. Because the model typically learns…

Information Retrieval · Computer Science 2024-03-11 Kai Sugahara , Kazushi Okamoto

Large Language Models (LLMs) have significantly advanced the field of Natural Language Processing (NLP), but their lack of interpretability has been a major concern. Current methods for interpreting LLMs are post hoc, applied after…

Computation and Language · Computer Science 2023-11-14 Sean Xie , Soroush Vosoughi , Saeed Hassanpour

Existing approaches to explaining deep learning models in NLP usually suffer from two major drawbacks: (1) the main model and the explaining model are decoupled: an additional probing or surrogate model is used to interpret an existing…

Computation and Language · Computer Science 2020-12-10 Zijun Sun , Chun Fan , Qinghong Han , Xiaofei Sun , Yuxian Meng , Fei Wu , Jiwei Li

Neural machine translation systems require a number of stacked layers for deep models. But the prediction depends on the sentence representation of the top-most layer with no access to low-level representations. This makes it more difficult…

Computation and Language · Computer Science 2020-02-18 Qiang Wang , Fuxue Li , Tong Xiao , Yanyang Li , Yinqiao Li , Jingbo Zhu

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li

Training neural machine translation (NMT) models in federated learning (FL) settings could be inefficient both computationally and communication-wise, due to the large size of translation engines as well as the multiple rounds of updates…

Computation and Language · Computer Science 2021-12-14 Tanya Roosta , Peyman Passban , Ankit Chadha

Brain tumor classification from magnetic resonance imaging, which is also known as MRI, plays a sensitive role in computer-assisted diagnosis systems. In recent years, deep learning models have achieved high classification accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hiba Adil Al-kharsan , Róbert Rajkó

Monitoring Machine Learning (ML) models in production environments is crucial, yet traditional approaches often yield verbose, low-interpretability outputs that hinder effective decision-making. We propose a cognitive architecture for ML…

Machine Learning · Computer Science 2025-06-12 Gusseppe Bravo-Rocca , Peini Liu , Jordi Guitart , Rodrigo M Carrillo-Larco , Ajay Dholakia , David Ellison

Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process of prediction error minimization. PC networks (PCNs) are…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

Despite the ubiquity of tabular data in high-stakes domains, traditional deep learning architectures often struggle to match the performance of gradient-boosted decision trees while maintaining scientific interpretability. Standard neural…

Machine Learning · Computer Science 2026-01-29 Fang Li

Neural Module Network (NMN) exhibits strong interpretability and compositionality thanks to its handcrafted neural modules with explicit multi-hop reasoning capability. However, most NMNs suffer from two critical drawbacks: 1) scalability:…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Wenhu Chen , Zhe Gan , Linjie Li , Yu Cheng , William Wang , Jingjing Liu

Transformer networks have revolutionized NLP representation learning since they were introduced. Though a great effort has been made to explain the representation in transformers, it is widely recognized that our understanding is not…

Computation and Language · Computer Science 2023-04-05 Zeyu Yun , Yubei Chen , Bruno A Olshausen , Yann LeCun

Federated continual learning (FCL) aims to learn from sequential data stream in the decentralized federated learning setting, while simultaneously mitigating the catastrophic forgetting issue in classical continual learning. Existing FCL…

Machine Learning · Computer Science 2024-12-25 Yuchen He , Chuyun Shen , Xiangfeng Wang , Bo Jin

While achieving tremendous success in various fields, existing multi-agent reinforcement learning (MARL) with a black-box neural network makes decisions in an opaque manner that hinders humans from understanding the learned knowledge and…

Machine Learning · Computer Science 2025-03-05 Zichuan Liu , Yuanyang Zhu , Zhi Wang , Yang Gao , Chunlin Chen

This paper presents a novel neural model - Dynamic Fusion Network (DFN), for machine reading comprehension (MRC). DFNs differ from most state-of-the-art models in their use of a dynamic multi-strategy attention process, in which passages,…

Computation and Language · Computer Science 2018-02-28 Yichong Xu , Jingjing Liu , Jianfeng Gao , Yelong Shen , Xiaodong Liu

Interpretable machine learning has become a strong competitor for traditional black-box models. However, the possible loss of the predictive performance for gaining interpretability is often inevitable, putting practitioners in a dilemma of…

Machine Learning · Computer Science 2019-05-13 Tong Wang , Qihang Lin

The AC optimal power flow (AC-OPF) problem is essential for power system operations, but its non-convex nature makes it challenging to solve. A widely used simplification is the linearized DC optimal power flow (DC-OPF) problem, which can…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Salvador Pineda , Juan Pérez-Ruiz , Juan Miguel Morales

We explore the use of FCNNs (Fully Connected Neural Networks) for designing end-to-end communication systems without taking any inspiration from existing classical communications models or error control coding. This work relies solely on…

Machine Learning · Computer Science 2024-09-10 Sudharsan Senthil , Shubham Paul , Nambi Seshadri , R. David Koilpillai

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Imitation learning considerably simplifies policy synthesis compared to alternative approaches by exploiting access to expert demonstrations. For such imitation policies, errors away from the training samples are particularly critical. Even…

Machine Learning · Computer Science 2024-03-19 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , James Weimer , Insup Lee