English
Related papers

Related papers: Neuron-Anchored Rule Extraction for Large Language…

200 papers

Rule-based models offer interpretability but struggle with complex data, while deep neural networks excel in performance yet lack transparency. This work investigates a neuro-symbolic rule learning neural network named RL-Net that learns…

Machine Learning · Computer Science 2025-07-01 Sarah Seifi , Tobias Sukianto , Cecilia Carbonelli , Lorenzo Servadei , Robert Wille

Recent advancements in Chain-of-Thought prompting have facilitated significant breakthroughs for Large Language Models (LLMs) in complex reasoning tasks. Current research enhances the reasoning performance of LLMs by sampling multiple…

Computation and Language · Computer Science 2024-05-22 Zhangyue Yin , Qiushi Sun , Qipeng Guo , Zhiyuan Zeng , Xiaonan Li , Tianxiang Sun , Cheng Chang , Qinyuan Cheng , Ding Wang , Xiaofeng Mou , Xipeng Qiu , XuanJing Huang

This paper introduces an approach to increasing the explainability of artificial intelligence (AI) systems by embedding Large Language Models (LLMs) within standardized analytical processes. While traditional explainable AI (XAI) methods…

Artificial Intelligence · Computer Science 2025-11-11 Marc Jansen , Marcel Pehlke

Explainable Artificial Intelligence (XAI) is targeted at understanding how models perform feature selection and derive their classification decisions. This paper explores post-hoc explanations for deep neural networks in the audio domain.…

Large language models (LLMs) are predominantly used as evaluators for natural language generation (NLG) tasks, but their application to broader evaluation scenarios remains limited. In this work, we explore the potential of LLMs as general…

Artificial Intelligence · Computer Science 2025-12-02 Jie Meng , Jin Mao

Neuron pruning is widely used to reduce the computational cost and parameter footprint of large language models, yet it remains unclear whether neurons in task-specific models contribute uniformly to task performance. In this work, we…

Large Language Models (LLMs) have shown remarkable reasoning performance but struggle with multi-step deductive reasoning involving a series of rule application steps, especially when rules are presented non-sequentially. Our preliminary…

Computation and Language · Computer Science 2024-08-27 Siyuan Wang , Zhongyu Wei , Yejin Choi , Xiang Ren

Active learning (AL) is a promising ML paradigm that has the potential to parse through large unlabeled data and help reduce annotation cost in domains where labeling data can be prohibitive. Recently proposed neural network based AL…

Machine Learning · Computer Science 2022-06-17 Prateek Munjal , Nasir Hayat , Munawar Hayat , Jamshid Sourati , Shadab Khan

Knowledge extraction is used to convert neural networks into symbolic descriptions with the objective of producing more comprehensible learning models. The central challenge is to find an explanation which is more comprehensible than the…

Artificial Intelligence · Computer Science 2020-03-23 Simon Odense , Artur d'Avila Garcez

Neural networks (NNs) have been successfully applied to solve a variety of application problems involving classification and function approximation. Although backpropagation NNs generally predict better than decision trees do for pattern…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman

We propose and implement an interpretable machine learning classification model for Explainable AI (XAI) based on expressive Boolean formulas. Potential applications include credit scoring and diagnosis of medical conditions. The Boolean…

Large Language Models (LLMs) are widely deployed in real-world applications, yet their internal mechanisms remain difficult to interpret and control, limiting our ability to diagnose and correct undesirable behaviors. Mechanistic…

Deep Learning (DL) models processing images to recognize the health state of large infrastructure components can exhibit biases and rely on non-causal shortcuts. eXplainable Artificial Intelligence (XAI) can address these issues but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Giovanni Floreale , Piero Baraldi , Enrico Zio , Olga Fink

We present an algorithm, NN2Rules, to convert a trained neural network into a rule list. Rule lists are more interpretable since they align better with the way humans make decisions. NN2Rules is a decompositional approach to rule…

Machine Learning · Computer Science 2022-07-26 G Roshan Lal , Varun Mithal

Rule-based reasoning is acknowledged as one of the fundamental problems of reasoning. While recent studies show that large reasoning models (LRMs) have remarkable reasoning capabilities enhanced by reinforcement learning (RL), real…

Computation and Language · Computer Science 2026-02-17 Yang Liu , Jiaqi Li , Zilong Zheng

Many high-performance models suffer from a lack of interpretability. There has been an increasing influx of work on explainable artificial intelligence (XAI) in order to disentangle what is meant and expected by XAI. Nevertheless, there is…

Machine Learning · Computer Science 2019-10-23 Adrien Bennetot , Jean-Luc Laurent , Raja Chatila , Natalia Díaz-Rodríguez

As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Sam Sattarzadeh , Mahesh Sudhakar , Anthony Lem , Shervin Mehryar , K. N. Plataniotis , Jongseong Jang , Hyunwoo Kim , Yeonjeong Jeong , Sangmin Lee , Kyunghoon Bae

This paper describes an efficient algorithm REx for generating symbolic rules from artificial neural network (ANN). Classification rules are sought in many areas from automatic knowledge acquisition to data mining and ANN rule extraction.…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman

Rule-based rewards offer a promising strategy for improving reinforcement learning from human feedback (RLHF), but current approaches often rely on manual rule engineering. We present AutoRule, a fully automated method for extracting rules…

Machine Learning · Computer Science 2025-06-19 Tevin Wang , Chenyan Xiong

Large language models generate complex, open-ended outputs: instead of outputting a class label they write summaries, generate dialogue, or produce working code. In order to asses the reliability of these open-ended generation systems, we…

Computation and Language · Computer Science 2022-11-28 Erik Jones , Jacob Steinhardt