English
Related papers

Related papers: Metafeatures-based Rule-Extraction for Classifiers…

200 papers

Combining symbolic human knowledge with neural networks provides a rule-based ante-hoc explanation of the output. In this paper, we propose feature extracting functions for integrating human knowledge abstracted as logic rules into the…

Artificial Intelligence · Computer Science 2021-04-13 Shashank Gupta , Antonio Robles-Kelly , Mohamed Reda Bouadjenek

Explaining the behavior of black box machine learning models through human interpretable rules is an important research area. Recent work has focused on explaining model behavior locally i.e. for specific predictions as well as globally…

Machine Learning · Computer Science 2021-05-17 Sukriti Verma , Nikaash Puri , Piyush Gupta , Balaji Krishnamurthy

Mechanistic interpretability strives to explain model behavior in terms of bottom-up primitives. The leading paradigm is to express hidden states as a sparse linear combination of basis vectors, called features. However, this only…

Computation and Language · Computer Science 2025-10-22 Dan Friedman , Adithya Bhaskar , Alexander Wettig , Danqi Chen

Despite the highest classification accuracy in wide varieties of application areas, artificial neural network has one disadvantage. The way this Network comes to a decision is not easily comprehensible. The lack of explanation ability…

Computer Vision and Pattern Recognition · Computer Science 2016-10-18 Tameru Hailesilassie

As opaque decision systems are being increasingly adopted in almost any application field, issues about their lack of transparency and human readability are a concrete concern for end-users. Amongst existing proposals to associate…

Artificial Intelligence · Computer Science 2022-11-02 Federico Sabbatini , Roberta Calegari

Rule-based rewards offer a promising strategy for improving reinforcement learning from human feedback (RLHF), but current approaches often rely on manual rule engineering. We present AutoRule, a fully automated method for extracting rules…

Machine Learning · Computer Science 2025-06-19 Tevin Wang , Chenyan Xiong

In our previous work, we introduced the rule-based Bayesian Regression, a methodology that leverages two concepts: (i) Bayesian inference, for the general framework and uncertainty quantification and (ii) rule-based systems for the…

Machine Learning · Statistics 2022-03-01 Themistoklis Botsas , Lachlan R. Mason , Omar K. Matar , Indranil Pan

RRULES is presented as an improvement and optimization over RULES, a simple inductive learning algorithm for extracting IF-THEN rules from a set of training examples. RRULES optimizes the algorithm by implementing a more effective mechanism…

Machine Learning · Computer Science 2021-06-15 Rafel Palliser-Sans

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

In this paper, we present a novel method to compute decision rules to build a more accurate interpretable machine learning model, denoted as ExMo. The ExMo interpretable machine learning model consists of a list of IF...THEN... statements…

Artificial Intelligence · Computer Science 2022-05-23 Pradip Mainali , Ismini Psychoula , Fabien A. P. Petitcolas

Understanding the behavior of a trained network and finding explanations for its outputs is important for improving the network's performance and generalization ability, and for ensuring trust in automated systems. Several approaches have…

Computation and Language · Computer Science 2018-08-30 Madhumita Sushil , Simon Šuster , Walter Daelemans

Recommendation is a prevalent application of machine learning that affects many users; therefore, it is important for recommender models to be accurate and interpretable. In this work, we propose a method to both interpret and augment the…

Machine Learning · Statistics 2020-06-22 Michael Tsang , Dehua Cheng , Hanpeng Liu , Xue Feng , Eric Zhou , Yan Liu

We introduce a new rule-based optimization method for classification with constraints. The proposed method leverages column generation for linear programming, and hence, is scalable to large datasets. The resulting pricing subproblem is…

Machine Learning · Computer Science 2025-02-07 Tabea E. Röber , Adia C. Lumadjeng , M. Hakan Akyüz , Ş. İlker Birbil

Machine learning methods adapt the parameters of a model, constrained to lie in a given model class, by using a fixed learning procedure based on data or active observations. Adaptation is done on a per-task basis, and retraining is needed…

Machine Learning · Computer Science 2021-10-22 Osvaldo Simeone , Sangwoo Park , Joonhyuk Kang

Machine learning models need to be continually updated or corrected to ensure that the prediction accuracy remains consistently high. In this study, we consider scenarios where developers should be careful to change the prediction results…

Software Engineering · Computer Science 2023-10-17 Hirofumi Suzuki , Hiroaki Iwashita , Takuya Takagi , Yuta Fujishige , Satoshi Hara

This paper considers generalized linear models using rule-based features, also referred to as rule ensembles, for regression and probabilistic classification. Rules facilitate model interpretation while also capturing nonlinear dependences…

Machine Learning · Computer Science 2019-06-06 Dennis Wei , Sanjeeb Dash , Tian Gao , Oktay Günlük

State-of-the-art results in typical classification tasks are mostly achieved by unexplainable machine learning methods, like deep neural networks, for instance. Contrarily, in this paper, we investigate the application of rule learning…

Machine Learning · Computer Science 2024-03-11 Albert Nössig , Tobias Hell , Georg Moser

Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods, little is known about why the resulting feature extractors…

Machine Learning · Computer Science 2020-07-02 Micah Goldblum , Steven Reich , Liam Fowl , Renkun Ni , Valeriia Cherepanova , Tom Goldstein

As machine learning models become more accurate, they typically become more complex and uninterpretable by humans. The black-box character of these models holds back its acceptance in practice, especially in high-risk domains where the…

Artificial Intelligence · Computer Science 2019-08-19 Ajaya Adhikari , D. M. J Tax , Riccardo Satta , Matthias Fath

Lack of labeled training data is a major bottleneck for neural network based aspect and opinion term extraction on product reviews. To alleviate this problem, we first propose an algorithm to automatically mine extraction rules from…

Computation and Language · Computer Science 2019-07-10 Hongliang Dai , Yangqiu Song