English
Related papers

Related papers: Supersparse Linear Integer Models for Interpretabl…

200 papers

Deep Neural Networks use thousands of mostly incomprehensible features to identify a single class, a decision no human can follow. We propose an interpretable sparse and low dimensional final decision layer in a deep neural network with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Thomas Norrenbrock , Marco Rudolph , Bodo Rosenhahn

Machine-learning models are ubiquitous. In some domains, for instance, in medicine, the models' predictions must be interpretable. Decision trees, classification rules, and subgroup discovery are three broad categories of supervised…

Machine Learning · Computer Science 2022-04-29 Vadim Arzamasov , Benjamin Jochum , Klemens Böhm

As a contribution to interpretable machine learning research, we develop a novel optimization framework for learning accurate and sparse two-level Boolean rules. We consider rules in both conjunctive normal form (AND-of-ORs) and disjunctive…

Machine Learning · Statistics 2016-06-21 Guolong Su , Dennis Wei , Kush R. Varshney , Dmitry M. Malioutov

This work proposes a research problem of finding sparse solution of undetermined Linear system with some applications. Two approaches how to solve the compressive sensing problem: using l_1 approach , the l_q approach with 0 < q < 1.…

Optimization and Control · Mathematics 2017-02-24 Maddullah Almerdasy

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

Symbolic regression (SR) aims to discover closed-form mathematical expressions that accurately describe data, offering interpretability and analytical insight beyond standard black-box models. Existing SR methods often rely on…

Machine Learning · Computer Science 2025-06-17 Mansooreh Montazerin , Majd Al Aawar , Antonio Ortega , Ajitesh Srivastava

Linear system identification and sparse dictionary learning can both be seen as structured matrix factorization problems. However, these two problems have historically been studied in isolation by the systems theory and machine learning…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Kyle Poe , Uday Kiran Reddy Tadipatri , Benjamin D. Haeffele , Rene Vidal

Data-driven model discovery (DDMD) algorithms are powerful tools for extracting interpretable symbolic models from data. However, identifying the model that best balances goodness-of-fit and sparsity is often a laborious process requiring…

Quantitative Methods · Quantitative Biology 2026-02-26 Michael C Chung , Alen Zacharia , Juan Guan

This work focuses on the issue of variable selection in functional regression. Unlike most work in this framework, our approach does not select isolated points in the definition domain of the predictors, nor does it rely on the expansion of…

Statistics Theory · Mathematics 2018-03-05 Victor Picheny , Rémi Servien , Nathalie Villa-Vialaneix

Data-driven discovery of model equations is a powerful approach for understanding the behavior of dynamical systems in many scientific fields. In particular, the ability to learn mathematical models from data would benefit systems biology,…

Machine Learning · Computer Science 2025-11-04 G. Pillonetto , A. Giaretta , A. Aravkin , M. Bisiacco , T. Elston

Single Index Models (SIMs) are simple yet flexible semi-parametric models for machine learning, where the response variable is modeled as a monotonic function of a linear combination of features. Estimation in this context requires learning…

Machine Learning · Statistics 2016-12-01 Nikhil Rao , Ravi Ganti , Laura Balzano , Rebecca Willett , Robert Nowak

In several applications, input samples are more naturally represented in terms of similarities between each other, rather than in terms of feature vectors. In these settings, machine-learning algorithms can become very computationally…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Fabio Roli

Sparse linear discriminant analysis via penalized optimal scoring is a successful tool for classification in high-dimensional settings. While the variable selection consistency of sparse optimal scoring has been established, the…

Statistics Theory · Mathematics 2021-04-01 Irina Gaynanova

Sequence classification is the task of predicting a class label given a sequence of observations. In many applications such as healthcare monitoring or intrusion detection, early classification is crucial to prompt intervention. In this…

Machine Learning · Computer Science 2020-10-07 Maayan Shvo , Andrew C. Li , Rodrigo Toro Icarte , Sheila A. McIlraith

Outlier detection is critical in real applications to prevent financial fraud, defend network intrusions, or detecting imminent device failures. To reduce the human effort in evaluating outlier detection results and effectively turn the…

Machine Learning · Computer Science 2023-09-04 Yu Wang , Lei Cao , Yizhou Yan , Samuel Madden

Time-series prediction has drawn considerable attention during the past decades fueled by the emerging advances of deep learning methods. However, most neural network based methods lack interpretability and fail in extracting the hidden…

Machine Learning · Computer Science 2023-03-03 Xiaoyi Liu , Duxin Chen , Wenjia Wei , Xia Zhu , Wenwu Yu

This study proposes a low-complexity interpretable classification system. The proposed system contains three main modules including feature extraction, feature reduction, and classification. All of them are linear. Thanks to the linear…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Tzu-Wei Tseng , Kai-Jiun Yang , C. -C. Jay Kuo , Shang-Ho , Tsai

Interpretable machine learning is essential in high-stakes domains where decision-making requires accountability, transparency, and trust. While rule-based models offer global and exact interpretability, learning rule sets that…

Machine Learning · Computer Science 2026-03-10 Hans Farrell Soegeng , Sarthak Ketanbhai Modi , Thomas Peyrin

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

We demonstrate the synthesis of sparse sampling and machine learning to characterize and model complex, nonlinear dynamical systems over a range of bifurcation parameters. First, we construct modal libraries using the classical proper…

Pattern Formation and Solitons · Physics 2015-10-28 Syuzanna Sargsyan , Steven L. Brunton , J. Nathan Kutz