English
Related papers

Related papers: Demystifying Functional Random Forests: Novel Expl…

200 papers

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

Statistical Finance · Quantitative Finance 2017-11-27 Joongyeub Yeo , George Papanicolaou

In order to trust the predictions of a machine learning algorithm, it is necessary to understand the factors that contribute to those predictions. In the case of probabilistic and uncertainty-aware models, it is necessary to understand not…

Machine Learning · Statistics 2024-08-19 Danny Wood , Theodore Papamarkou , Matt Benatan , Richard Allmendinger

Interpretation of deep learning models is a very challenging problem because of their large number of parameters, complex connections between nodes, and unintelligible feature representations. Despite this, many view interpretability as a…

Machine Learning · Computer Science 2021-03-05 Michael Tsang , James Enouen , Yan Liu

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

Density regression models allow a comprehensive understanding of data by modeling the complete conditional probability distribution. While flexible estimation approaches such as normalizing flows (NF) work particularly well in multiple…

Machine Learning · Statistics 2025-06-13 Marcel Arpogaus , Thomas Kneib , Thomas Nagler , David Rügamer

Decomposition plays a significant role in cooperative co-evolution which shows great potential in large scale black-box optimization. However, current popular decomposition algorithms generally require to sample and evaluate a large number…

Optimization and Control · Mathematics 2019-05-30 Zhigang Ren , An Chen , Yaochu Jin , Wenhua Guo , Yongsheng Liang , Zuren Feng

Interpretability is becoming an active research topic as machine learning (ML) models are more widely used to make critical decisions. Tabular data is one of the most commonly used modes of data in diverse applications such as healthcare…

Machine Learning · Statistics 2021-12-01 Amirata Ghorbani , Dina Berenbaum , Maor Ivgi , Yuval Dafna , James Zou

Forward marginal effects have recently been introduced as a versatile and effective model-agnostic interpretation method particularly suited for non-linear and non-parametric prediction models. They provide comprehensible model explanations…

Machine Learning · Computer Science 2024-09-13 Holger Löwe , Christian A. Scholbeck , Christian Heumann , Bernd Bischl , Giuseppe Casalicchio

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able to employ costly…

Machine Learning · Computer Science 2023-12-19 Merlijn Krale , Thiago D. Simão , Jana Tumova , Nils Jansen

One of the most popular approaches to understanding feature effects of modern black box machine learning models are partial dependence plots (PDP). These plots are easy to understand but only able to visualize low order dependencies. The…

Machine Learning · Statistics 2019-12-17 Gero Szepannek

Formal Concept Analysis (FCA) is a mathematical framework for knowledge representation and discovery. It performs a hierarchical clustering over a set of objects described by attributes, resulting in conceptual structures in which objects…

Artificial Intelligence · Computer Science 2025-08-12 Jessie Galasso

Advancements in data-driven machine learning have emerged as a pivotal element in supporting automotive software systems (ASSs) engineering across various levels of the V-development process.…

Software Engineering · Computer Science 2026-03-10 Mohammad Abboush , Ehab Ghannoum , Andreas Rausch

Face Recognition (FR) has advanced significantly with the development of deep learning, achieving high accuracy in several applications. However, the lack of interpretability of these systems raises concerns about their accountability,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Ivan DeAndres-Tame , Muhammad Faisal , Ruben Tolosana , Rouqaiah Al-Refai , Ruben Vera-Rodriguez , Philipp Terhörst

Penalized regression methods are an attractive tool for high-dimensional data analysis, but their widespread adoption has been hampered by the difficulty of applying inferential tools. In particular, the question "How reliable is the…

Statistics Theory · Mathematics 2026-05-13 Patrick Breheny

Regression problems have been more and more embraced by deep learning (DL) techniques. The increasing number of papers recently published in this domain, including surveys and reviews, shows that deep regression has captured the attention…

Machine Learning · Computer Science 2022-09-12 Jorge S. S. Júnior , Jérôme Mendes , Francisco Souza , Cristiano Premebida

Algorithms are powerful and necessary tools behind a large part of the information we use every day. However, they may introduce new sources of bias, discrimination and other unfair practices that affect people who are unaware of it.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Francesco Ventura , Tania Cerquitelli

Interpretable AI tools are often motivated by the goal of understanding model behavior in out-of-distribution (OOD) contexts. Despite the attention this area of study receives, there are comparatively few cases where these tools have…

Machine Learning · Computer Science 2023-09-25 Stephen Casper , Yuxiao Li , Jiawei Li , Tong Bu , Kevin Zhang , Kaivalya Hariharan , Dylan Hadfield-Menell

We tackle the challenges of modeling high-dimensional data sets, particularly those with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships. Our approach enables a seamless integration of concepts…

Machine Learning · Statistics 2025-03-17 Zichuan Guo , Mihai Cucuringu , Alexander Y. Shestopaloff

A major requirement for credit scoring models is to provide a maximally accurate risk prediction. Additionally, regulators demand these models to be transparent and auditable. Thus, in credit scoring, very simple predictive models such as…

Machine Learning · Statistics 2020-09-30 Michael Bücker , Gero Szepannek , Alicja Gosiewska , Przemyslaw Biecek

Piecewise-constant regression trees remain popular for their interpretability, yet often lag behind black-box models like Random Forest in predictive accuracy. In this work, we introduce TRUST (Transparent, Robust, and Ultra-Sparse Trees),…

Methodology · Statistics 2025-06-23 Albert Dorador