English
Related papers

Related papers: Statistical Inference for Explainable Boosting Mac…

200 papers

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

Artificial Intelligence · Computer Science 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious…

Machine Learning · Computer Science 2024-06-11 Cong Geng , Tian Han , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Søren Hauberg , Bo Li

An important issue when using Machine Learning algorithms in recent research is the lack of interpretability. Although these algorithms provide accurate point predictions for various learning problems, uncertainty estimates connected with…

Machine Learning · Statistics 2021-03-11 Burim Ramosaj

This paper compares the performances of three supervised machine learning algorithms in terms of predictive ability and model interpretation on structured or tabular data. The algorithms considered were scikit-learn implementations of…

Machine Learning · Statistics 2022-05-06 Alice J. Liu , Arpita Mukherjee , Linwei Hu , Jie Chen , Vijayan N. Nair

Quantifying the risk of global warming exceeding critical targets such as 2.0 K requires reliable projections of uncertainty as well as best estimates of Global Mean Surface Temperature (GMST). However, uncertainty bands on GMST projections…

Applications · Statistics 2021-01-21 Philip G. Sansom , Donald Cummins , Stephan Siegert , David B. Stephenson

In some situations, the interpretability of the machine learning models plays a role as important as the model accuracy. Interpretability comes from the need to trust the prediction model, verify some of its properties, or even enforce them…

Machine Learning · Computer Science 2024-04-10 Guilherme Seidyo Imai Aldeia , Fabricio Olivetti de Franca

We present XEM, an eXplainable-by-design Ensemble method for Multivariate time series classification. XEM relies on a new hybrid ensemble method that combines an explicit boosting-bagging approach to handle the bias-variance trade-off faced…

Machine Learning · Computer Science 2022-02-16 Kevin Fauvel , Élisa Fromont , Véronique Masson , Philippe Faverdin , Alexandre Termier

Over the past decades, researchers and ML practitioners have come up with better and better ways to build, understand and improve the quality of ML models, but mostly under the key assumption that the training data is distributed…

Machine Learning · Computer Science 2019-10-14 Yeounoh Chung , Peter J. Haas , Eli Upfal , Tim Kraska

Energy-based models (EBMs) provide a powerful and flexible way of learning a joint probability distribution over data by constructing an energy surface. This energy surface enables insight extraction and conditional sampling. We apply EBMs…

Plasma Physics · Physics 2026-05-12 Phil Travis , Troy Carter

Gradient Boosting Machine has proven to be one successful function approximator and has been widely used in a variety of areas. However, since the training procedure of each base learner has to take the sequential order, it is infeasible to…

Machine Learning · Computer Science 2020-06-09 Ji Feng , Yi-Xuan Xu , Yuan Jiang , Zhi-Hua Zhou

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo.Several variations of ML learning have been proposed, but existing methods all fail to achieve both…

Machine Learning · Statistics 2023-04-24 Xinwei Zhang , Zhiqiang Tan , Zhijian Ou

Incomplete data are a common feature in many domains, from clinical trials to industrial applications. Bayesian networks (BNs) are often used in these domains because of their graphical and causal interpretations. BN parameter learning from…

Machine Learning · Statistics 2025-01-13 Andrea Ruggieri , Francesco Stranieri , Fabio Stella , Marco Scutari

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized…

Methodology · Statistics 2021-04-13 Yutao Liu , Andrew Gelman , Qixuan Chen

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in…

Machine Learning · Computer Science 2022-07-04 Vinitra Swamy , Bahar Radmehr , Natasa Krco , Mirko Marras , Tanja Käser

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

We systematically investigate the links between price returns and Environment, Social and Governance (ESG) scores in the European equity market. Using interpretable machine learning, we examine whether ESG scores can explain the part of…

Portfolio Management · Quantitative Finance 2023-04-10 Jérémi Assael , Laurent Carlier , Damien Challet

The use of multivariate classifiers, especially neural networks and decision trees, has become commonplace in particle physics. Typically, a series of classifiers is trained rather than just one to enhance the performance; this is known as…

Nuclear Experiment · Physics 2015-06-16 Justin Stevens , Mike Williams

Energy-based models (EBMs) have become increasingly popular within computer vision in recent years. While they are commonly employed for generative image modeling, recent work has applied EBMs also for regression tasks, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Fredrik K. Gustafsson , Martin Danelljan , Radu Timofte , Thomas B. Schön