English
Related papers

Related papers: SHAPNN: Shapley Value Regularized Tabular Neural N…

200 papers

Recent theoretical studies proved that deep neural network (DNN) estimators obtained by minimizing empirical risk with a certain sparsity constraint can attain optimal convergence rates for regression and classification problems. However,…

Statistics Theory · Mathematics 2021-08-10 Ilsang Ohn , Yongdai Kim

The growing adoption of machine learning models for biological sequences has intensified the need for interpretable predictions, with Shapley values emerging as a theoretically grounded standard for model explanation. While effective for…

Machine Learning · Computer Science 2025-05-23 Darin Tsui , Aryan Musharaf , Yigit Efe Erginbas , Justin Singh Kang , Amirali Aghazadeh

Deep learning has been the engine powering many successes of data science. However, the deep neural network (DNN), as the basic model of deep learning, is often excessively over-parameterized, causing many difficulties in training,…

Machine Learning · Statistics 2021-03-09 Yan Sun , Qifan Song , Faming Liang

This paper presents a predictive model for estimating regularization parameters of diffeomorphic image registration. We introduce a novel framework that automatically determines the parameters controlling the smoothness of diffeomorphic…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Jian Wang , Miaomiao Zhang

Algorithmic decisions in critical domains such as hiring, college admissions, and lending are often based on rankings. Given the impact of these decisions on individuals, organizations, and population groups, it is essential to understand…

Artificial Intelligence · Computer Science 2025-07-29 Venetia Pliatsika , Joao Fonseca , Kateryna Akhynko , Ivan Shevchenko , Julia Stoyanovich

Data augmentation via synthetic data generation has been shown to be effective in improving model performance and robustness in the context of scarce or low-quality data. Using the data valuation framework to statistically identify…

Machine Learning · Computer Science 2025-02-11 Tommaso Ferracci , Leonie Tabea Goldmann , Anton Hinel , Francesco Sanna Passino

Strong intelligent machines powered by deep neural networks are increasingly deployed as black boxes to make decisions in risk-sensitive domains, such as finance and medical. To reduce potential risk and build trust with users, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Lingyang Chu , Xia Hu , Juhua Hu , Lanjun Wang , Jian Pei

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

Machine Learning · Computer Science 2019-10-23 Xinjie Lan , Kenneth E. Barner

Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost with respect to the…

Machine Learning · Computer Science 2022-12-06 Gabriel Laberge , Yann Pequignot

In addition to being extremely non-linear, modern problems require millions if not billions of parameters to solve or at least to get a good approximation of the solution, and neural networks are known to assimilate that complexity by…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-14 Habib Ben Abdallah , Christopher J. Henry , Sheela Ramanna

As Artificial Intelligence (AI) integrates deeper into diverse sectors, the quest for powerful models has intensified. While significant strides have been made in boosting model capabilities and their applicability across domains, a glaring…

Machine Learning · Computer Science 2023-10-05 Shiyun Wa , Xinai Lu , Minjuan Wang

Recent advancements in signal processing and machine learning domains have resulted in an extensive surge of interest in deep learning models due to their unprecedented performance and high accuracy for different and challenging problems of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Atefeh Shahroudnejad , Arash Mohammadi , Konstantinos N. Plataniotis

In this growing age of data and technology, large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex data patterns. The deficiency of these methods, however, is their…

Machine Learning · Computer Science 2026-04-09 Justin Lin , Julia Fukuyama

Hollmann et al. (Nature 637 (2025) 319-326) recently introduced TabPFN, a transformer-based deep learning model for regression and classification on tabular data, which they claim "outperforms all previous methods on datasets with up to…

Machine Learning · Computer Science 2025-12-01 Qiong Zhang , Yan Shuo Tan , Qinglong Tian , Pengfei Li

Fully connected deep neural networks (DNN) often include redundant weights leading to overfitting and high memory requirements. Additionally, the performance of DNN is often challenged by traditional machine learning models in tabular data…

Machine Learning · Computer Science 2022-05-18 Manar Samad , Sakib Abrar

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

The combination of deep neural nets and theory-driven models, which we call deep grey-box modeling, can be inherently interpretable to some extent thanks to the theory backbone. Deep grey-box models are usually learned with a regularized…

Machine Learning · Computer Science 2022-10-25 Naoya Takeishi , Alexandros Kalousis

Deep neural networks (DNNs) have achieved extraordinary success in numerous areas. However, to attain this success, DNNs often carry a large number of weight parameters, leading to heavy costs of memory and computation resources.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Rongrong Ma , Jianyu Miao , Lingfeng Niu , Peng Zhang

2. In Section 3, we used some vague statements to affirm the training process of the neural network, which cannot support others to reproduce the results of the paper. In addition, this section does not show the difference between this…

Optimization and Control · Mathematics 2020-07-01 Liang Xue , Jie Liu , Guilin Wen , Hongxin Wang

Training deep neural networks (DNNs) in the presence of noisy labels is an important and challenging task. Probabilistic modeling, which consists of a classifier and a transition matrix, depicts the transformation from true labels to noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Xianbin Lv , Dongxian Wu , Shu-Tao Xia