English
Related papers

Related papers: InterpreTabNet: Distilling Predictive Signals from…

200 papers

Sleep staging is fundamental for sleep assessment and disease diagnosis. Although previous attempts to classify sleep stages have achieved high classification performance, several challenges remain open: 1) How to effectively extract…

Machine Learning · Computer Science 2021-05-31 Ziyu Jia , Youfang Lin , Jing Wang , Xuehui Wang , Peiyi Xie , Yingbin Zhang

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

Timeseries regression models often struggle to leverage large volumes of labeled multimodal data, particularly when the data are irregularly sampled or contain missing values. This is common in domains like healthcare and predictive…

Machine Learning · Computer Science 2026-05-18 Antoine Honoré , Ming Xiao

Interpreting the inner workings of neural models is a key step in ensuring the robustness and trustworthiness of the models, but work on neural network interpretability typically faces a trade-off: either the models are too constrained to…

Computation and Language · Computer Science 2020-11-11 Phong Le , Willem Zuidema

Self-supervised pre-trained models such as HuBERT and WavLM leverage unlabeled speech data for representation learning and offer significantly improve for numerous downstream tasks. Despite the success of these methods, their large memory…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Yingying Gao , Shilei Zhang , Zihao Cui , Yanhan Xu , Chao Deng , Junlan Feng

The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of achieving the…

Machine Learning · Computer Science 2020-02-14 Gabriel Terejanu , Jawad Chowdhury , Rezaur Rashid , Asif Chowdhury

Image translation between two domains is a class of problems aiming to learn mapping from an input image in the source domain to an output image in the target domain. It has been applied to numerous domains, such as data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Chao Yang , Taehwan Kim , Ruizhe Wang , Hao Peng , C. -C. Jay Kuo

This paper proposes a general interpretable predictive system with shared information. The system is able to perform predictions in a multi-task setting where distinct tasks are not bound to have the same input/output structure. Embeddings…

Machine Learning · Computer Science 2024-07-02 Maciej Żelaszczyk , Jacek Mańdziuk

Attention mechanisms are ubiquitous components in neural architectures applied to natural language processing. In addition to yielding gains in predictive accuracy, attention weights are often claimed to confer interpretability, purportedly…

Computation and Language · Computer Science 2020-04-08 Danish Pruthi , Mansi Gupta , Bhuwan Dhingra , Graham Neubig , Zachary C. Lipton

Tabular data are fundamental in common machine learning applications, ranging from finance to genomics and healthcare. This paper focuses on tabular regression tasks, a field where deep learning (DL) methods are not consistently superior to…

Machine Learning · Computer Science 2024-12-17 Hong-Wei Wu , Wei-Yao Wang , Kuang-Da Wang , Wen-Chih Peng

The analysis of tabular data has traditionally been dominated by gradient-boosted decision trees (GBDTs), known for their proficiency with mixed categorical and numerical features. However, recent deep learning innovations are challenging…

Machine Learning · Computer Science 2025-03-26 Anton Frederik Thielmann , Manish Kumar , Christoph Weisser , Arik Reuter , Benjamin Säfken , Soheila Samiee

Autoregressive and Masked Transformers are incredibly effective as generative models and classifiers. While these models are most prevalent in NLP, they also exhibit strong performance in other domains, such as vision. This work contributes…

Machine Learning · Computer Science 2023-12-12 Manbir S Gulati , Paul F Roysdon

Tabular anomaly detection under the one-class classification setting poses a significant challenge, as it involves accurately conceptualizing "normal" derived exclusively from a single category to discern anomalies from normal data…

Machine Learning · Computer Science 2024-12-18 Jianan Ye , Zhaorui Tan , Yijie Hu , Xi Yang , Guangliang Cheng , Kaizhu Huang

Tabular foundation models like TabPFN and TabICL achieve state-of-the-art performance through in-context learning, yet their architectures remain fundamentally opaque. We introduce KernelICL, a framework to enhance tabular foundation models…

Machine Learning · Computer Science 2026-02-03 Ratmir Miftachov , Bruno Charron , Simon Valentin

Automated diagnosis with artificial intelligence has emerged as a promising area in the realm of medical imaging, while the interpretability of the introduced deep neural networks still remains an urgent concern. Although contemporary…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Binghua Li , Jie Mao , Zhe Sun , Chao Li , Qibin Zhao , Toshihisa Tanaka

We present an attention mechanism inspired from definition of screened Coulomb potential. This attention mechanism was used to interpret the Graph Attention (GAT) model layers and training dataset by using a flexible and scalable framework…

Machine Learning · Computer Science 2019-12-19 Burc Gokden

Downsampling-based methods for time series forecasting have attracted increasing attention due to their superiority in capturing sequence trends. However, this approaches mainly capture dependencies within subsequences but neglect…

Computational Engineering, Finance, and Science · Computer Science 2026-01-21 Zhangyao Song , Nanqing Jiang , Miaohong He , Xiaoyu Zhao , Tao Guo

Large language models (LLMs) are increasingly exposed to data contamination, i.e., performance gains driven by prior exposure of test datasets rather than generalization. However, in the context of tabular data, this problem is largely…

Computation and Language · Computer Science 2026-03-31 Matteo Silvestri , Fabiano Veglianti , Flavio Giorgi , Fabrizio Silvestri , Gabriele Tolomei

Forecasting in financial markets remains a significant challenge due to their nonlinear and regime-dependent dynamics. Traditional deep learning models, such as long short-term memory networks and multilayer perceptrons, often struggle to…

Machine Learning · Computer Science 2026-03-24 Vidhi Oad , Param Pathak , Nouhaila Innan , Shalini D , Muhammad Shafique

Tabular neural network (NN) has attracted remarkable attentions and its recent advances have gradually narrowed the performance gap with respect to tree-based models on many public datasets. While the mainstreams focus on calibrating NN to…

Machine Learning · Computer Science 2024-03-05 Xuan Li , Yun Wang , Bo Li