English
Related papers

Related papers: Understanding the Limits of Deep Tabular Methods w…

200 papers

Deep learning advancements have revolutionized scalable classification in many domains including computer vision. However, when it comes to wearable-based classification and domain adaptation, existing computer vision-based deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Yidong Zhu , Md Mahmudur Rahman , Mohammad Arif Ul Alam

Conformal prediction has emerged as a rigorous means of providing deep learning models with reliable uncertainty estimates and safety guarantees. Yet, its performance is known to degrade under distribution shift and long-tailed class…

Machine Learning · Computer Science 2023-07-06 Kevin Kasa , Graham W. Taylor

Heterogeneous tabular data are the most commonly used form of data and are essential for numerous critical and computationally demanding applications. On homogeneous data sets, deep neural networks have repeatedly shown excellent…

Machine Learning · Computer Science 2023-01-24 Vadim Borisov , Tobias Leemann , Kathrin Seßler , Johannes Haug , Martin Pawelczyk , Gjergji Kasneci

Tabular data underpins decisions across science, industry, and public services. Despite rapid progress, advances in deep learning have not fully carried over to the tabular domain, where gradient-boosted decision trees (GBDTs) remain a…

Machine Learning · Computer Science 2025-11-21 David Bonet , Marçal Comajoan Cara , Alvaro Calafell , Daniel Mas Montserrat , Alexander G. Ioannidis

Tabular data is prevalent in real-world machine learning applications, and new models for supervised learning of tabular data are frequently proposed. Comparative studies assessing the performance of models typically consist of…

Machine Learning · Computer Science 2024-12-19 Andrej Tschalzev , Sascha Marton , Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

Recently, evolving networks are becoming a suitable form to model many real-world complex systems, due to their peculiarities to represent the systems and their constituting entities, the interactions between the entities and the…

Artificial Intelligence · Computer Science 2017-09-21 Angelo Impedovo , Corrado Loglisci , Michelangelo Ceci

This paper is concerned with a nonparametric regression problem in which the input variables and the errors are autocorrelated in time. The motivation for the research stems from modeling wind power curves. Using existing model selection…

Applications · Statistics 2024-09-13 Abhinav Prakash , Rui Tuo , Yu Ding

Recently deep neural networks demonstrate competitive performances in classification and regression tasks for many temporal or sequential data. However, it is still hard to understand the classification mechanisms of temporal deep neural…

Machine Learning · Computer Science 2020-07-13 Sohee Cho , Ginkyeng Lee , Wonjoon Chang , Jaesik Choi

Deep learning performs remarkably well on many time series analysis tasks recently. The superior performance of deep neural networks relies heavily on a large number of training data to avoid overfitting. However, the labeled data of many…

Machine Learning · Computer Science 2022-04-04 Qingsong Wen , Liang Sun , Fan Yang , Xiaomin Song , Jingkun Gao , Xue Wang , Huan Xu

Machine learning models deployed in non-stationary environments are exposed to temporal distribution shift, which can erode predictive reliability over time. While common mitigation strategies such as periodic retraining and recalibration…

Machine Learning · Computer Science 2026-04-06 Naimur Rahman , Naazreen Tabassum

Real-world tabular learning production scenarios typically involve evolving data streams, where data arrives continuously and its distribution may change over time. In such a setting, most studies in the literature regarding supervised…

Machine Learning · Computer Science 2024-09-17 Kodjo Mawuena Amekoe , Mustapha Lebbah , Gregoire Jaffre , Hanene Azzag , Zaineb Chelly Dagdia

Deep learning methods in the literature are commonly benchmarked on image data sets, which may not be suitable or effective baselines for non-image tabular data. In this paper, we take a data-centric view to perform one of the first studies…

Machine Learning · Computer Science 2023-01-12 Sakib Abrar , Ali Sekmen , Manar D. Samad

Long-horizon tasks, which have a large discount factor, pose a challenge for most conventional reinforcement learning (RL) algorithms. Algorithms such as Value Iteration and Temporal Difference (TD) learning have a slow convergence rate and…

Machine Learning · Computer Science 2024-09-04 Mark Bedaywi , Amin Rakhsha , Amir-massoud Farahmand

Pre-training is prevalent in deep learning for vision and text data, leveraging knowledge from other datasets to enhance downstream tasks. However, for tabular data, the inherent heterogeneity in attribute and label spaces across datasets…

Machine Learning · Computer Science 2025-02-13 Han-Jia Ye , Qi-Le Zhou , Huai-Hong Yin , De-Chuan Zhan , Wei-Lun Chao

Modern deep models are trained on large real-world datasets, where data quality varies and redundancy is common. Data-centric approaches such as dataset pruning have shown promise in improving training efficiency and model performance.…

Machine Learning · Computer Science 2025-07-18 Suorong Yang , Peijia Li , Yujie Liu , Zhiming Xu , Peng Ye , Wanli Ouyang , Furao Shen , Dongzhan Zhou

The main challenge in domain generalization (DG) is to handle the distribution shift problem that lies between the training and test data. Recent studies suggest that test-time training (TTT), which adapts the learned model with test data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Liang Chen , Yong Zhang , Yibing Song , Ying Shan , Lingqiao Liu

In several real world applications, machine learning models are deployed to make predictions on data whose distribution changes gradually along time, leading to a drift between the train and test distributions. Such models are often…

Machine Learning · Computer Science 2021-11-23 Anshul Nasery , Soumyadeep Thakur , Vihari Piratla , Abir De , Sunita Sarawagi

Temporal point process as the stochastic process on continuous domain of time is commonly used to model the asynchronous event sequence featuring with occurrence timestamps. Thanks to the strong expressivity of deep neural networks, they…

Machine Learning · Computer Science 2024-12-25 Haitao Lin , Cheng Tan , Lirong Wu , Zhangyang Gao , Zicheng Liu , Stan. Z. Li

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

Artificial Intelligence · Computer Science 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang

Nowadays, time series forecasting is predominantly approached through the end-to-end training of deep learning architectures using error-based objectives. While this is effective at minimizing average loss, it encourages the encoder to…

Machine Learning · Computer Science 2026-03-26 Jiacheng Wang , Liang Fan , Baihua Li , Luyan Zhang